Search found 53125 matches

by ray.wurlod
Tue Jul 05, 2016 5:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Optimal ETL design for missing row
Replies: 8
Views: 3959

Visit the data provider and make appropriate threats! :lol:

I'd probably generate a full set of rows using a Row Generator stage and left outer join that to the provided data.
by ray.wurlod
Tue Jul 05, 2016 5:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Control Code Characterset Issue
Replies: 20
Views: 16617

I think it might be a byte order issue, as Craig suspects.
by ray.wurlod
Tue Jul 05, 2016 4:58 pm
Forum: General
Topic: Connector Conversion Tool
Replies: 5
Views: 2317

They're running on version 9.1.fp1. I don't think it's available at that version. Maybe with Fix Pack 2 (would have to research that).
by ray.wurlod
Tue Jul 05, 2016 4:56 pm
Forum: General
Topic: What's the best method to write complex derivations?
Replies: 18
Views: 6433

Expressions in parallel transformer stages are actually in BASIC. They are translated to C++ during "compilation". However, multi-statement blocks are not available in expressions; indeed no form of statement is available in an expression. I continue to maintain that your example could be ...
by ray.wurlod
Thu Jun 30, 2016 11:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: GS1 XSD
Replies: 0
Views: 1182

GS1 XSD

Does anyone have experiences (ideally successes) with using any of the XML or Hierarchical Data stage types to work with XML data described by the GS1 XSD schemas (http://www.gs1.org/edi-xml/technical-us ... _hierarchy)?
by ray.wurlod
Thu Jun 30, 2016 5:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Content LongVarBinary to Image
Replies: 1
Views: 1544

Try explicitly setting Precision to 65535 for that column.
by ray.wurlod
Thu Jun 30, 2016 5:12 pm
Forum: General
Topic: What's the best method to write complex derivations?
Replies: 18
Views: 6433

No, complex expressions are OK in DataStage BASIC, but you have to know the rule that every multi-statement block has to be terminated with an END statement. However, in a derivation expression things are different. You're right that you cannot assign work variables (use stage variables for these). ...
by ray.wurlod
Thu Jun 30, 2016 5:02 pm
Forum: General
Topic: DataStage Certifications
Replies: 9
Views: 4977

Certifications are usually either free or heavily discounted if you take them at IBM conferences, such as World of Watson next October in Las Vegas (the conference formerly known as IBM Insight).
by ray.wurlod
Wed Jun 29, 2016 4:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformation Logic
Replies: 6
Views: 3960

If the data are accurate and accurately sorted you could use a Remove Duplicates stage and keep just the Last value from Column B for each group of Column A values.
by ray.wurlod
Wed Jun 29, 2016 4:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: question regarding datastage runtime and design time process
Replies: 3
Views: 1641

The connection should be via the node agent to the ASB Server, and then to the Connector Access Service.

You could create a logging view on CAS to see what is happening.
by ray.wurlod
Tue Jun 28, 2016 11:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 7310

Take a look at the Resource Estimation tool (and, possibly, Performance Analysis tool) in DataStage Designer.

Have you implemented DataStage Operations Console (which was new in version 8.7)? IF so, that would show you much more useful information.
by ray.wurlod
Tue Jun 28, 2016 11:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Record Count from Lookup is only showing in Node 0.
Replies: 1
Views: 1505

For Entire partitioning there is no point in reporting the other nodes.

Indeed, in an SMP environment, only one copy of the data exists, stored in shared memory that is accessible by all nodes.
by ray.wurlod
Tue Jun 28, 2016 11:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Connector x SQL Server Enterprise (which one do I use?)
Replies: 1
Views: 940

Given that most Enterprise (and older plug-in) stage types are being phased out in version 11.5, I would counsel using Connector stage types as much as possible.
by ray.wurlod
Tue Jun 28, 2016 11:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with Sequential File Stage - No Metadata Rejects
Replies: 3
Views: 2180

Assuming that all three columns are defined as VarChar, there is nothing wrong with your data from a metadata perspective.
by ray.wurlod
Tue Jun 28, 2016 11:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Restrict rows processed in a job
Replies: 6
Views: 2546

:wink:

One of my "must do" tasks when a new release becomes available is to explore all the menus. If I have time, I create a lightly documented menu map (for my own convenience).