Search found 53125 matches

by ray.wurlod
Fri May 10, 2013 3:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Issue
Replies: 9
Views: 2758

If the join key is indexed in Oracle it is likely that the join will be resolved in the indexes. Get Oracle to EXPLAIN its plan for resolving the join. This is likely to be far more efficient than anything you can accomplish in DataStage, and will involve less network traffic because you only send t...
by ray.wurlod
Fri May 10, 2013 3:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HOW TO PERFORM USING TRANSFORMER
Replies: 5
Views: 1783

Here is the approach I would use to achieve the requested result. Set up two stage variables in the Transformer stage, called svList (which becomes the output column containing the comma delimited list) and svPrevID. svList initialised to "" svPrevID initialised to -90909090 svList If InLi...
by ray.wurlod
Fri May 10, 2013 3:31 pm
Forum: General
Topic: datastage 8.7 installation on windows 8
Replies: 10
Views: 8689

You have choices. You can run it from a CMD shell, you can right click and add execution options.
by ray.wurlod
Fri May 10, 2013 3:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to extract data from Sequential File
Replies: 1
Views: 1308

Add a reject link to the Sequential File stage itself, to capture any rows that do not match the defined metadata.

For example, are there any empty lines in the file?

The strings captured onto the reject link (which can be written to another file as a single VarChar) will help you to diagnose.
by ray.wurlod
Fri May 10, 2013 3:29 am
Forum: General
Topic: datastage 8.7 installation on windows 8
Replies: 10
Views: 8689

No, that's not right. Use -force as an option for the setup command (or the install command, depending which platform you're on).
by ray.wurlod
Fri May 10, 2013 3:25 am
Forum: IBM QualityStage
Topic: Recognization on junk
Replies: 8
Views: 4110

Quite possibly, translation engines are getting better. But it would not be DataStage/QualityStage doing the work, which was the gist of the original post.
by ray.wurlod
Thu May 09, 2013 4:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Upsert not working (mode is update then insert)
Replies: 6
Views: 4912

Is any of the key columns of data type CHAR in your job but VARCHAR2 in the database? If so, you may need to do some trimming.
by ray.wurlod
Thu May 09, 2013 4:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Input Stage - Cannot Process data
Replies: 9
Views: 3416

Why should it? No other XML parser can.

Demand well-formed XML from your provider.
by ray.wurlod
Thu May 09, 2013 4:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: last day from date
Replies: 5
Views: 2200

Field("31|28|31|30|31|30|31|31|30|31|30|31", "|", MonthFromDate(InLink.TheDate), 1) is a quick way (ignoring leap years) to get the day number of the last day of the month. You can then build the date from components. Use an If..Then..Else derivation for the list to set the last...
by ray.wurlod
Thu May 09, 2013 4:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Performance
Replies: 4
Views: 1494

The answer will depend on many factors, including what other load there is on the server(s). For example you could use 10 Lookup stages and disable operator combination, so that the individual lookups are being performed in separate processes. If not much else is happening on the machine, this would...
by ray.wurlod
Thu May 09, 2013 4:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sort operation
Replies: 4
Views: 1719

Blocking does occur in parallel jobs, but is less apparent because inter-process row buffering is automatically ON. And the buffers are, by default, larger than in server jobs.
by ray.wurlod
Thu May 09, 2013 4:37 pm
Forum: General
Topic: DataStage 9.1 Operations Console Database Supported Versions
Replies: 8
Views: 4606

My understanding is that Microsoft SQL Server 2005 is not supported in version 9.1 (this is also true for the XMETA metadata repository). The others remain supported in version 9.1.
by ray.wurlod
Thu May 09, 2013 4:36 pm
Forum: General
Topic: datastage 8.7 installation on windows 8
Replies: 10
Views: 8689

Windows 8 is not supported.

The -force option causes the installer to ignore all but the most severe errors, but there is no guarantee that the installed software will work properly.
by ray.wurlod
Thu May 09, 2013 4:34 pm
Forum: General
Topic: Subroutine failed to complete successfully (30107)
Replies: 3
Views: 2705

30107 is a fairly generic error, and the issue here is when an attempt was being made to discover some information about the project. It could be something as simple as permissions on the project directory; it may be more complex, like corruption in the project's hashed files. Do you experience the ...
by ray.wurlod
Thu May 09, 2013 4:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HOW TO PERFORM USING TRANSFORMER
Replies: 5
Views: 1783

Is this pivoting into separate columns, or pivoting into a single column as a comma-delimited list.

There's an answer to this not very long back on DSXchange - a Search should find it.

Pivoting into a single column is most easily accomplished using a pair of stage variables.