Search found 53125 matches

by ray.wurlod
Thu Apr 20, 2006 9:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Sequence Aborting
Replies: 13
Views: 2920

"Failed to open RT_LOG6305 file." suggests that the log (for job number 6305) has become corrupted. Try clearing the log before proceeding to try to run the job again. To find out which is job number 6305

Code: Select all

SELECT NAME FROM DS_JOBS WHERE JOBNO = '6305';
(note that JOBNO is not an integer column).
by ray.wurlod
Thu Apr 20, 2006 9:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: buffer(7),0: sendWriteSignal() failed on node PSADC1UXP031 d
Replies: 1
Views: 2200

Is this on a single (SMP) machine or multiple machines? The error has occured on the first node in the configuration file, and is a failure to write to a pipe. This most usually occurs because the process reading from the pipe is not draining it as fast as the writing process is writing to it, leadi...
by ray.wurlod
Thu Apr 20, 2006 9:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cartesian processing in datastage
Replies: 10
Views: 3595

The Merge stage in server jobs exists specifically to perform joins between text files.
by ray.wurlod
Thu Apr 20, 2006 9:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using sequence in Datastage Sequencer
Replies: 3
Views: 1136

Except that your terminology is confused (you are using a Sequencer in a Job Sequence) the answers are yes, yes and yes.
by ray.wurlod
Thu Apr 20, 2006 9:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3132

Rubbish. You can perform a lookup using the text file as stream and the table (or a hashed file containing appropriate columns from it) to feed the reference input. You don't have to join.
by ray.wurlod
Thu Apr 20, 2006 9:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abnormal termination of DataStage
Replies: 7
Views: 2597

Ask your support provider to (ask IBM support to) VLIST the DSD.OshRun program to find out what is happening at address 1ec8. This may help to determine the likely cause and/or whether there's a bug.
by ray.wurlod
Thu Apr 20, 2006 6:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clean up resources
Replies: 2
Views: 800

Find the table definition for the Sequential File in Manager. Select it. Click Usage Analysis. Provided you have been consistent with managing metadata (only loading into jobs, never changing within jobs) this will show all jobs that use that table definition. You can also use MetaStage to perform a...
by ray.wurlod
Thu Apr 20, 2006 6:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3132

Appending a line to a text file is WAY faster than upserting a row into a database table, and WAY WAY faster if that table has constraints to be checked and/or indices to be maintained. Hence my suggestion to use files for staging. (You can also use these as data files for bulk loading.)
by ray.wurlod
Thu Apr 20, 2006 6:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Meta Data of Elasped time for two streams
Replies: 2
Views: 679

You should be able to capture the stage start (and end) times for the active stages from the job log, and calculate on these bases.
by ray.wurlod
Thu Apr 20, 2006 6:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Default Configuration file
Replies: 5
Views: 1275

Welcome aboard. :D The default configuration file consists of two nodes, which you can call Node0 and Node1 (or anything else you like). The fastname is the name of the machine where DataStage is installed. Each node is only in the default node pool only. Each has one (the same) disk and scratch dis...
by ray.wurlod
Thu Apr 20, 2006 4:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue in Datastage Server Edition
Replies: 13
Views: 3132

Try using staging files rather than staging tables. You'll be amazed how much difference it makes.
by ray.wurlod
Thu Apr 20, 2006 4:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cartesian processing in datastage
Replies: 10
Views: 3595

Not using Transformer.
Perform a full outer join when extracting the data.
by ray.wurlod
Thu Apr 20, 2006 4:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: server jobs in parllel
Replies: 3
Views: 817

Read Chapter 2 of Parallel Job Developer's Guide (the very end of the Chapter) for restrictions on using server job shared containers in parallel jobs.

You can also use the BASIC Transformer (effectively the server Transformer) stage in parallel jobs, except to perform lookups.
by ray.wurlod
Thu Apr 20, 2006 4:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parsing full file for a string
Replies: 4
Views: 876

Hashed file only does a whole-key match.
The solution to this can only be a grep for each name on the input stream, given that the "lookup file" is a file. If it's a database table, then a "LIKE" lookup might be possible, but via a Hashed File stage no.