Search found 53125 matches

by ray.wurlod
Tue Jan 15, 2008 2:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: dsenv and performance tuning
Replies: 15
Views: 6423

%CPU as reported by the monitor is usually wrong, for the same reasons that rows/sec is usually wrong. The clock is running even when rows are not being processed, and the time is rounded to whole seconds before the division has been done - %CPU is calculated as (CPU seconds) / (clock seconds) * 100...
by ray.wurlod
Tue Jan 15, 2008 2:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange behaviour of multiple instances
Replies: 10
Views: 4463

Each instance needs a unique invocation ID. I suspect that you've run one instance with no invocation ID, and all the rest with the same invocation ID, which would result in one of them running and the remainder aborting because the job is already running. But do identify the real cause of the probl...
by ray.wurlod
Tue Jan 15, 2008 2:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to read TAB delimited files using Folder Stage ??
Replies: 3
Views: 1769

It would be more efficient to use a Sequential File stage, with the COPY command added to it as a Filter command. The Sequential File stage reads the output of the Filter command.
by ray.wurlod
Tue Jan 15, 2008 2:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Create Account Name for a Hashed File
Replies: 6
Views: 1764

What worked? Did you leave it blank, enter the name of the current project, or enter the name of a different project? The third of these options carries certain intrinsic dangers - what if someone using the other project deletes the hashed file?
by ray.wurlod
Tue Jan 15, 2008 2:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading datastage log files in unix
Replies: 4
Views: 6761

Source is either a Hashed File stage or UniVerse stage. Table name is RT_LOGnnn, where nnn is the job number from DS_JOBS. I assume you can use a Sequential File stage to create your delimited text file. Search the forum for the column definitions in RT_LOGnnn. You will need to create them in the Re...
by ray.wurlod
Tue Jan 15, 2008 2:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: problem buliding extraction objects in abap extract
Replies: 3
Views: 1364

Do you have write permission to the directory into which the extraction objects would be written?
by ray.wurlod
Tue Jan 15, 2008 2:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to View Data from Informix CLI Stage
Replies: 12
Views: 6463

The difference is how the table was created. Yours is one of the second kind. CREATE [TEMP]TABLE name1 (definition); CREATE [TEMP] TABLE name2 (definition) WITH NO LOG; When viewed through ODBC, Informix generates an informational message that you are using a "non logging" table. Ask...
by ray.wurlod
Tue Jan 15, 2008 1:54 pm
Forum: General
Topic: SAP 999 line limitation
Replies: 3
Views: 1971

Yes, by using sorted data and stage variables to remember the header information and count the detail items. What is the source? You may find it easier to extract 950 line items at a time for any one header than to try to do it in DataStage. For example the UNIX command split can divide a file into ...
by ray.wurlod
Mon Jan 14, 2008 11:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating multiple rows based on the data of 2 input column
Replies: 12
Views: 4289

If you can tell me how to generate an arbitrary number of rows out of a Transformer stage for each row in, I'd be happy to know it. There is a kluge where you use - typically - a routine to generate a long string with a line terminator between each generated "output row", and output that to a sequen...
by ray.wurlod
Mon Jan 14, 2008 9:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline sort or external sort
Replies: 7
Views: 2904

It's a "rule of thumb" rather than a hard and fast rule. The hash table, in which every distinct combination of key values plus all calculated/counted output columns are stored, must fit in physical memory. If they won't, use Sort. If you're not sure, use Sort. With Sort, memory can be freed (and on...
by ray.wurlod
Mon Jan 14, 2008 9:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash table (hash partition)
Replies: 4
Views: 1018

Process data containing fewer distinct reference key values would be one way. Use more partitions would help too. Finding a different strategy, such as a sparse lookup or a Join or Merge stage might be another alternative. As you note, it is only an alert. You could create a message handler to demot...
by ray.wurlod
Mon Jan 14, 2008 9:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DMEMOFF, PMEMOFF, LDR_CNTRL
Replies: 3
Views: 3725

You need a lot more knowledge about the way that the DataStage works in order to make any sense of these. In short, there are up to four separate shared memory segments, the so-called "disk" shared memory segment, in which lock tables and other "disk-related" structures are stored; a "printer" share...
by ray.wurlod
Mon Jan 14, 2008 8:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating multiple rows based on the data of 2 input column
Replies: 12
Views: 4289

4 not 14? The reason is already in original post: "brain's half dead". External filter stage that runs a shell script to iterate through the values is one way, if you're comfortable with scripting. Build stage to iterate through the values is another way, if you're comfortable with C++ coding. There...
by ray.wurlod
Mon Jan 14, 2008 6:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Enterprise : Unrecognized argument
Replies: 2
Views: 1061

When you import the table definition do the database name and table name work properly?

Is it expecting the owner name rather than the database name in this syntax? It's more usual to connect to the database, then specify owner.table (or schema.table, if you prefer) as the object being accessed.