Search found 53125 matches
- Tue Jan 15, 2008 2:20 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: dsenv and performance tuning
- Replies: 15
- Views: 6423
%CPU as reported by the monitor is usually wrong, for the same reasons that rows/sec is usually wrong. The clock is running even when rows are not being processed, and the time is rounded to whole seconds before the division has been done - %CPU is calculated as (CPU seconds) / (clock seconds) * 100...
- Tue Jan 15, 2008 2:16 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Strange behaviour of multiple instances
- Replies: 10
- Views: 4463
Each instance needs a unique invocation ID. I suspect that you've run one instance with no invocation ID, and all the rest with the same invocation ID, which would result in one of them running and the remainder aborting because the job is already running. But do identify the real cause of the probl...
- Tue Jan 15, 2008 2:13 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to read TAB delimited files using Folder Stage ??
- Replies: 3
- Views: 1769
- Tue Jan 15, 2008 2:09 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Create Account Name for a Hashed File
- Replies: 6
- Views: 1764
- Tue Jan 15, 2008 2:07 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Reading datastage log files in unix
- Replies: 4
- Views: 6761
Source is either a Hashed File stage or UniVerse stage. Table name is RT_LOGnnn, where nnn is the job number from DS_JOBS. I assume you can use a Sequential File stage to create your delimited text file. Search the forum for the column definitions in RT_LOGnnn. You will need to create them in the Re...
- Tue Jan 15, 2008 2:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: problem buliding extraction objects in abap extract
- Replies: 3
- Views: 1364
- Tue Jan 15, 2008 2:02 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to View Data from Informix CLI Stage
- Replies: 12
- Views: 6463
- Tue Jan 15, 2008 1:54 pm
- Forum: General
- Topic: SAP 999 line limitation
- Replies: 3
- Views: 1971
Yes, by using sorted data and stage variables to remember the header information and count the detail items. What is the source? You may find it easier to extract 950 line items at a time for any one header than to try to do it in DataStage. For example the UNIX command split can divide a file into ...
- Mon Jan 14, 2008 11:02 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generating multiple rows based on the data of 2 input column
- Replies: 12
- Views: 4289
If you can tell me how to generate an arbitrary number of rows out of a Transformer stage for each row in, I'd be happy to know it. There is a kluge where you use - typically - a routine to generate a long string with a line terminator between each generated "output row", and output that to a sequen...
- Mon Jan 14, 2008 9:12 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Agg,1: Hash table has grown to 16384 entries.
- Replies: 9
- Views: 25292
- Mon Jan 14, 2008 9:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Inline sort or external sort
- Replies: 7
- Views: 2904
It's a "rule of thumb" rather than a hard and fast rule. The hash table, in which every distinct combination of key values plus all calculated/counted output columns are stored, must fit in physical memory. If they won't, use Sort. If you're not sure, use Sort. With Sort, memory can be freed (and on...
- Mon Jan 14, 2008 9:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash table (hash partition)
- Replies: 4
- Views: 1018
Process data containing fewer distinct reference key values would be one way. Use more partitions would help too. Finding a different strategy, such as a sparse lookup or a Join or Merge stage might be another alternative. As you note, it is only an alert. You could create a message handler to demot...
- Mon Jan 14, 2008 9:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DMEMOFF, PMEMOFF, LDR_CNTRL
- Replies: 3
- Views: 3725
You need a lot more knowledge about the way that the DataStage works in order to make any sense of these. In short, there are up to four separate shared memory segments, the so-called "disk" shared memory segment, in which lock tables and other "disk-related" structures are stored; a "printer" share...
- Mon Jan 14, 2008 8:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generating multiple rows based on the data of 2 input column
- Replies: 12
- Views: 4289
4 not 14? The reason is already in original post: "brain's half dead". External filter stage that runs a shell script to iterate through the values is one way, if you're comfortable with scripting. Build stage to iterate through the values is another way, if you're comfortable with C++ coding. There...
- Mon Jan 14, 2008 6:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise : Unrecognized argument
- Replies: 2
- Views: 1061