Search found 4992 matches
- Sun Feb 29, 2004 2:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: [Resolved]Poor Performance high CPU%
- Replies: 16
- Views: 4740
This sounds suspicious to me. Since jobs that connect to DB's and spool to sequential files should have very little load on the DS server cpu, as all the job has to do is spool output to a file, it seems strange to me. Now, you have a design of passive-->passive, which is a bad idea. You should stic...
- Fri Feb 27, 2004 2:40 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Long running SQL server bulk load
- Replies: 7
- Views: 1662
- Fri Feb 27, 2004 12:57 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Long running SQL server bulk load
- Replies: 7
- Views: 1662
After a few years you sometimes just wonder why you even bother programming it via DataStage. Now I did not even come close to suggesting this. I think a perspective must be kept and that not everything has to be inside the tool. Your toolbelt should have as many tools in it and your judgement shou...
- Fri Feb 27, 2004 10:22 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Long running SQL server bulk load
- Replies: 7
- Views: 1662
Shawn, let's be quite clear to everyone out there that DataStage does not bulk load data. Its bulk loader stages either invoke the respective database bulk loader command to perform the load, or write the necessary control files to use with the command line bulk loader. In either case, DataStage spo...
- Fri Feb 27, 2004 8:58 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Long running SQL server bulk load
- Replies: 7
- Views: 1662
Because the DS bulk loader stages have performance issues in that they re-verify the data content while spooling the load file. The stages are meant to make life simple for those not experienced with bulk loaders. If you have the skill to insure a proper load file, then skip using the Stage and just...
- Fri Feb 27, 2004 8:55 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Can I transform an input file field?
- Replies: 11
- Views: 1983
- Fri Feb 27, 2004 7:01 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Can I transform an input file field?
- Replies: 11
- Views: 1983
Any logic that prepares the hash file has to first get the primary key value into the right condition. In the jobs that load the reference data into the hash file put onto the primary key column derivation the necessary logic to standardize/homogenize the data. Then, you have no need to do in the tr...
- Fri Feb 27, 2004 6:48 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Problem in job running, design...
- Replies: 11
- Views: 2883
How is the job designed? Is the stored procedure being called in an OCI stage, or are you talking about a Sequencer job that is executing a Command stage that executes a stored procedure? Are you sure that the stored procedure has not begun execution? Still highly confused as we do not have the nece...
- Thu Feb 26, 2004 11:36 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Capturing delta
- Replies: 1
- Views: 628
If you have the means to detect deltas in the source system via an last update timestamp then by all means use it. It allows you to extract only the row necessary for processing, thus reducing network and pipeline traffic. Your issue is if you need to pull the parent again. Since your delta detectio...
- Thu Feb 26, 2004 10:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Problem in job running, design...
- Replies: 11
- Views: 2883
We need a lot more information. What kind of jobs are hanging? Are they having database connections? Can you describe the condition of hanging? Are you finding that the job is running, and never finishes? That the link statistics stop changing? That the underlying unix processes disappear? Are the j...
- Thu Feb 26, 2004 2:02 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Need help starting an insert of records to Oracle job
- Replies: 5
- Views: 1391
- Thu Feb 26, 2004 2:00 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ORABULK
- Replies: 4
- Views: 1459
Search this forum, it's been covered in depth how this stage works. In a nutshell, it writes a data file (very slowly) and a control file. You will need to execute sqlldr and give it the control file, credentials, etc. to load the table. One good suggestion is a generic script that accepts a control...
- Thu Feb 26, 2004 1:52 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Need help starting an insert of records to Oracle job
- Replies: 5
- Views: 1391
Have you been thru training? If not, have you looked into the tutorial? If not, have you read the online documentation available under the Start button? I'm sure you can find examples in all of the documentation and manuals that show and describe how to do all of what you want. If you have specific ...
- Thu Feb 26, 2004 1:49 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ORABULK
- Replies: 4
- Views: 1459
- Thu Feb 26, 2004 11:51 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: DSSETPARAM
- Replies: 6
- Views: 1737