Search found 42189 matches
- Fri May 12, 2006 10:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job handling in Unix
- Replies: 10
- Views: 7304
you could just run your job via the dsjob -run command and for status put a command like RETURN_VALUE=$? to get the status of your previous command and then print that to a file You should also look into the use of the -jobstatus option rather than the -wait option. Rather than return the 'standard...
- Fri May 12, 2006 9:53 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Suggestions needed to improve the performance(Hashedfile)
- Replies: 26
- Views: 7404
my question regarding Ken's suggestion is that would not joining a 80 mill table with another big table, be slow in itself? Not if it's done properly. We do this all the time, it's a matter of ensuring the query is as optimal as possible. If it takes hints or an additional index, so be it. The net ...
- Fri May 12, 2006 9:19 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Suggestions needed to improve the performance(Hashedfile)
- Replies: 26
- Views: 7404
The key here is to not load all 80 million target records into the hashed used for lookup - there's no need for that. That's what Ken explained - a method to only load the natural keys from the 80 million target records that match up with the staged incremental data. That way your lookup has the min...
- Fri May 12, 2006 9:16 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Suggestions needed to improve the performance(Hashedfile)
- Replies: 26
- Views: 7404
- Fri May 12, 2006 9:14 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Suggestions needed to improve the performance(Hashedfile)
- Replies: 26
- Views: 7404
- Fri May 12, 2006 7:55 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Calling Stored Procedure
- Replies: 7
- Views: 1862
- Fri May 12, 2006 7:41 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Suggestions needed to improve the performance(Hashedfile)
- Replies: 26
- Views: 7404
kris007 wrote:Now, this incremental data, I need to load into the target table based upon the keys found or not found. It is in this second part, where I had a problem. Please let me know if you got any ideas as I didnt seem to follow your post.
Kris, that's basically what Ken explained in his post.
- Fri May 12, 2006 6:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can we use datastage version control to version shell script
- Replies: 8
- Views: 2004
- Fri May 12, 2006 6:10 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to find End of Records
- Replies: 8
- Views: 2576
You could also use a hashed file to perform the grouping - reading from and writing to the same hashed file, keyed by your 'group'. If the record doesn't exist simply write it. If it does, do your aggregation with the current value and the looked up value, then write it back. This way the records do...
- Fri May 12, 2006 6:07 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to find End of Records
- Replies: 8
- Views: 2576
- Fri May 12, 2006 6:05 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: rejecting duplicate rows
- Replies: 5
- Views: 2140
- Fri May 12, 2006 5:54 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: I am not able to accessing the sequence jobs
- Replies: 3
- Views: 1374
- Thu May 11, 2006 6:57 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: search function
- Replies: 7
- Views: 1758
- Thu May 11, 2006 4:01 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Loading multiple files in a single job.
- Replies: 10
- Views: 4603
As long as your operating system supports positive numbers with the 'head' command, I suppose so. On H-PUX it throws the following error:

Code: Select all
+1: No such file or directory- Thu May 11, 2006 2:42 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Error while viewing data
- Replies: 6
- Views: 1266