Search found 6 matches
- Thu Feb 15, 2007 11:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generate numeric duplicate number column
- Replies: 6
- Views: 1274
Alas, Ray, my company is too tight to pay for a premium membership to see most of your posting But the stage variables alternative was straightforward enough. I put a zero in the extra column by default and increment this value each time the other key columns are repeated. Easy! Thank you both very ...
- Tue Feb 13, 2007 12:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generate numeric duplicate number column
- Replies: 6
- Views: 1274
You can do this with stage variables. Use hash partition to ensure that similar keys end up in one partition. Use the stage variables to compare present row with previous row and a increment another stage variable which will be used as your counter. Reset it back if there is a change. You need to t...
- Fri Feb 09, 2007 10:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generate numeric duplicate number column
- Replies: 6
- Views: 1274
Generate numeric duplicate number column
I've imported data from a flat file into a dataset with a compound key based upon 5 columns, which can contain duplicates. I've added a column which I plan to use to uniquely identify each of the duplicates, with values 1,2,3... Can anyone tell me how to generate the numeric value in column 6 within...
- Tue Aug 01, 2006 10:38 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File Stage server vs parallel
- Replies: 4
- Views: 1530
Thanks for the help.
Apparently it is possible to read a CFF with redefines in parallel with a little jiggery-pokery, a switch and a Column Import stage.
The description is on :
http://www.dsxchange.com/viewtopic.php? ... +flat+file
I'm getting nearer but still not quite there...
Regards
JL
Apparently it is possible to read a CFF with redefines in parallel with a little jiggery-pokery, a switch and a Column Import stage.
The description is on :
http://www.dsxchange.com/viewtopic.php? ... +flat+file
I'm getting nearer but still not quite there...
Regards
JL
- Mon Jul 31, 2006 1:52 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File Stage server vs parallel
- Replies: 4
- Views: 1530
Thanks for your reply, Ray. I'm just trying to do what seems to be the obvious thing (well, it is very easy to do with the server CFF stage), that is, to read a record in the CFF stage. Then, according to the value of the record id (record type), to branch off to process the record appropriately to ...
- Fri Jul 28, 2006 10:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File Stage server vs parallel
- Replies: 4
- Views: 1530
Complex Flat File Stage server vs parallel
I'm writing a parallel job to read a complex flat file (defined by COBOL Copybook) and interpret the data according to an ID field, signifying which of the REDEFINES sections applies. I can do this in a server job fairly easily and intuitively with multiple output links, defining the select columns ...