its working for some records not all, do i need to change anyhting with partitioning property as job runs with 4 node config file..
Thanks.
Search found 253 matches
- Fri Feb 20, 2015 2:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sort with remove Dups
- Replies: 5
- Views: 3789
- Wed Feb 18, 2015 11:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sort with remove Dups
- Replies: 5
- Views: 3789
Sort with remove Dups
To get the latest row based on the key columns i am using sort with remove duplicates stage, however its working for some records but not all, also seeing dups. Input--->Sort--->remove Dups--->Output Here is the data.. COL1 COL2 COL3 COL4 COL5 1 02/01/2015 02/28/2015 02/18/2015 01 1 03/01/2015 12/31...
- Fri Jan 23, 2015 6:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash file equavalant in parallel Job
- Replies: 2
- Views: 3125
- Mon Jan 19, 2015 5:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash file equavalant in parallel Job
- Replies: 2
- Views: 3125
Hash file equavalant in parallel Job
I was trying to design a job to load data into oracle table, before table load i would like to compare the records based on the primary key which consists of 4 keys, if record already exists then log those records into file, if not insert those records. In server job i would have create hash file ba...
- Fri Jan 09, 2015 8:58 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Alphanumeric data
- Replies: 6
- Views: 3361
Alphanumeric data
I was trying to process only numeric data in a file based on a particular column and track other records with Alpha numeric. i used num(column)=1 to process recrods with numeric data, however when i try to use num(column)<>1 to track records with alphanumeric records, could you please suggest me wha...
- Sun Oct 26, 2014 6:40 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading sequential file in the order of file
- Replies: 7
- Views: 4624
- Sat Oct 25, 2014 5:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading sequential file in the order of file
- Replies: 7
- Views: 4624
- Fri Oct 24, 2014 8:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading sequential file in the order of file
- Replies: 7
- Views: 4624
Reading sequential file in the order of file
I was trying to read sequential file in the order of the records written in the file but it's not reading in the order.i know we can use sort stage if we know sorted columns.
My question is ..is they a way we can read data in the order of original file with out sort stage in parallel job.
My question is ..is they a way we can read data in the order of original file with out sort stage in parallel job.
- Tue Jun 11, 2013 8:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup output values
- Replies: 9
- Views: 4629
- Tue Jun 11, 2013 7:42 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup output values
- Replies: 9
- Views: 4629
- Tue Jun 11, 2013 1:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup output values
- Replies: 9
- Views: 4629
- Mon Jun 10, 2013 7:27 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup output values
- Replies: 9
- Views: 4629
My input is Col1 A B Lookup table Col1. Col2 A 1 C 2 D 3 E 4 I need to get Col2 from lookup table based on key column Col1 input Col1 Col2 A 1 B I need to populate ~ for missing Col2 so in transformer stage I use the below code to assign ~ for Col2 If IsNull(Col2) or Trim(Col2)='' Then '~' Else Col2...
- Mon Jun 10, 2013 2:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup output values
- Replies: 9
- Views: 4629
lookup output values
i use lookup stage with constraint continue and i thought wherever the condition not met lookup output value coming in as null or empty string so i use the below condition in transformer stage to pass default value '~', But its not working. If IsNull(lookupoutcolumn) OR Trim(lookupoutcolumn) Then '~...
- Mon May 20, 2013 7:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: subqueries are currently not supported as tables - Oracle C
- Replies: 5
- Views: 3999
- Mon May 20, 2013 1:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: subqueries are currently not supported as tables - Oracle C
- Replies: 5
- Views: 3999