Search found 253 matches

by edward_m
Fri Feb 20, 2015 2:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort with remove Dups
Replies: 5
Views: 3789

its working for some records not all, do i need to change anyhting with partitioning property as job runs with 4 node config file..

Thanks.
by edward_m
Wed Feb 18, 2015 11:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort with remove Dups
Replies: 5
Views: 3789

Sort with remove Dups

To get the latest row based on the key columns i am using sort with remove duplicates stage, however its working for some records but not all, also seeing dups. Input--->Sort--->remove Dups--->Output Here is the data.. COL1 COL2 COL3 COL4 COL5 1 02/01/2015 02/28/2015 02/18/2015 01 1 03/01/2015 12/31...
by edward_m
Mon Jan 19, 2015 5:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash file equavalant in parallel Job
Replies: 2
Views: 3125

Hash file equavalant in parallel Job

I was trying to design a job to load data into oracle table, before table load i would like to compare the records based on the primary key which consists of 4 keys, if record already exists then log those records into file, if not insert those records. In server job i would have create hash file ba...
by edward_m
Fri Jan 09, 2015 8:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Alphanumeric data
Replies: 6
Views: 3361

Alphanumeric data

I was trying to process only numeric data in a file based on a particular column and track other records with Alpha numeric. i used num(column)=1 to process recrods with numeric data, however when i try to use num(column)<>1 to track records with alphanumeric records, could you please suggest me wha...
by edward_m
Sun Oct 26, 2014 6:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading sequential file in the order of file
Replies: 7
Views: 4624

Thanks for all replies and I decided to go with server job instead of parallel job.
by edward_m
Sat Oct 25, 2014 5:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading sequential file in the order of file
Replies: 7
Views: 4624

I compared both input with output, and noticed output file order is different than input file order. DS job is using 4 node config.file which caused this order change. Is there a way to get exact order from input to output without using sort stage as I don't know sort order.
by edward_m
Fri Oct 24, 2014 8:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading sequential file in the order of file
Replies: 7
Views: 4624

Reading sequential file in the order of file

I was trying to read sequential file in the order of the records written in the file but it's not reading in the order.i know we can use sort stage if we know sorted columns.
My question is ..is they a way we can read data in the order of original file with out sort stage in parallel job.
by edward_m
Tue Jun 11, 2013 8:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup output values
Replies: 9
Views: 4629

Here are the properties for this field from lookup:
SQL TYPE:CHAR
Extended:unicode
Length:3
Nullable:yes
by edward_m
Tue Jun 11, 2013 7:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup output values
Replies: 9
Views: 4629

I am using OR condition so it should work.Anyhow i tried with only ISNull Comparison and it didn't work.
by edward_m
Tue Jun 11, 2013 1:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup output values
Replies: 9
Views: 4629

Yes,my lookup failure is continue.
Please advise why IsNull(Col2) is not returning true
by edward_m
Mon Jun 10, 2013 7:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup output values
Replies: 9
Views: 4629

My input is Col1 A B Lookup table Col1. Col2 A 1 C 2 D 3 E 4 I need to get Col2 from lookup table based on key column Col1 input Col1 Col2 A 1 B I need to populate ~ for missing Col2 so in transformer stage I use the below code to assign ~ for Col2 If IsNull(Col2) or Trim(Col2)='' Then '~' Else Col2...
by edward_m
Mon Jun 10, 2013 2:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup output values
Replies: 9
Views: 4629

lookup output values

i use lookup stage with constraint continue and i thought wherever the condition not met lookup output value coming in as null or empty string so i use the below condition in transformer stage to pass default value '~', But its not working. If IsNull(lookupoutcolumn) OR Trim(lookupoutcolumn) Then '~...
by edward_m
Mon May 20, 2013 7:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: subqueries are currently not supported as tables - Oracle C
Replies: 5
Views: 3999

This error actually reported by connector when I enter this SQL in select statement Query field in connector properties.
Thanks.
by edward_m
Mon May 20, 2013 1:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: subqueries are currently not supported as tables - Oracle C
Replies: 5
Views: 3999

Not seeing any issue with Query when i execute from sqlplus.

Thanks