Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.
Moderators: chulett , rschirm , roy
arasan
Participant
Posts: 44 Joined: Wed Nov 30, 2005 3:54 am
Contact:
Post
by arasan » Thu Jan 04, 2007 3:10 am
can any one tell how to capture the duplicate reject rows in the sequential file.
for example
source
rollno,name
101,pradeep
102,arasan
101,deepu
in the reject i should get one row after implementing the hob design through datastage.
wnogalski
Charter Member
Posts: 54 Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw
Post
by wnogalski » Thu Jan 04, 2007 3:51 am
Store the Rejects in a HashedFile with key column set to rollno but this way you will only get the last version of rejected row with given rollno.
Regards,
Wojciech Nogalski
arasan
Participant
Posts: 44 Joined: Wed Nov 30, 2005 3:54 am
Contact:
Post
by arasan » Thu Jan 04, 2007 4:31 am
i tried that but i am unable to capture the reject rows
source(SF)----->transformer----->hashfile
(reject hash file)
if i mplement the job design as this way i am not able to capture the rejected row.After the trasformer the rows from soure are passing directly to the target hash file.but when i view data in hash file i am getting two rows only.I know that hash file is doing is Job but the other rows that is not shoing in the hash file i need to capture it.
If i am wrong pls correct me....
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Thu Jan 04, 2007 4:54 am
By "reject" do you mean "duplicate"?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
WoMaWil
Participant
Posts: 482 Joined: Thu Mar 13, 2003 7:17 am
Location: Amsterdam
Post
by WoMaWil » Thu Jan 04, 2007 5:35 am
as Ray already said is, that we need more information, what you finally want to reach. Rejects and Removing Dublicates is a strength of DataStage.
Only if we knew, what you finally want, we can give you a good solution.
Wolfgang Hürter
Amsterdam
arasan
Participant
Posts: 44 Joined: Wed Nov 30, 2005 3:54 am
Contact:
Post
by arasan » Thu Jan 04, 2007 5:38 am
hi ray i want the duplicate row from the source sequential file to be captured .
wnogalski
Charter Member
Posts: 54 Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw
Post
by wnogalski » Thu Jan 04, 2007 5:50 am
Count the rollno's using Aggregator and then filter the ones with count > 1.
Regards,
Wojciech Nogalski
DSguru2B
Charter Member
Posts: 6854 Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX
Post
by DSguru2B » Thu Jan 04, 2007 7:28 am
Check out
this post . In this post Craig elaborates a method thats taught by IBM to capture duplicates.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
wnogalski
Charter Member
Posts: 54 Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw
Post
by wnogalski » Thu Jan 04, 2007 8:54 am
That's a really smart - thanks for the tip DSguru2B
Regards,
Wojciech Nogalski