Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
fareeda_b
Participant
Posts: 48 Joined: Sat Feb 23, 2008 4:25 pm
Post
by fareeda_b » Wed May 27, 2009 5:55 am
Hi All,
Could you please help me how can filter the records in sequential stage?
miwinter
Participant
Posts: 396 Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK
Post
by miwinter » Wed May 27, 2009 5:59 am
The parallel job dev guide will help you no end... it's an option you can add to the stage, called 'filter'
This will allow you to make a call to filter as desired. As an input, it filters before writing, as an output, it filters before reading... as explained in the product documentation
Last edited by
miwinter on Wed May 27, 2009 6:02 am, edited 2 times in total.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
nagarjuna
Premium Member
Posts: 533 Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago
Post
by nagarjuna » Wed May 27, 2009 5:59 am
Give more details about nature of file and what you want to filter ..
You can use filter option in sequential file stage .
Nag
fareeda_b
Participant
Posts: 48 Joined: Sat Feb 23, 2008 4:25 pm
Post
by fareeda_b » Wed May 27, 2009 6:06 am
Hi all,
thanks for reply
if i'm wrong please correct me
i have used "Filter" option in sequential file in that i have used unix command. is there any process is there ?
Thanks
miwinter
Participant
Posts: 396 Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK
Post
by miwinter » Wed May 27, 2009 6:10 am
Using a unix command in the filter is correct yes, I'm not sure about the "is there any process is there"
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
fareeda_b
Participant
Posts: 48 Joined: Sat Feb 23, 2008 4:25 pm
Post
by fareeda_b » Wed May 27, 2009 6:18 am
Hi miwinter,
thanks for the reply,in sequential file we have option "Read first Rows" like this also we can filter the records right?
Thanks
nagarjuna
Premium Member
Posts: 533 Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago
Post
by nagarjuna » Wed May 27, 2009 6:23 am
yes you can ...
Nag
miwinter
Participant
Posts: 396 Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK
Post
by miwinter » Wed May 27, 2009 6:31 am
Yes, but I wouldn't call this filtering exactly, effectively it's just take the first x records... filtering would apply further logic in my book
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>