filter the records in sequential stage?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
fareeda_b
Participant
Posts: 48
Joined: Sat Feb 23, 2008 4:25 pm

filter the records in sequential stage?

Post by fareeda_b »

Hi All,

Could you please help me how can filter the records in sequential stage?
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

The parallel job dev guide will help you no end... it's an option you can add to the stage, called 'filter' :wink:

This will allow you to make a call to filter as desired. As an input, it filters before writing, as an output, it filters before reading... as explained in the product documentation
Last edited by miwinter on Wed May 27, 2009 6:02 am, edited 2 times in total.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

Give more details about nature of file and what you want to filter ..
You can use filter option in sequential file stage .
Nag
fareeda_b
Participant
Posts: 48
Joined: Sat Feb 23, 2008 4:25 pm

Post by fareeda_b »

Hi all,
thanks for reply

if i'm wrong please correct me
i have used "Filter" option in sequential file in that i have used unix command. is there any process is there ?
Thanks
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

Using a unix command in the filter is correct yes, I'm not sure about the "is there any process is there"
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
fareeda_b
Participant
Posts: 48
Joined: Sat Feb 23, 2008 4:25 pm

Post by fareeda_b »

Hi miwinter,

thanks for the reply,in sequential file we have option "Read first Rows" like this also we can filter the records right?
Thanks
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

yes you can ...
Nag
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

Yes, but I wouldn't call this filtering exactly, effectively it's just take the first x records... filtering would apply further logic in my book
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
Post Reply