use of peak stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chrisjones
Participant
Posts: 194
Joined: Thu May 11, 2006 9:42 am

use of peak stage

Post by chrisjones »

Hi ,
Can someone help me for below requirement .

I am getting data in below format from source


col1,col2,col3, col4

1, 100 , , xyz
1, 100, abc,

the expected output should be

col1,col2,col3, col4
1, 100 , abc , xyz

i know we can accomplish using the peak stage but not sure how to do it.
Thanks,
Chris Jones
prasson_ibm
Premium Member
Premium Member
Posts: 536
Joined: Thu Oct 11, 2007 1:48 am
Location: Bangalore

Post by prasson_ibm »

Hi,
Its not "Peak"stage ,but it is "Peek" stage.

Peek stage is only used for debugging,you can see the output of peek stage in datastage director log.
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

Prasoon,

You can also use Peek to pull out specific columns/values to send to an output link, from which you can join it back to something else, for example, or do some other processing on. It's not restricted solely to being output to the job log.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I would use Transformer stage for this requirement, either using LastRecordInGroup(col1) as a constraint expression or following the Transformer with a Remove Duplicates stage set to "Last" and grouping on col1.
Within the Transformer populate the column if the incoming value is non-empty.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply