How to use Link Partitioner?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Prashantoncyber
Participant
Posts: 108
Joined: Wed Jul 28, 2004 7:15 am

How to use Link Partitioner?

Post by Prashantoncyber »

Hi All,

How does the Link Partitioner work and what for is it used.
I have gone through the documention but it is very brief and not able to understand how to use this stage.

Can any body explain it with a example ?


thanks,
Prashant
bibhudc
Charter Member
Charter Member
Posts: 20
Joined: Thu Jun 19, 2003 12:26 pm

Re: How to use Link Partitioner?

Post by bibhudc »

Prashant,

Go to Chapt 2 (Optimizing Performance in Server Jobs) of the Server Job Developer Guide and look for an example in the section "CPU Limited Jobs - Multi-processor Systems"

This example partitions (using Link partitioner) the rows so that it can be worked upon (using a transformer in a container) by multiple processors.

Hope this helps
Bibhu
suma
Participant
Posts: 32
Joined: Fri Jun 11, 2004 8:18 am

Post by suma »

Link Partitioner,Link collector,IPC are performance related issues.
These greately increase the performance. For Example if you have Lacks of records in your source you can divide the volume of data to be sent to the transformer by using the Link Partitioner so that the transformations take place simultaniously, and collect them back into the target by using Link Collector. And the Business Logic to be applied should be the same throughout.
Prashantoncyber
Participant
Posts: 108
Joined: Wed Jul 28, 2004 7:15 am

Thanks

Post by Prashantoncyber »

Thanks to all of you for sharing the useful information.

Regards
Prashant
Post Reply