Performance using sorter

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
lakshmipriya
Participant
Posts: 31
Joined: Tue Jul 13, 2004 5:26 am
Location: chennai
Contact:

Performance using sorter

Post by lakshmipriya »

Hi

In my job i am using db2 and a sorter stage followed by a aggregator. In this my sorter stage is taking 3/4th time of the overall run.

I tired to increase the memory usage from the default to 20MB to 300MB. Even then the time is not that much reduced. What can be done to increase the performance of the same.
Lakshmi
T42
Participant
Posts: 499
Joined: Thu Nov 11, 2004 6:45 pm

Post by T42 »

Suggestions:

1. Remove sort, and see what the performance time is.
2. Ensure that your scratch space is on local SAN disks.
3. Increase your partitioning level. Don't do 1 node.
4. Land to datasets and then execute the sort, see what performance time is.

The more information you gather, the better you can pinpoint the actual cause. Unlike what people think, DataStage is cute when it comes to determining the primary cause of performance problems.
Post Reply