Search found 5 matches

by tcallahan
Fri Oct 22, 2004 2:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message: unbalanced input from partition
Replies: 6
Views: 11980

I have finally corrected the problem with a little help from Ascential. I have two seperate jobs with the first one just extracting data from a table into a dataset. This dataset was being hash partitioned and sorted. The 2nd job was taking the dataset as input, aggregating the data and then inserti...
by tcallahan
Thu Oct 21, 2004 8:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message: unbalanced input from partition
Replies: 6
Views: 11980

Below is a record count for each node that the aggregator is processing. node 0: 4392921 node 1: 4409319 node 2: 4383562 node 3: 4392104 node 4: 4386820 node 5: 4406425 The nodes are some what balanced but I wouldn't think that you could get a complete balance using hash or modulus partitioning. Do ...
by tcallahan
Thu Oct 21, 2004 8:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message: unbalanced input from partition
Replies: 6
Views: 11980

Thanks for the reply, I am not sure that I can balance the nodes by using the hash partitioning due to the consumer-id (integer) having any number of transaction records. I did try a test using entire partitioning just to see if the messages would go away but the warnings still appeared. A couple of...
by tcallahan
Thu Oct 21, 2004 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message: unbalanced input from partition
Replies: 6
Views: 11980

Warning message: unbalanced input from partition

New to Datastage, I am receiving the following warning message: APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered The job that I am running is designed as follows...
by tcallahan
Thu Oct 21, 2004 8:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message: unbalanced input from partition
Replies: 0
Views: 1682

Warning message: unbalanced input from partition

New to Datastage, I am receiving the following warning message: APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered The job that I am running is designed as follows...