Search found 5 matches
- Fri Oct 22, 2004 2:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warning message: unbalanced input from partition
- Replies: 6
- Views: 11980
I have finally corrected the problem with a little help from Ascential. I have two seperate jobs with the first one just extracting data from a table into a dataset. This dataset was being hash partitioned and sorted. The 2nd job was taking the dataset as input, aggregating the data and then inserti...
- Thu Oct 21, 2004 8:41 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warning message: unbalanced input from partition
- Replies: 6
- Views: 11980
Below is a record count for each node that the aggregator is processing. node 0: 4392921 node 1: 4409319 node 2: 4383562 node 3: 4392104 node 4: 4386820 node 5: 4406425 The nodes are some what balanced but I wouldn't think that you could get a complete balance using hash or modulus partitioning. Do ...
- Thu Oct 21, 2004 8:30 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warning message: unbalanced input from partition
- Replies: 6
- Views: 11980
Thanks for the reply, I am not sure that I can balance the nodes by using the hash partitioning due to the consumer-id (integer) having any number of transaction records. I did try a test using entire partitioning just to see if the messages would go away but the warnings still appeared. A couple of...
- Thu Oct 21, 2004 8:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warning message: unbalanced input from partition
- Replies: 6
- Views: 11980
Warning message: unbalanced input from partition
New to Datastage, I am receiving the following warning message: APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered The job that I am running is designed as follows...
- Thu Oct 21, 2004 8:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warning message: unbalanced input from partition
- Replies: 0
- Views: 1682
Warning message: unbalanced input from partition
New to Datastage, I am receiving the following warning message: APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered The job that I am running is designed as follows...