Prallel join creating rows as many as nodes

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
johnson_binkam
Participant
Posts: 2
Joined: Tue Jul 10, 2007 3:14 pm

Prallel join creating rows as many as nodes

Post by johnson_binkam »

We are converting server jobs to parallel. Coded a join stage with 2 inputs(oracle enterprise). query gives 100 rows and the join stage gives 800 rows(8 nodes).If we use ODBC stage inputs, it is giving 100 rows.

Is there any parameter or configuration can cause this problem?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Are you doing any repartitioning? Does the job monitor show 800 rows output or have you actually checked the data to see if it is wrong. I've noticed some discrepancies in the monitor row counts when using several nodes, sometimes it showed total row counts per node.
johnson_binkam
Participant
Posts: 2
Joined: Tue Jul 10, 2007 3:14 pm

Post by johnson_binkam »

No Re-partitioning. Out put is actually 800 rows.
Found the cause of the problem and we move on. One of the inputs were created by Ascential and not Oracle DDL, when we pre-create the table with Oracle DDL it is giving just 100 rows.
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If the problem is fixed please mark the thread as Resolved.

And post a little more information - what do you mean by "created by Ascential"? That company ceased to exist in 2005.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply