Pivot or Transformer for Normalization??

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ashutosh_sule
Participant
Posts: 1
Joined: Thu Jun 21, 2007 3:37 pm

Pivot or Transformer for Normalization??

Post by ashutosh_sule »

The source data is in denormalized fashion. I want to normalize each row of source data into 30 rows. The source data volume is in millions. Considering the huge volume, should the Pivot be used or should the Transformer used for Normalization?
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. :D

Without knowing a lot more about your source data it's impossible to say. For example, how many columns are in each source row? Maybe even a different stage type (such as Complex Flat File) can accomplish your normalization.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply