Preserver Partion - Clear + Same partition

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsdoubt
Participant
Posts: 106
Joined: Sat Jul 15, 2006 12:17 am

Preserver Partion - Clear + Same partition

Post by dsdoubt »

I have the Looup stage with Reject to a Sequential file stage.

I get the follwing warning.
A sequential operator cannot preserve the partitioning
of the parallel data set on input port 0.
I can 'Clear' the Preserver Partition of the Lookup.

But other stages that are connected to Lookup, would need the 'Same' partition as the lookup.
Will the other stage be affected based on the Preserver partition change?
SwathiCh
Premium Member
Premium Member
Posts: 64
Joined: Mon Feb 08, 2010 7:17 pm

Post by SwathiCh »

If you clear the partition then Datastage tries to repartition the data on link before next stage but as you are having "SAME" partition on that link, datastage should through the warning.

By the way, why can't you have a copy stage on reject link before sequential file and clear the partition on copy?
--
Swathi Ch
dsdoubt
Participant
Posts: 106
Joined: Sat Jul 15, 2006 12:17 am

Post by dsdoubt »

Adding copy stage is always an option. But I was actually of 'Clear' the Preserver Partition option, if that would work to avoid an extra stage.
Post Reply