parallel shared container

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsscholar
Premium Member
Premium Member
Posts: 195
Joined: Thu Oct 19, 2006 2:45 pm

parallel shared container

Post by dsscholar »

Hi all,

Source --> shared container ---> copy --> target

Source : 20 columns

Shared container input stage obviously has 20 columns.

Inside shared container, first stage is column generator after input container. input tab is empty in column generator. In output tab, a created one dummy column. i enabled RCP inside shared container as the input columns has to propagate till the last stage.

In this case, when i dont enable RCP in the source stage of the job, compilation error happens. When i enable it works fine. RCP passes the missed out columns during runtime. But here all twenty columns goes to input link of the shared container which is mapped inside the shared container. Inside shared container its enabled because all the input columns should pass till the output of the shared container. But why should i enable RCP in source when the column count is the same.

Thanks in advance.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Re: parallel shared container

Post by qt_ky »

dsscholar wrote:But why should i enable RCP in source when the column count is the same.

Thanks in advance.
Did you say the input columns inside the first shared container stage are empty? If so then the column count is not the same between there and what you pass to there from the source stage. Seems like that should generate an error without RCP on.
Choose a job you love, and you will never have to work a day in your life. - Confucius
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Why the need to enable RCP on the output of the source stage, which is connected directly to the input link of the shared container? Precisely because you don't have any columns defined on the input link of the first stage in your shared container. With RCP disabled, there's nothing to match against for validating the link.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
Post Reply