Triggering the same job n no of times at the same time

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
saratha14
Participant
Posts: 27
Joined: Sun Jan 20, 2008 11:40 pm
Location: Jersey city, NJ

Triggering the same job n no of times at the same time

Post by saratha14 »

Hello Everyone,

Good afternoon,

Goal: Invoking a child server job n no of times at the same time in parallel.

Scenario: 8 files should be processed into the same staging table. Using the sequencers the job can be invoked using diff parameters ( say load1.... load 8 ) at the same time, but 8 diff sequence stages used.

Flow
Parameter file no of load=8 --> 8 diff sequence stages --> Invoke the same server job with diff parameter.

Is there a way we can invoke the same job using single sequence stage at the same time.
Parameter file no of load=8 --> :?: single sequence stages :?: --> Invoke the same server job with diff parameter.

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You must compile the job as multi-instance capable (a check box in the job properties page). As you start each instance you give a different invocation ID. This is the approved, and only, mechanism for running clones of the same job at the same time.

As you note, the file name will need to be passed as a parameter, and the job instances must not break any rules, such as all trying to write to the same text file.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
asorrell
Posts: 1707
Joined: Fri Apr 04, 2003 2:00 pm
Location: Colleyville, Texas

Post by asorrell »

And please be aware, depending on the processing power required for the job, just because you CAN start eight at a time, doesn't mean you SHOULD start eight at a time.

Trying to submit too many jobs simultaneously on an over-stressed system can cause DSJE_TIMEOUT errors.
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
saratha14
Participant
Posts: 27
Joined: Sun Jan 20, 2008 11:40 pm
Location: Jersey city, NJ

Post by saratha14 »

I put a workaround by calling Unix command to call the job in loop.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What happened to your "in parallel" requirement?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
saratha14
Participant
Posts: 27
Joined: Sun Jan 20, 2008 11:40 pm
Location: Jersey city, NJ

Post by saratha14 »

ray.wurlod wrote:What happened to your "in parallel" requirement? ...
Sorry for the late response Ray. The unix scripts interval is so quick and we dint have to run the jobs in parallel.
Post Reply