job hangs after processing few thousand records

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nibha Dash
Participant
Posts: 1
Joined: Mon Jun 15, 2009 11:25 pm

job hangs after processing few thousand records

Post by Nibha Dash »

I have 3 jobs which has been promoted to UAT environments.
The source is a staging table. which are loaded from source files through separate DS jobs.
The 3 jobs fail to process the records for cetrain files from staging table. The jobs do not abort but it goes into infinite processing. For one of the job it gets stuck in the Look up stage. The input to the lookup is 11000 records but from the output only 2646 records are proceeseed and DS cannot process further.

This is not happening for all the files. Files with larger volumes have processed successfully. It would be of great help if some suggestions can be given. Also please note that all the three jobs run fine in the development environment for the same source files.

thanks
Nibha
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. I'd start by looking for locks - maybe even deadlocks - in your target.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply