job hangs after processing few thousand records
Posted: Mon Dec 27, 2010 2:48 am
I have 3 jobs which has been promoted to UAT environments.
The source is a staging table. which are loaded from source files through separate DS jobs.
The 3 jobs fail to process the records for cetrain files from staging table. The jobs do not abort but it goes into infinite processing. For one of the job it gets stuck in the Look up stage. The input to the lookup is 11000 records but from the output only 2646 records are proceeseed and DS cannot process further.
This is not happening for all the files. Files with larger volumes have processed successfully. It would be of great help if some suggestions can be given. Also please note that all the three jobs run fine in the development environment for the same source files.
thanks
Nibha
The source is a staging table. which are loaded from source files through separate DS jobs.
The 3 jobs fail to process the records for cetrain files from staging table. The jobs do not abort but it goes into infinite processing. For one of the job it gets stuck in the Look up stage. The input to the lookup is 11000 records but from the output only 2646 records are proceeseed and DS cannot process further.
This is not happening for all the files. Files with larger volumes have processed successfully. It would be of great help if some suggestions can be given. Also please note that all the three jobs run fine in the development environment for the same source files.
thanks
Nibha