Huge amount of processes generated

DWS · Post by **DWS** » Tue Jun 17, 2014 6:46 am

I was told that over 1000 bash processes owned by me are running on server. I believe they were generated by dataStage jobs. Can anybody tell me why they didn't die after my jobs finished running.

chulett · Post by **chulett** » Tue Jun 17, 2014 7:01 am

You are probably correct but first I would suggest confirming that belief. Can you confirm what kind of processes they were? Post some examples?

DWS · Post by **DWS** » Tue Jun 17, 2014 7:09 am

Sorry, I killed all of them before I realized to make a copy. I was told it happens often to biginners. But I wonder where I did wrong.

PaulVL · Post by **PaulVL** » Tue Jun 17, 2014 7:41 am

recursive script calling is often a prime suspect.

chulett · Post by **chulett** » Tue Jun 17, 2014 9:59 am

DWS wrote:I was told it happens often to beginners.

Have whomever told you that explains what it means.

When these jobs "finished running" did they run OK or did they in fact crash / die / abort? The latter can leave orphaned processes running, which may be what your comment maker meant.

Oh and yes, DataStage jobs can create a 'huge' number of processes, especially when running on multiple nodes. How many jobs are we talking about here?

DWS · Post by **DWS** » Tue Jun 17, 2014 11:39 am

Actually, the administer told me that those over 1000 processes were generated since May 27. I really have no idea which job caused it. there're four nodes.

chulett · Post by **chulett** » Tue Jun 17, 2014 11:46 am

OK, just to keep picking at this... that's almost a month. Was he saying that over that course of time your jobs generated 1000 processes or you've had 1000 processes all 'running' since that time?

Also, you didn't answer the aborted question.