ISD job priority and WLM queues

Dedicated to DataStage and DataStage TX editions featuring IBM<sup>®</sup> Service-Oriented Architectures.

Moderators: chulett, rschirm

Post Reply
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am

ISD job priority and WLM queues

Post by qt_ky »

According to the Ops Console's Workload Management tab, by default there are 3 batch queues for jobs (Low, Medium, and High), and dedicated queues for ISD, IA, and DataClick.

Today we have deployed a new ISD application that is based on a DataStage job, and instead of running, it was Queued in the ISD queue. This seems to have happened because several IA tasks were already running and CPU usage was too high, and there was a very long wait for IA tasks to finish and reduce CPU to below the global threshold of 80%.

Are there any options to give ISD priority over IA, or over anything else for that matter?
Choose a job you love, and you will never have to work a day in your life. - Confucius
ray.wurlod
Participant
Posts: 54588
Joined: Wed Oct 23, 2002 10:52 pm

Post by ray.wurlod »

Basically by tweaking (balancing) the CPU and memory limits for each of the queues. Allow ISD queue to start jobs even though CPU/memory might be 100%, but don't allow this for the other queues.
You may also be able to fiddle with the maximum jobs setting.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
eostic
Premium Member
Premium Member
Posts: 3835
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

There are a lot of sites who recognize the unique pattern and needs of ISD Jobs vis-a-vis regular batch Jobs, and they deploy a whole separate engine for ISD Jobs.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/07/29/open-igc-is-here/">Open IGC is Here!</a>
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am

Post by qt_ky »

Thank you both for sharing! We will look into both options.
Choose a job you love, and you will never have to work a day in your life. - Confucius
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am

Post by qt_ky »

By default, the IA queue and the ISD queue are each set to Medium priority and 100 maximum running jobs.

The ISD queue is locked down from making any changes, however the IA queue allowed some changes to made and saved.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply