Author |
Message |
qt_ky

Group memberships: Premium Members
Joined: 03 Aug 2011
Posts: 2897
Location: USA
Points: 21971
|
|
DataStage® Release: 11x |
Job Type: Parallel |
OS: Unix |
Additional info: Version 11.3.1.2 |
According to the Ops Console's Workload Management tab, by default there are 3 batch queues for jobs (Low, Medium, and High), and dedicated queues for ISD, IA, and DataClick.
Today we have deployed a new ISD application that is based on a DataStage job, and instead of running, it was Queued in the ISD queue. This seems to have happened because several IA tasks were already running and CPU usage was too high, and there was a very long wait for IA tasks to finish and reduce CPU to below the global threshold of 80%.
Are there any options to give ISD priority over IA, or over anything else for that matter?
|
_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
|
|
|
 |
ray.wurlod
Participant
Group memberships: Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group
Joined: 23 Oct 2002
Posts: 54621
Location: Sydney, Australia
Points: 296179
|
|
|
|
|
|
Basically by tweaking (balancing) the CPU and memory limits for each of the queues. Allow ISD queue to start jobs even though CPU/memory might be 100%, but don't allow this for the other queues.
Yo ...
|
_________________ IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold. |
|
|
 |
eostic

Group memberships: Premium Members
Joined: 17 Oct 2005
Posts: 3840
Points: 31021
|
|
|
|
|
|
There are a lot of sites who recognize the unique pattern and needs of ISD Jobs vis-a-vis regular batch Jobs, and they deploy a whole separate engine for ISD Jobs.
Ernie
|
_________________ Ernie Ostic
blogit!
Open IGC is Here! |
|
|
 |
qt_ky

Group memberships: Premium Members
Joined: 03 Aug 2011
Posts: 2897
Location: USA
Points: 21971
|
|
|
|
|
|
Thank you both for sharing! We will look into both options.
|
_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
|
|
|
 |
qt_ky

Group memberships: Premium Members
Joined: 03 Aug 2011
Posts: 2897
Location: USA
Points: 21971
|
|
|
|
|
|
By default, the IA queue and the ISD queue are each set to Medium priority and 100 maximum running jobs.
The ISD queue is locked down from making any changes, however the IA queue allowed some changes to made and saved.
|
_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
|
|
|
 |
|