Performance issues after migrating from 7.5 to 8.0 server ed

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
vj_ds_dev
Premium Member
Premium Member
Posts: 4
Joined: Thu Sep 11, 2008 2:15 pm

Performance issues after migrating from 7.5 to 8.0 server ed

Post by vj_ds_dev »

Hi,

Recently we have Migrated from DS 7.5 version to DS 8.0 version.

Websphere Application Server and DataStage Server are on same machine(UNIX box).

Below are the performance issues we are experiencing compared to the prior version.

1. Time taken to open the Job is more .
2. Job execution time is more. In the previous version the job used to take 40 minutes to complete whereas in the the newer version it takes 1 hr 30 minutes. No changes done to the job in the newer version.
3. Time taken to Open the Active Stages(Transformer, Aggregator etc) is more .

DS Client is on VISTA

Can some one throw some light as to what could be the reason for this and any suggestions to improve.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

DataStage Version 8 has significantly higher overhead than previous versions.

You should take a look at what the system is doing, without that detailed information an analysis isn't possible. When developing, look at your server and see if the machine is paging/swapping - in which case you might need to add memory. This would be my first guess, as the repository and database on the same machine is going to eat more memory (but not necessarily much more CPU, when at rest).
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

Post by jdmiceli »

We had (still have to an extent) very similar problems with our install. We access DataStage Designer and Director through through Citrix which exist on virtual machines, adding yet another set of layers that do not help performance.

We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.

Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.

So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

Post by jdmiceli »

We had (still have to an extent) very similar problems with our install. We access DataStage Designer and Director through through Citrix which exist on virtual machines, adding yet another set of layers that do not help performance.

We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.

Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.

So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
vj_ds_dev
Premium Member
Premium Member
Posts: 4
Joined: Thu Sep 11, 2008 2:15 pm

Performance issues after migrating from 7.5 to 8.0 server ed

Post by vj_ds_dev »

Hi,

Can you please provide the patch details you applied(referring to) so that we can verify whether we already have that patch applied before going to IBM.

Thanks.
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

Post by jdmiceli »

In all honesty, I do not have any of that info as it is in the hands of the Administrators. I will see if I can get it from them for you and post it up.
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
Bryceson
Charter Member
Charter Member
Posts: 88
Joined: Wed Aug 03, 2005 1:11 pm
Location: Madison, WI

Post by Bryceson »

John Miceli,

I have been checking the forum hopping to see your post. Have you gotten around to ask your Administrators about this . . .
There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
We're facing similar issues since we migrated to DataStage 8.0.1/AIX Unix specifically when running PX jobs and IA to profile data.

Thanks . . . . Bryceson
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

Post by jdmiceli »

Hi Bryceson,

The Administrator from our company said he was going to post it up somewhere, but I haven't seen it either. I know there is more going on yet though, because the problem still is not fixed.

:(
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
Terala
Premium Member
Premium Member
Posts: 73
Joined: Wed Apr 06, 2005 3:04 pm

Post by Terala »

jdmiceli wrote:Hi Bryceson,

The Administrator from our company said he was going to post it up somewhere, but I haven't seen it either. I know there is more going on yet though, because the problem still is not fixed.

:(
Hi John,
do you have the patch details that were applied on your system?
Post Reply