Hi,
Recently we have Migrated from DS 7.5 version to DS 8.0 version.
Websphere Application Server and DataStage Server are on same machine(UNIX box).
Below are the performance issues we are experiencing compared to the prior version.
1. Time taken to open the Job is more .
2. Job execution time is more. In the previous version the job used to take 40 minutes to complete whereas in the the newer version it takes 1 hr 30 minutes. No changes done to the job in the newer version.
3. Time taken to Open the Active Stages(Transformer, Aggregator etc) is more .
DS Client is on VISTA
Can some one throw some light as to what could be the reason for this and any suggestions to improve.
Performance issues after migrating from 7.5 to 8.0 server ed
Moderators: chulett, rschirm, roy
DataStage Version 8 has significantly higher overhead than previous versions.
You should take a look at what the system is doing, without that detailed information an analysis isn't possible. When developing, look at your server and see if the machine is paging/swapping - in which case you might need to add memory. This would be my first guess, as the repository and database on the same machine is going to eat more memory (but not necessarily much more CPU, when at rest).
You should take a look at what the system is doing, without that detailed information an analysis isn't possible. When developing, look at your server and see if the machine is paging/swapping - in which case you might need to add memory. This would be my first guess, as the repository and database on the same machine is going to eat more memory (but not necessarily much more CPU, when at rest).
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
We had (still have to an extent) very similar problems with our install. We access DataStage Designer and Director through through Citrix which exist on virtual machines, adding yet another set of layers that do not help performance.
We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.
So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.
So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
We had (still have to an extent) very similar problems with our install. We access DataStage Designer and Director through through Citrix which exist on virtual machines, adding yet another set of layers that do not help performance.
We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.
So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
We had to contact IBM for a patch to the Information Server/WebSphere software to help the problem. We also figured out that the client tools do not run efficiently on anything less than 3 GB of RAM (Citrix side and/or local install side). There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
Prior to the application of patches and fixes, it would take 5 minutes to connect, up to 20 minutes to change screens, and per job compile times of over a minute. Now, screen changes are closer to normal and compile times are about 11 seconds per job.
So, I suggest contacting your primary support to get any patches that may have been issued for your setup.
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
Performance issues after migrating from 7.5 to 8.0 server ed
Hi,
Can you please provide the patch details you applied(referring to) so that we can verify whether we already have that patch applied before going to IBM.
Thanks.
Can you please provide the patch details you applied(referring to) so that we can verify whether we already have that patch applied before going to IBM.
Thanks.
In all honesty, I do not have any of that info as it is in the hands of the Administrators. I will see if I can get it from them for you and post it up.
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli,
I have been checking the forum hopping to see your post. Have you gotten around to ask your Administrators about this . . .
Thanks . . . . Bryceson
I have been checking the forum hopping to see your post. Have you gotten around to ask your Administrators about this . . .
We're facing similar issues since we migrated to DataStage 8.0.1/AIX Unix specifically when running PX jobs and IA to profile data.There was some other memory tuning that had to be done on the DataStage server (AIX Unix) before we got to somewhat acceptable levels.
Thanks . . . . Bryceson
Hi Bryceson,
The Administrator from our company said he was going to post it up somewhere, but I haven't seen it either. I know there is more going on yet though, because the problem still is not fixed.
The Administrator from our company said he was going to post it up somewhere, but I haven't seen it either. I know there is more going on yet though, because the problem still is not fixed.
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"