Issue with DataStage 9.1 upgrade

DatastageCoEUser · Post by **DatastageCoEUser** » Mon Mar 10, 2014 3:35 am

We are working on DataStage upgrade from 8.0.1 to 9.1 version

We are facing the below issues during upgrade

1. Performance issue - parallel engine job startup times taking more time
2. Few Jobs getting hung when parameter APT_NO_BUFFERING_FUNNEL_INPUT=1 is set
3. The sort & remove duplicate (stages) algorithm is behaving differently between 8.0.1 and 9.1
4. Join stage with same input links is behaving differently in DS9.1 (auto partition).
5. Warnings are more in 9.1 compared to 8.0.1 for the same job

Can you please let us know whether we have faced these issue in any upgrade projects?
Also will we face the same issue if we upgrade to 8.5 instead of 9.1??

IBM Analytics Champion 2009 - 2020 · Post by **asorrell** » Tue Mar 11, 2014 9:52 pm

1. Haven't seen it
2. Never used that option. Why are you turning buffering off on the funnels?
3. Can you quantify "different"? How? What behavior?
4. Again, what is "different"?
5. Most definitely. Starting at 8.1 and again at 8.5 the metadata rules were more strictly enforced, resulting in numerous warnings as jobs are now reporting their metadata doesn't match the metadata on the database. Job should be updated to match. What other types of messages are you seeing?

Null handling did change between 8.0.1 and 9.1 along with some other items which might be causing the join problems among other things.

Refer to this tech note for details on compatibility issues between those releases http://www-01.ibm.com/support/docview.w ... wg21459416

Did you also turn on NLS? If so, there are other issues related to enabling NLS. viewtopic.php?t=151139

ray.wurlod · Post by **ray.wurlod** » Wed Mar 12, 2014 1:19 am

Have you installed version 9.1.2 (that is, Fix Pack 2)?

IBM Analytics Champion 2009 - 2020 · Post by **asorrell** » Fri Mar 14, 2014 8:19 pm

Found something that might be pertinent to the slow startup times for PX jobs.

You'll need a valid IBM login id to access this: https://www-304.ibm.com/support/entdocv ... wg1JR49593

Text is below:

JR49593: INFORMATION SERVER 9.1 PARALLEL JOBS HAVE LONG STARTUP TIMES DURING SCHEMA SETUP

Investigation has shown that there is an un-needed function call inside PX schema distribution code which slows down performance on some systems

Status: Open

mandyli · Post by **mandyli** » Fri Apr 04, 2014 10:12 am

Hi

We had a same issue in our environment 9.1. we are moving from 8.5 to 9.1.

As per IBM we have applied 9.1 patch JR49593 for these issues. The following issue has been fixed 1) slow start-up and 2) sort & remove duplicate (stages) algorithm with Auto partition issues.

Thanks
Man

mandyli · Post by **mandyli** » Fri Apr 04, 2014 1:09 pm

Again you will hit same issue even 8.5.

We migrated 8.5 to 9.1. It looks like IBM released almost 15 to 20 fixes between 8.5 to 9.1. But we are seeing lot of improvement in 9.1 compare to 8.5.

It looks like you guys using very old version (8.0.1). Better to move 9.1 and also try to redesign some of old jobs which is designed on 8.0.

Thanks

Man

rkashyap · Post by **rkashyap** » Fri Apr 04, 2014 2:17 pm

One issue that we have observed on 9.1.2 (Solaris 64 with windows client) is that at times when the PX Oracle Connector of a readonly job is opened (when another client has job open), it will not show the Connector Properties tab, but reverts to the standard property editor. Similar issue was also observed for Db2Connector, though more severe - DSDesigner crashes.

Our support provider is looking into these issues. Based on what I could gather, few other shops are also facing this issue.

kmsekhar · Post by **kmsekhar** » Tue Nov 11, 2014 12:18 pm

asorrell wrote:JR49593: INFORMATION SERVER 9.1 PARALLEL JOBS HAVE LONG STARTUP TIMES DURING SCHEMA SETUP

Hi,

Does the above APAR #JR49593 fix has been fixed as part of new releases i.e., 9.1.2 version or 11.3 version?

vmcburney · Post by **vmcburney** » Tue Nov 11, 2014 5:38 pm

Is number five - more warning messages - due to the use of a message handler that hasn't been migrated between versions? Have a look in the 8.0.1 DataStage Administrator to see if the project has a default message handler that downgrades or hides certain warning messages.

kmsekhar · Post by **kmsekhar** » Wed Nov 12, 2014 1:00 am

Hi vmcburney/team

Could you please help me in the below:

Does the above APAR #JR49593 fix has been included as part of new releases i.e., 9.1.2 version or 11.3 version?

chulett · Post by **chulett** » Wed Nov 12, 2014 1:25 am

Why not help yourself, ask your official support provider? Get the answer from the horse's mouth, so to speak.

kmsekhar · Post by **kmsekhar** » Wed Nov 12, 2014 1:32 am

Hi Chullet,

I've already requested IBM to provide the details, I am yet to get the response.

Meanwhile I thought of getting valuable input from dsxchange team, If you have details please provide.

chulett · Post by **chulett** » Wed Nov 12, 2014 8:07 am

If I did, I would.

kmsekhar · Post by **kmsekhar** » Fri Nov 21, 2014 7:05 am

JR49593 is NOT in IS 9.1 FP1/FP2, 11.3/11.3.1, It will be included in upcoming version 11.3.2 when it is released