Search found 152 matches

by betterthanever
Sat Feb 10, 2018 12:28 pm
Forum: General
Topic: IIS on Hadoop Recommendations
Replies: 1
Views: 2399

IIS on Hadoop Recommendations

Hello All, I am at a client place with 9.1.2 version. Client is considering moving to a managed Grid env with 11.5 version and at the enterprise level, modernization initiative is pushing all the teams to look for alternatives that work with/within BigData eco system. Since the migration(effort/cost...
by betterthanever
Fri Jun 30, 2017 1:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Enable TLS1.2 on java 1.6
Replies: 5
Views: 6963

Kondeti,
I appreciate your response. I will keep that in mind.

I found a resolution to force the Integration stage to use TLS1.2. Now the Debug logs shows "*** ClientHello, TLSv1.2" and my job goes though without any issues.

-Dhttps.protocols=TLSv1.1,TLSv1.2.
by betterthanever
Mon Jun 19, 2017 2:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Enable TLS1.2 on java 1.6
Replies: 5
Views: 6963

Craig, Still looking to see if JAVA1.6 even supports TLS1.2 or not. Few google search reads say yes and some don't. The target is allowing us through a different port but i need to be able to get a resolution to use TLS1.2. From your perspective, time to reach IBM, since the properties are not being...
by betterthanever
Mon Jun 19, 2017 12:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Enable TLS1.2 on java 1.6
Replies: 5
Views: 6963

I tried with those options. It didn't work, I switched on the debug mode and it still says "*** ClientHello, TLSv1" . Please the fill DEBUG log below -Dcom.ibm.jsse2.overrideDefaultTLS=true -Dcom.ibm.jsse2.overrideDefaultProtocol=TLSv12 -Djavax.net.debug=all -------------------------------...
by betterthanever
Wed Jun 14, 2017 2:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Enable TLS1.2 on java 1.6
Replies: 5
Views: 6963

Enable TLS1.2 on java 1.6

I have a java program that is being called from JAVA Integration stage to invoke a REST API. It has been working fine with the end points using a port num 8443. see the java version below java -version java version "1.6.0_30" OpenJDK Runtime Environment (IcedTea6 1.13.3) (rhel-5.1.13.3.el6...
by betterthanever
Thu Jan 05, 2017 2:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

I tried to implement the same with in a transformer and looks like I am running into same issue. The restructuring I am grouping on has 25k iterations to go though and failing with this error below.
waitForWriteSignal(): Premature EOF on node "nodename" Socket operation on non-socket
by betterthanever
Wed Jan 04, 2017 12:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

Thanks for your Input. yes the job runs fine till 13.5 M records and it fails after that. even if we bump up the heap it didn't help. We are raising a ticket to IBM and see if they can help. Speaking of doing the restructure and Hjoins outside of that stage, taking a alternate approach to avoid usin...
by betterthanever
Wed Jan 04, 2017 7:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

I looked down the log and these are additional ones I see. node_node2: Player 1 terminated unexpectedly. seq_pfsComp,0: Failure during execution of operator logic. seq_pfsComp,0: Output 0 produced 9581094 records. seq_pfsComp,0: Fatal Error: Unable to allocate communication resources main_program: A...
by betterthanever
Tue Jan 03, 2017 4:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

To make the job fail, I took the files to lower env with a 256MB value for heap and it failed with clear error as you expected, but when I increase the heap and reran it fails with no specific error like before.
by betterthanever
Tue Jan 03, 2017 12:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

Thanks for the response.
1. The data that is coming in for restructuring is pre sorted.
2. The heap size has been set to 2.5 GB

Speaking of splitting the data, is there a way for me to find out we are running out of Heap or any other setting that is causing the job to blow up?

Thanks.
by betterthanever
Tue Jan 03, 2017 9:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage XML transformation aborts
Replies: 12
Views: 13413

Hierarchical Stage XML transformation aborts

We have a job that creates Json file using the hierarchical stage for XML transformation. The stage is connected from 3 sequential stages and the XML stage assembly does Restructure and Hjoins. The job is failing after reading 13.5 M records. Is there a setting or environment variable for the stage ...
by betterthanever
Mon May 23, 2016 5:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC connection Setup for MySql
Replies: 5
Views: 4372

Thanks for the reply. If the above was the case, the error should have been consistent across all the env, which is not the case. we are able to run parallel jobs successfully without any issues in the other env.
by betterthanever
Mon May 23, 2016 2:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Push Json through Layer7 gateway
Replies: 7
Views: 5997

I appreciate all of your inputs. coming back here to update. We have setup this up. created JSONs in datastage and invoking a JAVA program/class from Java Integration stage and persist API response to a DB. we tested this in Lower Env and getting 24 Rows/sec. which is expected due to target end poin...
by betterthanever
Mon May 23, 2016 2:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Java Integration Stage NoClassDefFoundError:
Replies: 4
Views: 5974

I had to add the required .jars explicitly in the class path, even after bundling them in the main class .jar file. This is fixed now.
by betterthanever
Mon May 23, 2016 2:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC connection Setup for MySql
Replies: 5
Views: 4372

Thanks for your reply. i tested from ../branded_odbc/samples/example/example utility as well as ./uvsh ds_connect utility. both work just fine. but when i run the job it fails. like you said in the log the error shows up as information at the beginning and i see the same as fatal and job failure aft...