Search found 516 matches

Go to advanced search

by rkashyap
Wed May 02, 2018 12:07 pm
Forum: General
Topic: Connect to Azure Data Lake Store?
Replies: 2
Views: 3795

Connect to Azure Data Lake Store?

We are connecting to Azure SQL database from DataStage 11.50.1. Has anyone connected with Azure Data Lake Store from DataStage? If yes, please share your experience.
by rkashyap
Thu Apr 26, 2018 1:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get JSON file from blob storage using DataStage 11.5
Replies: 4
Views: 4558

"Read a BLOB (GET BLOB)" section of Developerworks article IBM Datastage Hierarchical Stage made easy to do operations on Azure-Cloud platform has information on reading Azure blob using XML connector. It may help you. Do share your solution and experience in accessing Azure blobs from Dat...
by rkashyap
Mon Apr 23, 2018 3:40 pm
Forum: General
Topic: DataStage 11.5 vs DataStage 11.7?
Replies: 3
Views: 7847

Following blog posts are also quite informative ...
by rkashyap
Mon Mar 26, 2018 12:34 pm
Forum: General
Topic: All users (including Admin) cannot open client session.
Replies: 8
Views: 7954

Thank you. Apparently, lots of zombie DataStage connections were being created from a rogue DataStage session on a desktop and maximum no of sessions was exhausted, thus no new session could be opened to diagnose/resolve the issue. Solution was to bounce the box, restart DataStage and logon to IIS C...
by rkashyap
Sat Mar 24, 2018 8:09 pm
Forum: General
Topic: All users (including Admin) cannot open client session.
Replies: 8
Views: 7954

All users (including Admin) cannot open client session.

Attempts to open Client session for all users including Admin are failing with message: <Status xmlns="http://iis.ibm.com"> <httpStatus>503</httpStatus> <msgId>CDISF0001E</msgId> <msgSeverity>Error</msgSeverity> <msgText>The maximum number of sessions has been reached.</msgText> </Status> ...
by rkashyap
Mon Mar 05, 2018 4:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hive Connector Vs ODBC Connector
Replies: 4
Views: 4633

Hive connector leverages JDBC connectivity.

We are using both ODBC Connector and Hive Connector for connect with Hive and have not seen much difference between the performance of the two.
by rkashyap
Mon Feb 26, 2018 6:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC-Connector issues
Replies: 6
Views: 3876

You can see the SQL statement performing Delete and subsequent Insert in DataStage Director. Confirm that ALL columns that the connector can be paired with the target table.
by rkashyap
Thu Feb 22, 2018 7:07 pm
Forum: General
Topic: Install on Remote DB2 with SSL port
Replies: 2
Views: 2608

Are you trying to create a connection from DataStage to a DB2 database with SSL?
by rkashyap
Thu Feb 22, 2018 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How Pivot Stage works in Server Edition of Datastage 11.5
Replies: 3
Views: 15367

Re: How Pivot Stage works in Server Edition of Datastage 11.

I'm trying to convert multiple rows into one row. I can see the Pivot stage in Processing Palette, but I don't see the properties of Pivot stage other than Input and Output. Requirement is to perform "Vertical Pivot" and Server job's Pivot stage pivots horizontal data. If this requirement...
by rkashyap
Thu Feb 22, 2018 5:51 pm
Forum: General
Topic: List the sequencers which uses environmental variable
Replies: 2
Views: 2626

Alternatively, if you are using Operations Console, then you can modify following query to get the desired result SELECT H.HostName , J.ProjectName , J.JobName , P.ParamName , P.ParamValue , R.InvocationId , R.RunStartTimeStamp , R.ElapsedRunSecs FROM DSODB.JobExec J , DSODB.JobRun R , DSODB.Host H ...
by rkashyap
Thu Feb 22, 2018 5:29 pm
Forum: General
Topic: List the sequencers which uses environmental variable
Replies: 2
Views: 2626

Try

Code: Select all

LIST DS_JOBS WITH JOBTYPE = 3 AND EVAL "TRANS('DS_JOBOBJECTS','J\':@RECORD<5>:'\ROOT',14,'X')" LIKE ...FTP_EPSILON_HOST...
by rkashyap
Thu Feb 22, 2018 5:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC-Connector issues
Replies: 6
Views: 3876

What is value of "Drop unmatched fields" in the JDBC stage properties?
by rkashyap
Fri Feb 16, 2018 10:21 am
Forum: IBM QualityStage
Topic: Two Source Match Stage, long running job and fails at last
Replies: 4
Views: 14937

Is the job using bounded length varchars in the data? If yes, then setting the APT_OLD_BOUNDED_LENGTH environment variable will reduce runtime disk usage. Note that setting APT_OLD_BOUNDED_LENGTH might have adverse performance effects.
by rkashyap
Fri Feb 16, 2018 10:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP not working for Salesforce Server Package stage
Replies: 6
Views: 8808

SFDC stage (still) does not supports RCP. You may submit a Request for Enhancement for this.
by rkashyap
Fri Feb 16, 2018 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple records based on value in column
Replies: 8
Views: 6154

Another option could be leveraging Unix ... invoke following command in either External Source stage or using Filter option of Sequential file stage

Code: Select all

awk 'BEGIN {FS="|";RS="\n"};  (NR> 1) {for(i=0; i<$2; ++i) {print $1}}' <inputfile>

Go to advanced search