Search found 516 matches

Go to advanced search

by rkashyap
Wed May 02, 2018 12:07 pm
Forum: General
Topic: Connect to Azure Data Lake Store?
Replies: 2
Views: 3824

Connect to Azure Data Lake Store?

We are connecting to Azure SQL database from DataStage 11.50.1. Has anyone connected with Azure Data Lake Store from DataStage? If yes, please share your experience.
by rkashyap
Thu Apr 26, 2018 1:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get JSON file from blob storage using DataStage 11.5
Replies: 4
Views: 4574

"Read a BLOB (GET BLOB)" section of Developerworks article IBM Datastage Hierarchical Stage made easy to do operations on Azure-Cloud platform has information on reading Azure blob using XML connector. It may help you. Do share your solution and experience in accessing Azure blobs from Dat...
by rkashyap
Mon Apr 23, 2018 3:40 pm
Forum: General
Topic: DataStage 11.5 vs DataStage 11.7?
Replies: 3
Views: 7877

Following blog posts are also quite informative ...
by rkashyap
Mon Mar 26, 2018 12:34 pm
Forum: General
Topic: All users (including Admin) cannot open client session.
Replies: 8
Views: 7982

Thank you. Apparently, lots of zombie DataStage connections were being created from a rogue DataStage session on a desktop and maximum no of sessions was exhausted, thus no new session could be opened to diagnose/resolve the issue. Solution was to bounce the box, restart DataStage and logon to IIS C...
by rkashyap
Sat Mar 24, 2018 8:09 pm
Forum: General
Topic: All users (including Admin) cannot open client session.
Replies: 8
Views: 7982

All users (including Admin) cannot open client session.

Attempts to open Client session for all users including Admin are failing with message: <Status xmlns="http://iis.ibm.com"> <httpStatus>503</httpStatus> <msgId>CDISF0001E</msgId> <msgSeverity>Error</msgSeverity> <msgText>The maximum number of sessions has been reached.</msgText> </Status> ...
by rkashyap
Mon Mar 05, 2018 4:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hive Connector Vs ODBC Connector
Replies: 4
Views: 4640

Hive connector leverages JDBC connectivity.

We are using both ODBC Connector and Hive Connector for connect with Hive and have not seen much difference between the performance of the two.
by rkashyap
Mon Feb 26, 2018 6:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC-Connector issues
Replies: 6
Views: 3902

You can see the SQL statement performing Delete and subsequent Insert in DataStage Director. Confirm that ALL columns that the connector can be paired with the target table.
by rkashyap
Thu Feb 22, 2018 7:07 pm
Forum: General
Topic: Install on Remote DB2 with SSL port
Replies: 2
Views: 2617

Are you trying to create a connection from DataStage to a DB2 database with SSL?
by rkashyap
Thu Feb 22, 2018 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How Pivot Stage works in Server Edition of Datastage 11.5
Replies: 3
Views: 15472

Re: How Pivot Stage works in Server Edition of Datastage 11.

I'm trying to convert multiple rows into one row. I can see the Pivot stage in Processing Palette, but I don't see the properties of Pivot stage other than Input and Output. Requirement is to perform "Vertical Pivot" and Server job's Pivot stage pivots horizontal data. If this requirement...
by rkashyap
Thu Feb 22, 2018 5:51 pm
Forum: General
Topic: List the sequencers which uses environmental variable
Replies: 2
Views: 2644

Alternatively, if you are using Operations Console, then you can modify following query to get the desired result SELECT H.HostName , J.ProjectName , J.JobName , P.ParamName , P.ParamValue , R.InvocationId , R.RunStartTimeStamp , R.ElapsedRunSecs FROM DSODB.JobExec J , DSODB.JobRun R , DSODB.Host H ...
by rkashyap
Thu Feb 22, 2018 5:29 pm
Forum: General
Topic: List the sequencers which uses environmental variable
Replies: 2
Views: 2644

Try

Code: Select all

LIST DS_JOBS WITH JOBTYPE = 3 AND EVAL "TRANS('DS_JOBOBJECTS','J\':@RECORD<5>:'\ROOT',14,'X')" LIKE ...FTP_EPSILON_HOST...
by rkashyap
Thu Feb 22, 2018 5:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC-Connector issues
Replies: 6
Views: 3902

What is value of "Drop unmatched fields" in the JDBC stage properties?
by rkashyap
Fri Feb 16, 2018 10:21 am
Forum: IBM QualityStage
Topic: Two Source Match Stage, long running job and fails at last
Replies: 4
Views: 15056

Is the job using bounded length varchars in the data? If yes, then setting the APT_OLD_BOUNDED_LENGTH environment variable will reduce runtime disk usage. Note that setting APT_OLD_BOUNDED_LENGTH might have adverse performance effects.
by rkashyap
Fri Feb 16, 2018 10:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP not working for Salesforce Server Package stage
Replies: 6
Views: 8838

SFDC stage (still) does not supports RCP. You may submit a Request for Enhancement for this.
by rkashyap
Fri Feb 16, 2018 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple records based on value in column
Replies: 8
Views: 6204

Another option could be leveraging Unix ... invoke following command in either External Source stage or using Filter option of Sequential file stage

Code: Select all

awk 'BEGIN {FS="|";RS="\n"};  (NR> 1) {for(i=0; i<$2; ++i) {print $1}}' <inputfile>

Go to advanced search