Search found 12 matches

by John Corbin
Sun Apr 28, 2019 6:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

apologies for reviving this thread.... sorry no CASE number from IBM only because I am no in the support gropu that would deal with them. I asked my support area how they fixed it and this is what I was told: the group that maintains our Data stage added this line to the dsenv file APT_DATASET_FLUSH...
by John Corbin
Sat Feb 24, 2018 4:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

Update...

Update... We have just upgraded to 11.5. We were on 8.5 without support as we were past our license expire date by a year. We contacted IBM as soon as we were in 11.5... here is what were told... Datasets make use of a linux system call named fsync. As a test, IBM told our support area how to disabl...
by John Corbin
Wed Jan 06, 2016 6:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

Red Hat Enterprise Linux on mounted/remote disk.
by John Corbin
Tue Jan 05, 2016 6:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

Just confirmed with our support area.. we are not on a GRID
by John Corbin
Sat Jan 02, 2016 7:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

Ray It happens every week since we moved to Linux Red Hat.. There are other jobs experiencing the same issue in performance. The one I wrote about is an extreme example Not sure how to tell how big each segment is... is this info from Dataset Management useful? ##I IIS-DSEE-TFCN-00001 08:47:18(000) ...
by John Corbin
Fri Jan 01, 2016 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11854

Issue with Dataset performance in RedHat Linux

We have a very similar issue in our shop... writing to or reading from datasets seems to take forever. as an extreme example, I had a job that read 145 rows from a sequential file and wrote them to a dataset. We use an 8 node config file running DS 8.5 seqFile------------------>Transformer----------...
by John Corbin
Wed Dec 30, 2015 8:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset stage
Replies: 11
Views: 5842

Moved my post to separate topic
by John Corbin
Tue Jun 02, 2015 11:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: C++ routine vs. Convert function performance
Replies: 5
Views: 3650

One final question... I am using this isn a stage variable: CHAR(0):CHAR(1):CHAR(2):CHAR(3):CHAR(4):CHAR(5):CHAR(6):CHAR(7):CHAR(8):CHAR(9):CHAR(10):CHAR(11):CHAR(12):CHAR(13):CHAR(14) :CHAR(15):CHAR(16):CHAR(17):CHAR(18):CHAR(19):CHAR(20):CHAR(21):CHAR(22):CHAR(23):CHAR(24):CHAR(25):CHAR(26):CHAR(2...
by John Corbin
Fri May 29, 2015 5:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: C++ routine vs. Convert function performance
Replies: 5
Views: 3650

Thanks for that reminder about stage variables. applying it now :D
by John Corbin
Thu May 28, 2015 6:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: C++ routine vs. Convert function performance
Replies: 5
Views: 3650

C++ routine vs. Convert function performance

I have programed in C/C++ for many years. It is coming back slowly though. I currently use this code in a transformer stage, in a PX job, to replace certain Ascii control characters to space in free format text fields: Convert(Char(0):Char(10):Char(13),' ', link.column) Then i stumbled on this threa...
by John Corbin
Mon Dec 23, 2013 9:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage as a Venn Diagram
Replies: 3
Views: 2288

Thanks for the excellent feedback and link.
by John Corbin
Wed Dec 18, 2013 4:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage as a Venn Diagram
Replies: 3
Views: 2288

Join Stage as a Venn Diagram

Hi Saw nothing on this particular question so here goes. I am to give a lecture/demonstration on the use of a Join Stage to some of our less experienced DS Users. Start with the basics and show a Left Outer Join. Can the results of a DataStage Join be shown in a Venn Diagram? some people learn compl...