Search found 26 matches

by rschirm
Sun May 20, 2018 3:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Array Size, Record Count, Commit Frequency, Bulk Insert
Replies: 8
Views: 9728

I would try the following. Calculate what the width is for each row. (so add up all the lengths of the columns) Take that value and divide it into 64,000. Round the value down to the next whole number. Use this number for the Array Size. Make the Record Count to be a multiple of the Array Size so th...
by rschirm
Mon Jan 29, 2018 4:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Copy Issue
Replies: 11
Views: 5499

There is no reason for DataStage to get to this point and crash. can you provide screen shots of the properties within your DB2 target stage?

Have you had your DBA's look at the DB2 side to check for anything?
by rschirm
Mon Jan 29, 2018 4:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delete then insert option
Replies: 5
Views: 5100

The Delete then Insert logic works like this. Row of data comes in it goes to database and deletes records based on the keys specified. Then inserts the current row. Next row of data comes in and goes to database to delete records based on the keys specified and then inserts the row. If I were to gu...
by rschirm
Tue May 02, 2017 6:55 am
Forum: Site/Forum
Topic: Spambot
Replies: 28
Views: 60612

Craig, I delete that user and all 124 posts.
by rschirm
Tue Apr 11, 2017 10:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Writing multiple record types flat file
Replies: 5
Views: 5240

As the Ray and Craig have added I will add one more suggestion. Since you have one row coming in and you need basically 5 going out in the transformer take advantage of the Loop capability. This way you can produce the multiple rows at a time for each input record. If you need anymore detail on this...
by rschirm
Thu Jul 14, 2016 8:10 am
Forum: General
Topic: Fallen Premium Poster: Kim Duke
Replies: 32
Views: 26301

Fallen Premium Poster: Kim Duke

As the editor of the DSXchange, and longtime friend, we lost the divine input of Kim Duke this week as he has passed to higher place. Kim, has been a huge supporter of DataStage and the underlying engine and how he could provide his years of insight and wisdom to our community. We are blessed to hav...
by rschirm
Sat Apr 23, 2016 6:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Not Passing through Transformer
Replies: 11
Views: 9638

Find the entry in the log or the sequential output. It will state that 0 rows written and NNNN# of rows rejected.
by rschirm
Fri Apr 15, 2016 9:26 am
Forum: General
Topic: Wait for file issues
Replies: 16
Views: 7721

The WFF stage is not intended for it to monitor for the file that a job is suppose to execute. Many time the file may have been created and populated but the process that wrote it has not completely closed yet. so to a job trying to pick it up cannot get a open because the file is still open by anot...
by rschirm
Mon Jan 19, 2015 1:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pipelining with a sortfunnel stage
Replies: 2
Views: 2846

Hello Arnd,

Hope things are going well with you.

How about instead of rejecting unmatched rows tell it to continue instead and feed all rows through the trx and evaluate the if the row had a match in the trx?

Rows would stay in the same order so would not have to be resorted or sort merged.

Rick
by rschirm
Mon Jan 19, 2015 1:41 pm
Forum: General
Topic: Can we setup a C++ compiler after installation of Datastage
Replies: 6
Views: 5421

You can install the C++ post DS install. But you must get the 2 Environment Variables set correctly. After you install the c++ compiler there should be a command prompt that you can run that is related to the compiler that you installed. By executing that you can then do a set and retrieve the env v...
by rschirm
Wed Dec 24, 2014 8:46 am
Forum: General
Topic: Can we enable RCP in a Dataware Environment or not ?
Replies: 10
Views: 9068

From what you are describing RCP will work just fine. Performance will not be an issue as there is no additional overhead unless your target does not have all of the same column names. The only impact that you will have would be if you are utilizing Metadata Workbench as the RCP is not seen in the l...
by rschirm
Tue Dec 23, 2014 11:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filter Stage problems
Replies: 3
Views: 3976

The () characters are what is throwing the error. Something a complex as you are doing belong using a transformer or a build op stage.
by rschirm
Mon Dec 22, 2014 11:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture Multiple changes
Replies: 3
Views: 3936

You might address it this way.

1. Read data in and sort by bk,org,unit,flag(maybe)
2. feed to Aggregator stage grouping by bk,org,unit,flag(maybe)
3. output grouping values of bk,org,unit,flag(maybe),Min(active_frm),Max(active_to)
4. add seregate key and write to output.
by rschirm
Mon Dec 22, 2014 10:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivoting of rows
Replies: 10
Views: 6998

Just use the enterprise pivot stage to do exactly what you want to do.
by rschirm
Thu Jun 02, 2011 9:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: transformer compilation eror
Replies: 12
Views: 10821

on the server goto programs and navigate to the Microsoft Visual Studio 2008 and find the Command prompt and select. This will place you in a command window that has all of the needed C++ environment variables defined. execute the following: set > env.txt Now you have a file that you can edit up and...