Search found 602 matches

by abc123
Sun May 24, 2020 8:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Looking for design suggestions
Replies: 2
Views: 11563

Looking for design suggestions

I have an input link, Link1, that has two values coming in such as: Val1 Val2 10 20 90 100 200 100000 etc. There are some situations where Val2 might have a value of 100000. From Link2, I have values coming in ranges such as: ValX ValY ValCol 30 40 A 70 80 B 110 120 C 150 160 D 250 300 E etc. If Val...
by abc123
Tue Dec 10, 2019 4:25 am
Forum: General
Topic: Making an Execute Command stage produce a warning
Replies: 8
Views: 11335

Ray, thank you very much for your response. I want to do it without making any code change on the ExecuteCommand stage. This is because, I want to test my error handler on the ExecuteCommand stage just like it would happen in production. I can delete the file in the JobActivity stage before the Exec...
by abc123
Mon Dec 09, 2019 9:33 am
Forum: General
Topic: Making an Execute Command stage produce a warning
Replies: 8
Views: 11335

Craig, thank you for your response. 1) I have a sequence job design like this: JobActivity1--------->ExecuteCommand---------> JobActivity2 | | ~ ~ TerminatoryActivity1 TerminatoryActivity2 NOTE: I had to use a caret to show the arrow pointer. JobActivity1 produces a flat file. I would like to raise ...
by abc123
Sat Dec 07, 2019 9:03 am
Forum: General
Topic: Making an Execute Command stage produce a warning
Replies: 8
Views: 11335

Craig, thank you for your response. 1) I have a sequence job design like this: JobActivity1--->ExecuteCommand ---> JobActivity2 | | ~ ~ TerminatoryActivity1 TerminatoryActivity2 JobActivity1 produces a flat file. I would like to raise a warning in the ExecuteCommand stage so that execution moves to ...
by abc123
Thu Dec 05, 2019 10:23 am
Forum: General
Topic: Making an Execute Command stage produce a warning
Replies: 8
Views: 11335

Making an Execute Command stage produce a warning

I have an Execute Command stage that does a: cat filename There is a Job Activity stage before it in the sequence job which produces a file. I would like the Execute Command stage to produce a warning at run-time. I know that I can do an After-Job Subroutine in the job in the Job Activity stage and ...
by abc123
Tue Nov 19, 2019 4:01 pm
Forum: General
Topic: Querying the log of a multi-instance job
Replies: 6
Views: 8693

Thanks. I tried:
dsjob -domain MyDomain -user MyID -password MyPwd -server MyServer -logdetail MyProj MyJob.InstanceID

I get the error:
ERROR: ASBHome not found
no JvmPath configured
by abc123
Mon Nov 18, 2019 1:47 pm
Forum: General
Topic: Querying the log of a multi-instance job
Replies: 6
Views: 8693

Querying the log of a multi-instance job

I would like to query the log of a multi-instance job. I would like to see if any of the instances ever encountered a warning. I thought of querying RT_STATUSnnn files in the project but I am not sure how to do it. Any ideas? Is there any other way that this can be done?
by abc123
Mon Jul 29, 2019 11:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running a stage within a job with a different config file
Replies: 8
Views: 6670

Nothing would be different. I am just wondering if just the Oracle Connector stage can be run with a higher number of nodes to improve performance. The SQL takes a long time due to the volume of data and was hoping to improve performance.
by abc123
Sat Jul 27, 2019 3:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running a stage within a job with a different config file
Replies: 8
Views: 6670

Running a stage within a job with a different config file

I have a job with several stages with the last stage being an Oracle Connector stage. I would like the last stage to run with a different config file than the other stages. I looked into node map constraint but it wasn't of much help. Any ideas?
by abc123
Thu Nov 08, 2018 5:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage: Anybody encountered this?
Replies: 0
Views: 2393

Slowly Changing Dimension stage: Anybody encountered this?

I have a dimension table (Dim1) being updated using Type 2. The existing data of Dim1 (based on certain criteria) is being used as the Reference set (Ref1). Between runs of the DataStage job to load Dim1, some of the rows got updated in Ref1 (Dim1 based on certain criteria). Now, in the next run of ...
by abc123
Mon Nov 14, 2016 7:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Default Date format
Replies: 2
Views: 3293

When you wrote to the dataset, what data type did you write it as? You need to read it using the same data type. You can then manipulate the format downstream (if needed) using something like what Craig is suggesting.
by abc123
Mon Nov 14, 2016 3:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicates
Replies: 4
Views: 4544

I am assuming that what he is saying is, other than the indicator column, he wants to find duplicates of the rest of the columns. If there is a Y in the indicator column of a row, it is a duplicate of the previous row in all columns other than the indicator column.
by abc123
Mon Nov 14, 2016 3:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removal of Repeated Characters
Replies: 14
Views: 11801

qt_ky, I am assuming that you are talking about a parallel transformer loop, right?
by abc123
Mon Nov 14, 2016 11:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removal of Repeated Characters
Replies: 14
Views: 11801

Datastage 9.1 has eReplace in the parallel transformer stage.

Ray/qt_ky, if the OP was to replace strings such as AAAA with A using eReplace, how would he do it?

I would think that the OP would have to call eReplace 26 times in a nested manner. Agree?
by abc123
Fri Nov 11, 2016 11:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple spreadsheet using unstructured datastage
Replies: 4
Views: 6459

If you want to read multiple Excel files by using one unstructured stage, you need to use a wild card. So if you have files like this: File1.xls File2.xls File3.xls you need to put: File*.xls in the "File name" box after clicking the Configure button. In that case, you also need to check &...