Search found 336 matches

by Raftsman
Mon Feb 05, 2018 12:27 pm
Forum: General
Topic: Netezza: select all columns with name like %X from Y% tables
Replies: 5
Views: 4956

Use the "After" subroutine and run an Unix command to remove last UNION.
by Raftsman
Tue Mar 15, 2016 5:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage - Hierarchy
Replies: 4
Views: 4036

Thanks, we had already discussed this scenario but due to the time and memory each XML stage take to use, it did not meet our requirement.

Again thanks for the input and I will close this post.
by Raftsman
Mon Mar 14, 2016 9:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage - Hierarchy
Replies: 4
Views: 4036

In a nutshell, we are trying to parse out XML into a normalized model. Because the XML does not contain sequence keys, we have no way of tying the parent to the children. We could have root nodes with multiple duplicate children, who's children could have the same information at a lower level. Other...
by Raftsman
Thu Mar 10, 2016 1:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage - Hierarchy
Replies: 4
Views: 4036

XML Stage - Hierarchy

Is there a way to for the XML Stage to create the parent and child hierarchy. Currently the XSD provides the metadata from Root node down through the lower level nodes. The problem is, when we parse the data, there is no Referential Integrity tying the root node to the lower level nodes. From readin...
by Raftsman
Wed Sep 02, 2015 9:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Netezza Connector - SCD Stage
Replies: 1
Views: 1808

Netezza Connector - SCD Stage

Using the SCD stage with Netezza and for some reason the Updates are not working. Input Table Key Description 01 Text Type1 01 TextF When it goes through the SCD, two rows come out but duplicates end up in Netezza. Key is the primary key on the table. I checked with DBA's and an update was sent to t...
by Raftsman
Wed Jul 02, 2014 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Netezza connector creating external tables
Replies: 2
Views: 3144

This is part of the Netezza technology. It creates and drops the external tables once complete.
by Raftsman
Wed Jul 02, 2014 7:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 - Bulk Load
Replies: 1
Views: 2534

DB2 - Bulk Load

One of the options within the Load Control section of the Bulk Loader is"Statistics". It is greyed out and defaulted to "no". Is there a way to change it to "Yes". I can't find any documentation on this.

Thanks,
by Raftsman
Wed Jun 18, 2014 7:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS_FORCE_ABORT_AT_WARN_LIMIT
Replies: 5
Views: 5119

Thanks, I also opened up a PMR asking about this trigger option. Not sure why it's published and doesn't work.
by Raftsman
Wed Jun 18, 2014 5:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS_FORCE_ABORT_AT_WARN_LIMIT
Replies: 5
Views: 5119

DS_FORCE_ABORT_AT_WARN_LIMIT

We would like to force an abort if any warning errors are thrown from Datastage. The IBM documentation says that this utility will work. Seems not. Has anyone ever used this and is there a specific way to implement. I tried it at the Job level, Sequence level and then the Project level with no succe...
by Raftsman
Mon Mar 03, 2014 8:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Coding Bulk and Inserts/Updates
Replies: 3
Views: 2709

We are working with 300+ million rows for the first initial load, subsequent deltas are manageable. It is the first load that causes problems due to slow inserts loading. We get 4 times more performance with the Bulk loader. I was just wondering if anyone has used one job with two DB2 connectors, on...
by Raftsman
Wed Feb 26, 2014 7:44 am
Forum: General
Topic: DB2 Connector - Cursor Stability vs Read Uncommitted
Replies: 0
Views: 1735

DB2 Connector - Cursor Stability vs Read Uncommitted

We have had a few issues regarding the isolation level for DB2. We currently contain our source and targets in different schemas. We never read and write to the same table in the same schema. Currently, all of our jobs are defaulted to Cursor Stability. For some reason, we have been getting contenti...
by Raftsman
Wed Feb 26, 2014 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Coding Bulk and Inserts/Updates
Replies: 3
Views: 2709

Coding Bulk and Inserts/Updates

Has anyone designed how they do Initial loads and Incremental's in Datastage. We have a requirement to bulk load the initial load and subsequently process delta's. What I am try to stay away from is coding two jobs. My thought is to code one job and use a parameter to control which DB2 connector get...
by Raftsman
Fri Oct 25, 2013 2:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage - Clarification
Replies: 5
Views: 3658

Thanks for the info. I will mark this resolved.
by Raftsman
Fri Oct 25, 2013 11:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage - Clarification
Replies: 5
Views: 3658

Don't get me wrong, I just thought that if we could set this in the join stage, less stages would exist on the palette. I agree that it's useful.

Thanks for the answer.
by Raftsman
Fri Oct 25, 2013 10:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage - Clarification
Replies: 5
Views: 3658

Sort Stage - Clarification

When using a sorted Dataset as input to a join statement, if we don't put a Sort Stage set to "do not sort" and "same", the Join stage insert an internal Tsort even if we set the input partitioning of the Join stage to "same" In conclusion, in order for Datastage NOT to...