Search found 3835 matches

by eostic
Thu Apr 04, 2013 1:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Java Transformer Performance
Replies: 4
Views: 1305

Not sure...could be a lot of things. Here are some questions and also things to consider: a) What are you doing inside your code? Are you calling out to somewhere? performing i/o? Doing heavy calculations? doing your own lookups into an rdbms? b) how many columns? are you going thru a loop for each ...
by eostic
Thu Apr 04, 2013 5:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Web Service Client Fails: Service invocation exception
Replies: 7
Views: 6144

Congrats, and thanks for the details! ....in theory, if the xpath was the only problem, this one is fixable by hand on a per-job basis prior to the patch, if someone was in a crucial mode with one particular Job.

Ernie
by eostic
Wed Apr 03, 2013 5:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get the xml message built by the webservice stages???
Replies: 2
Views: 1432

...another way is to build a Server Job that calls the same Web Service, and then use the "Trace" option in the Run Job dialog....select the Web Service Transformer on the left side, and all four boxes on the right...you will get a voluminous log in the DS Director.....and in the center yo...
by eostic
Wed Apr 03, 2013 5:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage with multiple lists at the same level
Replies: 7
Views: 3518

Congrats! ...and thanks...I continue to tweak the ways to describe this...glad it was clear.

Ernie
by eostic
Tue Apr 02, 2013 7:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage with multiple lists at the same level
Replies: 7
Views: 3518

I agree it looks confusing, and frankly, I'm not sure why it is called Parent/Child in that Step....I've been using it (HJoin) exclusively for this purpose, and outside of some initial testing when the Stage first came out, I've never had a reason to look at the OrderJoin Step ever again. I suppose ...
by eostic
Tue Apr 02, 2013 3:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage with multiple lists at the same level
Replies: 7
Views: 3518

regroup for certain, and then probably a join..... Spend time on that "side" of the job separately, so that things don't get too confused...read the data from flat files and make sure you are able to write the xml perfectly with your assembly. I'm currently writing a post on "tips for...
by eostic
Tue Apr 02, 2013 3:43 pm
Forum: General
Topic: How Long Does it Take to learn Datastage for ETL project
Replies: 7
Views: 4210

16+ years with it and learning new things every day... I like what Craig said up above. You can be pretty "dangerous" with it in just a couple of days, or a week...but it depends on so many other things...the sources and targets you have, the kinds of transformations you need to do, the st...
by eostic
Tue Apr 02, 2013 9:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Stage with multiple lists at the same level
Replies: 7
Views: 3518

Are they truly "independent" repeating nodes at the same level? If so, then in most cases, the appropriate solution is two separate links. They are no different than two separate relational tables coming out of (say) DB2. For a simple example, imagine "company" xml document that ...
by eostic
Fri Mar 29, 2013 1:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate xml output of below format
Replies: 7
Views: 1921

This is one of those xml documents that has a fairly poor design.....it would have been better if the element names were truly the metadata...in this case, the property "name" is the metadata. We'll assume for the moment that things like DEPT, Class and SECTION are actually columns on your...
by eostic
Wed Mar 27, 2013 1:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML stage generates separate documents for each row
Replies: 5
Views: 2465

I haven't explicitly seen "these" issues, but as we've discussed earlier, I haven't used the xml Stage in Server since early 8.5. Your issues certainly sound worthy of formally calling whoever provides your support.

Ernie
by eostic
Tue Mar 26, 2013 12:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML stage generates separate documents for each row
Replies: 5
Views: 2465

Very interesting. I can only guess here, based on some best practices I've been working on and observations of the behavior at the "mapping" part of the Composer step. By design, if you map a summary "group" (particular node key and usually the result of a re-group Step) to the &...
by eostic
Fri Mar 22, 2013 11:41 am
Forum: General
Topic: Source to Target mapping
Replies: 24
Views: 8279

I've had similar success using DataStage to read the xml variant of a .dsx file.

Ernie
by eostic
Fri Mar 22, 2013 11:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Omit null columns in XML output
Replies: 5
Views: 1536

Thank you Craig! Bless all you admins...!

Ernie
by eostic
Fri Mar 22, 2013 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Omit null columns in XML output
Replies: 5
Views: 1536

Maybe someone can split this into its own thread. These are two different questions. First, the xmlOutput Stage, by default, will not create elements for columns whose condition is truly "null". The elements simply won't be there for that row. If you have name and phone within person for a...
by eostic
Fri Mar 22, 2013 5:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Omit null columns in XML output
Replies: 5
Views: 1536

You should start your own thread, but the equivalent settings in a parallel Job are delimiter NONE and quote character NONE.

Ernie