Search found 3835 matches

by eostic
Tue Apr 20, 2010 7:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

Bummer. I first learned about using the JVM options at a site when WSPack was brand new --- we were reading from a BEA based Web Service that was returning nearly 20Meg.......but that was many releases and many years ago. ...still seems odd that your volume is so small (big but not anywhere near ext...
by eostic
Tue Apr 20, 2010 6:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

Trying to think of other things that could be an issue...... Let's talk about the Web Service itself and the method of calling it. It's a WISD based Service... Can I assume it is configurd to return an array? (lots of rows=lots of data) What is the topology of the Job? Is it WSClient at the start? W...
by eostic
Mon Apr 19, 2010 1:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

3.6M is still really small.... If it were 100M, and pushing on the limits of XMLPack, I'd be concerned...but something else would seem to be going on here. Do you get "cannot create the JVM" when just setting those values and running "any" service, or when you set those values an...
by eostic
Mon Apr 19, 2010 5:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

So much for it being an ISD thing. Oh well. Good debugging work. Web Services pack is limited on what it can do. Having a tool like SOAPui is so critical when building an ISD app.....for future readers of this thread, you often have no control of the web service client --- whether it is DataStage or...
by eostic
Mon Apr 19, 2010 5:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage and SGML
Replies: 2
Views: 1096

...it will, to a degree... it depends. XML was derived from, and is a subset of, SGML......so there are bits and pieces and chunks of sgml where the xslt beneath the surface has been able to work. Get a snippet from your sgml and post it here, and we can take a look.

Ernie
by eostic
Fri Apr 16, 2010 6:15 am
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: DB2 Extract into Web service
Replies: 9
Views: 6728

.....now that we know it's WSTransformer, which is a row by row process, how many rows are we talking about? ....where do they go after they pass thru the WSTransformer? Web Services are definitely not screamers. I certainly wouldn't use them for large scale quantities of data. A really good SOAP ba...
by eostic
Thu Apr 15, 2010 3:30 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: DB2 Extract into Web service
Replies: 9
Views: 6728

hmm.. ...for further qualification, your note says you are "passing data to a web service", but the note is in the RTI Services topic --- do you mean that this job "is" a web service and you are passing data to RTIOutput Stage? ....then it's a slightly different discussion..... ....
by eostic
Thu Apr 15, 2010 3:26 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: DB2 Extract into Web service
Replies: 9
Views: 6728

...it depends.....how are you calling your Web Service? Can you tell us a bit more about the topology of the Job? I assume that DB2 API Stage is the source.......what is it doing for retrieval (complex join, simple SQL, Stored Procedure....Aggregation? ...one row retrieved or thousands of rows, etc....
by eostic
Thu Apr 15, 2010 11:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sending files to MQ
Replies: 6
Views: 2823

Not sure if DataStage will be the right way to go here.....there really isn't a regular way to "lift" a whole file and send it down a link........the only way to get something to the MQ Stage is to represent it as a "column" in DS....your zip file is likely to run into all kinds ...
by eostic
Thu Apr 15, 2010 11:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with XML Repitition Element
Replies: 1
Views: 895

This is going to be a tough one...there is little or no organization to the elements....is this the EXACT xml? Is there nothing that acts as a "containing" element for these? .....like <Transaction><ID/><Type/></Ref></Transaction> or something similar? Right now there is no real "stru...
by eostic
Thu Apr 15, 2010 10:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

Well...looking thru our threads again, if the RTI job is dumping it, it's likely not something at issue inside of the calling Job. And if you right mouse click on the WS Transformer (for future reference) and select "grid" option for editing, you will see an entry in there that lets you ad...
by eostic
Wed Apr 14, 2010 10:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

...beyond that, my only solution for you is the programmatic one. Limit the rows.

Ernie
by eostic
Wed Apr 14, 2010 10:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

....hmm..that's interesting. I didn't realize that you were calling this from another Job....

...using WSTransformer?

What happens when you invoke the service from an external tool, such as SOAPUI?

Ernie
by eostic
Tue Apr 13, 2010 12:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RTI WS doesn't return data if above a certain amount of rows
Replies: 28
Views: 8827

Let's talk about "b". Using XMLOutput. You say that you get the same error......do you mean that a test job (not RTI) wth XMLOutput gets the same error (ie...when trying to build the xml payload and send to say, a flat file)? Just looking for clarification in our discussion. You may have a...
by eostic
Mon Apr 12, 2010 3:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: xml as binary
Replies: 9
Views: 3136

To Ray's point, you won't convert "the xml"....you would convert something that is carried "inside" the xml.... There are various ways to do this, (I like using Server with iconv/oconv), but once you have the hex value translated into character, you put it inside your tags.... Fo...