DSXchange

Strange for such a small document. Right now I'd suspect something else. Strange characters in the data, perhaps? What else are you doing in the Job... ...and now I see that you are in EE...so it's possible it is a column issue, although I don't usually see "heap" type errors, and generall...

You need to spend some time researching xml and this forum. Also read the documentation on the xml stages. You will need to know what the xml target you want "looks like" and then import that metadata (or type it in, once you learn how that works). Find also the xml best practices (tons of...

Right. Task number one is to get the data "out" of Oracle. Forget that it is xml, just try to get it.....describe as Varchar, have someone write a procedure for you, etc.... Once you "get" it....... then you can work on the xml bits....either streaming from whatever method you co...

K or M ? Anything above 300 Meg is getting borderline. That's for "one" of the xml documents in your subdirectory. If you really mean "k" here, then that's small, and shouldn't cause you a problem.... If truly it's megabytes you are talking about, then you will need to break up t...

Follow my link up above. You can do this very nicely, but it requires that you use a Server Job, which is more flexible for doing this sort of "row level" transaction work....... The link outlines how "close" you can come to ensuring delivery, and you can certainly avoid losing t...

Correction! Just did some checking.....as of 8.1 with FP1 (FP1 became available at the end of last year), the DTS supports Teradata! I haven't had a chance to see how to configure it, but it is supposed to support it. It should be similar to Oracle and DB2, exploiting MQ and utilizing the newer &quo...

First.... Congrats! Glad you stuck it out too. DS can do some wonderful things in real time. a) EE jobs were designed for heavy volume. Major batch stuff. Grid, etc. They have buffers built into the natural pipeline processing that occurs by default. When we run in real time, we have to somehow &quo...

I'm going entirely on memory here, because I haven't had a chance to look at 7.x in a long while, but I don't think the 7.x MQ Stage lets you target Correlation Id or many of the other header items......you can read them at the source, but not push them out.......

Ernie

Can't help with whether DTS shows up or not, but it's not for Teradata anyway. As far as I know it is designed for Oracle and DB2...... probably because, afaik, MQ series only supports DB2 and Teradata for the cross resource commit support (DTS is merely using MQ's support as a transaction coordinat...

Usually XSD = Schema file = XML Schema Definition. All three are generally synonyms. ....you can use that, or you can just use a formal "instance" document.... (a sample of your xml document). Either of those will give you the metadata that you need.....the xsd is best, as it will be sure ...

I suspected as much....it had to be "something" that was impacting the behavior of row shipment. I knew I've used xmlInput in real time jobs a ton of times...... ...and for something like this, you won't need interprocess row buffering. I suppose someone at your site felt it was necessary,...

It should be there with 8.1 and FP 1 applied. Base 8.1 did not have it included. If you are new to DataStage there is lots to do before you start working with the DTS Stage and MQ. Spend time learning how MQ works as a source in DS, how DS works in general, and how the DB2 (assuming that is your tar...

Go to Edit Job Properties...performance settings...in there are settings for interprocess row buffering.... I want you to have "none".

Also... any chance you are validating the xml?

Ernie

...another thought..... Have you worked at all with your interprocess row buffering settings? What are they for this job? For this project?

Ernie

Yes. Conservatively figure around 150 to 300 Meg in total document size before you will run into issues....you might get a bit higher, as I've seen as large as 500M, but it depends on a whole lot of factors, including the number of columns, their size and content, etc. See if you can create smaller ...