How memory intensive is the XML output stage?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
poornimasai
Participant
Posts: 6
Joined: Mon Aug 02, 2010 2:38 pm

How memory intensive is the XML output stage?

Post by poornimasai »

I have a job that becomes non-responsive after it gets to the XML Output stage. Is there a memory setting I can change to experiment with?

Is this even memory intensive?
I am what I am, even when I am not myself.
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

It "could" be. But also, consider that the XML Output Stage is a sort of aggregating stage....unless you are using a trigger, it has to collect all of your rows before letting anything go....it also could just be a reflection of your job....if the "whole job" is your "whole xml", then it will be waiting for all the other rows to arrive before it finishes. If you sort your data coming in along its nested nodes, and the XML is not too many elements or attributes, it's fairly quick.....it depends.....but it's definitely not a screamer. How complex is your xml? Is it coming out correctly?

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Post Reply