DSXchange

I would prefer to see entries 1) Moved to the correct forum for the first offense for a poster then 2) deleted and the poster locked for a month (or a week for a signed up member). 1) can be skipped. This will drive home the message more than locking a forum that people might want to post correctly ...

Krazykoolrohit, I agree it's an overhead which is why I mentioned optional. I think it will enormously to the benifit of searches if resolutions are posted. Then some enterprising person copuld build a wikki or FAQ out of it :) If search results resulted in less ambiguous answers then we can in more...

While a check box to indicate the topic is closed, I think there should be a finalise option by the original poster detailing the solution that worked (even if it's referring back to a particular poster). I was looking for some information on UV lookups and while there are hundreds of posts, and lot...

We do have some issues with the current version such as teradata timeout - mutex error - jobs / seq not responding - etc.. and the solution to these problems given to us by IBM is to upgrade to v7.5.2. At my last gig we had similar problems that were solved by adding a dedicated network between the...

I think it is a xerces/saxxon implementation.

It just doesn't seem to handle the throughput as well as a more "native" on can. Sometimes we must look beyond DS for our solutions.

I've used two parsers; Saxxon and Xalan/Xerces. Xalan/Xerces is on apache.org, Saxxon you'll have to search for. I think Xalan and Xerces came orginally from IBM and were open sourced to Apache control a few years ago. There are others available, but I like the use OS software. You'll need to read u...

If you have a lot of XML data to parse and are breaking it down into several streams you might want to consider going outside of DataStage to process the XML into 1 or more flat files and deal with them that way. I changed a job stream that ran for over 4 hours processing 45 streams out of 3 largish...

I have to agree with Ray, One job, multiple transformations. Load as many Hashed tables into RAM (enable caching) as possible. If volumes are huge you can even containerise the lookup transforms, split the stream using a link partitioner, process each stream through the lookups and then use a link c...

Well done Craig. Well deserved praise for a well deserving poster

I use the doco tools very extensivly. At my current posting, we are using that for all our D/S doco and making sure that the jobs are filled in properly as part of QA. I've added an after market sed to add an annotations part to the HTML that references a file (and creates an empty one if necessary)...

I paid, I joined. If my $50 helps keep things running and gives me full access to all the top posters replies I'm WAY ahead. I'm not a newbie, in fact I think I'm pretty good. Not in the top group but I get by. $50 is nothing compared to the time I've saved, the answers I've found and the knowledge ...

I'm one of the CAPS only set like Arnd. My hand writing and spelling are atrotious (I knew I should have paid attention at school to english). People are suprised at how bad my spelling is considering my reading habit. At the moment I'm blaming spelling mistakes on my new keyboard ... It's USB conne...

ppalka,
Can datastage handle huge XML ... probably within it's limits.

The question is SHOULD datastage handle huge XML?

IMHO no. There are better tools to handleXML.

Search here for more info.

On my current assignment I'm here to oversee on behalf of the client the vendor that is/was doing the actual design/build work on a 7.1 SE system. I came up with same nameing standards and some sort of design standards before they started work. I then told them that IMHO maintainability is more impo...

I'd have to agree with ray. SMP becomes MPP with the addition of a second machine. A major Australian Telco had a datastage PC project running on 16 x 4 CPU Red Hut Linux boxes connected as a grid. I worked at Monash uni on their super computer, a cluster of Pentiums, 100MB ethernets and Linux. One ...