DSXchange

First suggestion would be an exact search here for "transformer looping" as I seem to recall the details of it have already been discussed quite a bit here. That should get you going... that and a read of the manual.

I can't speak to their reasoning for the 'replace completely' approach versus an update. It may be lore, something that someone a long time ago in a version far far away decided that is no longer valid but is still being followed. There might be a business reason behind it, something to do with a pr...

What "next stage"? You can't detect zero records in the same job that is processing them but you can "after job". I've seen people union a dummy record to their source so they always get it regardless and then either filter it out or trigger something if that's the only record. I...

No rows is no rows, there's no such thing as a row number zero. And it should successfully process zero records, why would you need to "hard code" it?

saraswati wrote:I would like to know why unbounded columns does not work with XML data

To me that's a support question, I for one have no clue. Is that type even officially supported? Not asking whether it 'works' or not... is it supported?

Nowadays (and technically in another tool) we tend to prefer joins between the source and target to do the insert v. update decision since our database can handle that. We go 'full outer' when we need to worry about deletes and left outer when they're not an issue. Simplifies things for us as we onl...

Without a corresponding change to the buffer size? Not possible.

First guess - it sounds like a driver issue to me. You'd need to work with your official support provider to determine if that was the case and see if perhaps there is a known fix for it.

Enzopre wrote:First sentence in Ray's reply is: aggregation builds a hash table OF RESULTS in memory.

Sorry, I was focusing on the "in memory" part and thought that would be enough of an answer. Didn't realize you were on a deep dive.

Tony, this has nothing to do with ETL tools nor (as you noted) exclusive to DataStage, it's the nature of the beast with relational databases regardless of tool. While it can work fine where the vast majority of your actions are the first one listed and its use is highly dependent on the volume of d...

Not really. Is "99999" the largest value you are allowed to set?

If you are on version 8.5+ I would imagine transformer looping would be quite useful here.

First sentence in Ray's reply applies to both methods.

In my neck of the woods it's both Sunday and Mother's Day plus I'm on the verge of a migraine on top of it. Maybe tomorrow.

In the meantime, have you actually tried anything or are you just... stuck?

Yes.