DSXchange

Should be PS_1.param1, and parameter set PS_1 needs to be added to the job/sequence that uses it.

That's a useful tip. Thank you.

Annotations never cover stages - they always display behind them. There seem to be two schools of thought: small discreet annotations adjacent to a single stage, or large annotations that run behind a stage or group of stages. I have personal standards around colour schemes, etc., for annotations fo...

Compare the two export files and determine what the difference is.

Use the Performance Analysis tool right there in DataStage Designer (or, as Mike suggested, use the database behind the Operations Console). Or use Monitor view in DataStage Director client, where you can get figures per stage per node quite easily. The job log is not in ASCII. It's a database table...

Welcome aboard. Willkommen. Create a reject link from your Connector. On the page for the reject link you will find the ability to specify what error information you want added to the link, and under what circumstances. Downstream of that, you can parse the SQL State out of the error text. You may n...

Anyone out there seeing or hearing from customers about tooling such as Astera, EasyMorph, or even Tableau, for pushing transformation and ETL-like functionality closer to the business? Starting to see Tableau trying to push into "my" space. Nowhere near the richness of functionality, of ...

And I wonder, often out loud, how it is that someone in their early twenties can have a title including the word "Senior".

And I too am always learning and have not arrived.

I invest considerable quantities of my own time in doing so, because there's only so much you can learn from courses (and my manager says I no longer need them).

1. Prevention is the key. Write your jobs and test them so that they cannot crash. That said, don't forget to include some mechanism whereby the job can check whether it has been instructed to shut down (for example for system maintenance). 2. If you can intercept data errors via tests in the ETL fl...

I assume that, by "NEL", you mean the newline character (more usually described as "LF" for linefeed). But is it? Maybe the source from which DB2 was loaded was an extract from some kind of Windows-based file, so that you may also need to be looking for carriage-return ("CR&...

If the files can be pre-sorted by the join key(s), that would help. Use an explicit Sort stage with Sort Mode set to "Don't sort (previously sorted)". You could try throwing two or three or four reader processes per node at it, but this could interfere with partitioning by at least the fir...

Vincent McBurney wrote a blog on this very topic in September 2015.

Or a Column Export stage, with its output appropriately right trimmed of delimiter characters.

It's most easily accomplished - and far more efficient to process* - if you construct a Rule Set definition and use the Rule Set derived from that.

* Benchmarks suggest that a ten-rule Rule Set can process in roughly 18% of the time required for ten individual Data Rules.