DSXchange

Easy to do if you use a third party scheduling tool since it can wait for a dsjob against one project to finish before running one against the other project. If you are using DataStage scheduling then it becomes more difficult. Maybe do a routine that creates a set of empty text files, one per job. ...

Normally you could remove duplicates and produce a count column using an aggregator, but since you have a conditional counter probably easiest to do it in a transformer using stage variables. You will need the data sorted by the four key fields and in the stage variables store the current key and pr...

Lee Scheffler was the initial architect of DataStage and you can read his account of the origins of DataStage , plus DataStage present day under IBM and DataStage future plans (beyond Hawk). He remains the chief architect and a Distinguished Engineer with IBM. As pointed out in the previous replies ...

Varchar numbers and decimal numbers sort differently. Decimal is obviously 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Varchar is 1, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 2, 20, 3, 4, 5, 6, 7, 8, 9 So what you might be seeing is unexpected sorting of your second column. P...

Have a look at the FAQ forum sticky topic "Where do I get Information on DataStage?" for some websites. Also check the profile of our top posters to see if they have websites, some of them have DataStage treasure chests!

It is 75% of questions right, not 75 questions right.
DataStage Certification - how to pass the exam

Once you have set your mode to continue (or reject) be on the lookout in testing for unexpected lookup misses such as comparing a trimmed string to an untrimmed string, or comparing char to varchar, or comparing on a duplicate key.

The first Hawk product has already been released, it was DataStage TX version 8.0 that came out last year. So we can assume the other products in the Hawk release will also be version 8.0. I have a couple of blogs on Hawk in A quick look at QualityStage Hawk and My top ten features in DataStage Hawk...

I like Exam Diff which you can get from any shareware download site like the one at zdnet. It has different highlighting of rows that are new, updated or missing. It has inline highlighting of differences.

I did some investigation of lookup fileset versus a dataset which I posted to my blog parallel lookup types. On larger lookups the lookup fileset can be used immediately, other types of lookup need to be loaded into a temporary lookup fileset which is removed after the job finishes.

No reason to use the API stage in parallel jobs, you should be using the enterprise stage instead.

As DSG points out you can easily read the difference between datasets and flat files in the manual. With the copy stage I often use it as a "placeholder" stage which simply transfers input columns to output columns in straight mapping. This stage will disappear when the job is run. It lets me replac...

You need a good study balance between experimenting with jobs and reading up on those sections of the manuals you are not familiar with. Pay special attention to experimenting with your own config files, different types of sorting, partitioning. View the results of partitioning through the Director ...

Probably better to build an intelligent copy mechanism of just the user-defined section. You do not want to overwrite parameters such as temp directory locations and you do not want to push development flag settings such as logging into production. See the FAQ Project specific environment variables ...

So far CoSort have worked mainly with the server edition for developing the plugin and determining compatibility and measuring performance improvements. There is no doubt the CoSort sorting, filtering and aggregation is many times faster then a server job. As much as 100 times faster. What I am dubi...