DSXchange

If you are looking for a BASIC transformer routine you can look in the SDK folder via DataStage Manager. If you are looking for a parallel job transformer routine tutorial try my blog post The Top 7 Online DataStage Tutorials as they are hard to find on the IBM website.

You can run the install program again without fear as it will just take you into the menus. The first install screen gives you five options: client, server, domain, repository and documentation. For Information Analyzer you should choose client, server and domain but not repository. This should take...

QualityStage 7.5 still has import and export files in the .IMF extension. According to the help file "When you need to use a project created in an earlier version of QualityStage (or INTEGRITY), or someone else's project, you import that project."

So your INTEGRITY IMF files should work.

Given the cost of repartitioning you may find restricting both jobs to 2 nodes is faster than 4 nodes followed by 2 nodes. There may be a way to be clever with the configuration file so you have a node pool of 4 nodes for datasets and 2 nodes for everything else. Don't know enough about pooling to b...

If your WebSphere Application Server is not running you will not be able to connect to the Metadata Server. If you started it and it shows up as being stopped maybe it is not starting correctly. Verify that it is running before you try DataStage.

Addendum to my last post, you might be able to generate consistent and repeatable surrogate keys if you use a formula to turn a text string into a key such as a CRC32 function. You could search the web for C code that does this and turn it into a custom C routine that can be called from a Transforme...

You can never get the same keys as your item list will keep changing so the keys you give to items will keep changing. The only way to keep the same keys for the same items is to store key mapping in a dataset and use it as a lookup each month and keep adding to it with new key combinations.

The dataset is the fastest way to save data from a parallel job to disk as it maintains the partitioning and metadata of the data. This makes it a good choice for staged data or reference data but they can only be written, read or used by DataStage jobs. Sequential files are plain text files with ei...

I think it's the %ORCHESTRATE.KEYFLD, DataStage isn't recognising it as a field so it is passed through as a string. Have you tried some type of SQL concatenation like ''' || '%' || ORCHESTRATE.KEYFIELD || '''. Excuse my Oracle syntax, it's been a long time and I'm working from memory.

I think your descending sort may be the problem. Most sorts by default are ascending. Your sort stage is doing an ascending, descending sort and your remove duplicates stage is probably configured for an ascending, ascending row order. You need to keep them synchronised to avoid the warning.

Have a look at the FAQ forum on generating a unique counter in a parallel job. The surrogate key stage wont let you do a complex increment, a parallel transformer will. You need to use the parallel macros for partition numbers to make sure numbers are unique between parallel instances of the transfo...

You can switch your standard job parameters into project specific job parameters by exporting your development file to a dsx export file and running various search and replace commands on parameter names. I discussed these type of parameters in detail in DataStage tip: using job parameters without l...

It's a bit tricky and it depends on what the latest partner offerings are. You should be able to get trial or evaluation software, you can also use a wide range of business software for free. Some software you only get with the purchase of an additional partner pack. You should be able to get a part...

Have a look at my blog posts for the links to download the software:
Information Server 8.0.1 released for Solaris and Red Hat Linux
Download DataStage 8, Information Analyzer and IBM Information Server for Windows AIX and Linux

I don't like this method for large volumes, it is far more efficient if you can separate your inserts and updates into different streams. If you do need to do it, and it's a simple design for smaller volumes, make sure you have a reject link. You will probably find your inserts are being rejected. S...