DSXchange

I've heard of ibm converting a site using the inhouse convertion tool. If PeopleSoft hadn't been bought by Oracle they would probably offer it as a standard out of the box upgrade by now. The original plan was to put an express upgrade version of DataStage into every PeopleSoft product. Multiple ins...

I think DataStage jobs are far more common than TX jobs. For example on an Australian job site I see 113 ads with DataStage in the job description and 4 with TX or Mercator (the old name for TX). This means if you are an expert in TX you could potential earn the most money since resouces are hard to...

There is a version of DataStage called DataStage for PeopleSoft. It is a set of prewritten jobs for moving data from PeopleSoft into the PeopleSoft EPM database. There are hundreds of server jobs in this pack. This version comes "free" with PeopleSoft EPM, and by free I mean it is factored into the ...

If you are talking about the entire suite it is going to get a much higher profile in IBM than if it had remained at Ascential. With MetaStage reincarnated as the Information Server it becomes the home of DataStage, QualityStage and the Information Analyser from the old Ascential suite. It also serv...

I just answered this on another thread. Why don't you write from your hash file directly to lookup filesets? You should be able to do this by putting the hash file stage in a server job shared container and adding this to your parallel job.

Couldn't you just write a parallel job with a server job shared container that reads a server hash file and writes it to parallel lookup filesets? A transformer is probably not required though you might get some metadata related warning messages when you run the job. I would put a copy stage between...

I always thought that the functionality of QS was excellent in the matching and standardisation but what was letting it down was the architecture. Most problems can be debugged and fixed but what I found annoying was the way it wasn't entirely client server: the Access repository and pattern file di...

On recent projects I have seen Linux overwhelmingly becoming the most popular platform for DataStage servers, especially on sites running clusters or grids. If you work out how to get the first server setup correctly then you make this the standard configuration for every server that follows and you...

Thanks to tzeng for finding the new certification exam on the IBM website. I don't know of any way to get automatically notified of new exams of interest so I hadn't seen this one arrive. I don't know enough about the current QualityStage to have any chance of passing the exam. I may try and take it...

You should also consider a master data management process. For example, where is your definitive list of customers, addresses and products? Are you decommissioning core systems? You could try and make your data warehouse the consolidated view of all information from each set of systems but you face ...

Use a transformer stage accepting both sources as input with list 2 as primary input and list 1 as a reference lookup. Join on all fields, if you have a unique primary key you can just join on those fields for faster processing. Have a single output with a constraint of list1.NOTFOUND. This will out...

In your source and target databases you tend to store data just once. On your ETL server your store it many times, depending on how many rollback points you have, whether you have a dataset staging area, how often you archive etc. Data saved to datasets tends to take up more space than database tabl...

Since Hawk isn't available yet it is hard comparing it to other ETL products.

You don't get a dsparams.keep file until there is something to put into it! When you first create a project you get a dsparams file but since you have not made any changes to environment variables you don't have a keep file. Once you start making changes the keep file shows up.

An ETL developer on a DW project should know both ETL and DW concepts. On the modelling side they should know about things like surrogate keys, dimensional modelling and slowly changing dimensions. At least one ETL developer on the project should have both skillsets.