DSXchange

You might be able to do something by writing to the Complex Flat File stage or the XML output stage. They both support hierarchy record formats. They can be tricky to configure. The Complex Flat File stage in DataStage 8 would be much easier to use for this task as it has better multiple format supp...

It spins? I didn't know that. Now I want a spinning dsxchange logo.

I often use stage variables when I don't need to for complex derivation code. I don't think there is much overhead and it can really help to document and organize the code in the stage. You can for example add a comment and a naming convention to a stage variable.

Your two biggest challenges: - the different way that Teradata handles keys and indexes. It doesn't need a unique primary index - in fact it can perform better without it. It does like natural keys instead of surrogates. You really need a Teradata specialist to get this right. An Oracle data modeler...

IBM usually uses DeveloperWorks to publish stuff for developers. There are a few articles turning up and one long RedBook. There have also been some tips and best practices at the IOD conferences. They are still trailing Informatica and Business Objects Data Integrator who both provide best practice...

We love people who find the resolution to their own questions and take the time to post them. Well done.

I'm in the same boat. I've written a few of these but they usually have customer logos all over them and I can't take them with me or distribute them. There is some stuff up on the OpenMethodology wiki. It's about information development and has some ETL tool stuff such as ETL Job Design Standards .

It is a very cool logo. Can you makeover Ken Bland's next?

The install guide for 8.0.1 that I've got has kernel parameters for Linux and AIX but not Solaris. There is online documentation for preparing Solaris for installation of the WebSphere Application Server (part of the Information Server): IBM WAS on Solaris It has 14 recommended kernel settings that ...

You can download it straight from IBM via the page IBM WebSphere DataStage Parallel Job Developer Guide Version 8 where they will charge you US$31.15 for a PDF! You are better off finding your install DVD or searching for the PDFs on your hard disk - they may be installed there without start menu li...

The easiest way to get row counts is via processing metadata - finding out how many rows passed down links in the job after the job has finished. Have a search for ETLSTATS posts for examples. Any attempt to get this number inside the job will slow the job down and may force you to take a single thr...

It started as a product called Orchestrate, the company was acquired by Ascential and became DataStage 6 for Unix. Then came DataStage 7 for Unix and Linux. DataStage 7.5.2x was the first Windows release. There was also support for DataStage 7 on Unix System System Services on the mainframe. Now Dat...

There have been some big changes in Informatica: - Buying Similarity Systems and getting a data quality tool and profiling tool. - Adding Push-Down optimisation. - Adding parallel processing capability (but is it as good as DataStages?) - Big move into Saas, eg. the Salesforce.com connector. - Super...

Looks like it's the earliest effective date of the most recent salary. This makes it tricky as a persons salary may have gone up and down. Eg. 10001 1999-01-01 000210000 10001 2001-01-01 000240000 10001 2003-01-01 000210000 In this case no combination of aggregation, sort and grouping will give you ...

You really should be loading those 10,000 records in a much shorter time. Your job will have array size in the database stage that you can increase. You can use the bulk insert stage for faster inserts. You should have a DBA monitor the load to see if there is any type of table locking that is slowi...