DSXchange

Trillium have an old server edition plugin for DataStage and it's probably compatible with the 7.x releases. The Trillium website also talks about ETL connectors. However the Trillium website claims they are compatible with "IBM Information Integrator (formerly Ascential Data Stage)". Since they get...

Wow, version 4. You could use a Universe stage, write all your data into it and pull it out with a group by SQL command. You could upgrade a couple versions and try multiple instance jobs. Upgrade to DataStage EE parallel jobs with much faster sort and aggregation functions.

Isn't there a dos2unix Unix command to reformat files that have been editing on Windows?

I don't know how you do an Oracle or SQL Server repository install - the installation guide doesn't mention it. The install wizard searches for existing DB2 or prompts for a new DB2. I don't see any Oracle or SQL Server options. Best speak to IBM support and post the answer back here.

The Metadata Server and WAS need to stay together as the WAS hosts the server. DataStage can be on its own server. The database repository can be on its own server. So you can put the entire Metadata Server layer on another server.

You need to get an XBox, it wont run DataStage but it's more fun. You could practice on Microsoft SSIS or one of the open source ETL tools such as Talend or KETTLE. It's handy for all those projects you go on that don't have a budget for DataStage but need to move data.

Version 8.0.1 requires an application server for the domain layer - it comes bundled with WebSphere Application Server. Amongst other things this lets you run adminstration functions through a browser. It also requires a database repository of Oracle, DB2 or SQL Server and comes bundled with DB2 in ...

One thing a join will do that a lookup wont do is insist both the input and lookup streams are sorted. If your lookup volume is low (say less than 10 million rows) it may pay to use a lookup instead to remove this sort requirement. This is easier than pushing 3 billion rows into sort scratch space.

I like that. It satisfies the objective of keeping the design simple and it avoids playing around with the environment variables that try to prevent implicit sorts from being added to the job. Does it add any overhead to the job or does it get removed from the executing job? (Like a straight through...

I haven't got it to work just passing the file name, I've usually passed the contents as well. You might need to tweak your imported XML definition such as switching the key field. You might need to test on smaller files to see if it is valid XML and not a volume problem.

IBM have published a tutorial on using the XML input stage in parallel jobs. See my blog post for details: 7 DataStage Tutorials.

I'm still trying to get my evaluation Info Server running - problems with the license file. The manual shows creating users and groups via the new browser based tool and giving them access to roles such as DS User, DS Admin, Bus Gloss Admin, Bus Gloss author, Bus Gloss User. There are also Suite Adm...

The maintainable approach is to let the job do its own sorting and you just configure the merge. Parallel sorts are quite fast. You only need to make your design more complicated if you need more speed - so do a test run of the simple approach first to see if it meets your needs.

I've seen a demo of both products. Info Analyzer is worth it. It profiles source data and publishes results via reports and puts a summary of the profile results right into the DataStage properties window. It profiles on the DataStage parallel architecture making it a lot faster than it's predecesso...

You could get away with skipping the basic training if you know Informatica since there are so many similarities. I suggest you look through my Top 7 Online DataStage Tutorials (which has become 8 tutorials) to walk through the basics of DataStage before your advanced course.