DSXchange

I am blogging on this report later in the week. I call it a draw, Informatica ahead on Ability to Execute, IBM ahead on Visionary, both the only vendors in the leader quadrant, daylight to third. Great to see Informatica sparring with Bob on his blog. Hopefully vendors are becoming more aware of the...

They barely snuck into November. You should ask for your IoD entry fee back!

What do you have running on those Windows servers? Do you have both the target database and the DataStage engine on the same machines? If so you can improve performance by moving the database onto its own server. You can also upgrade your DataStage server with more RAM and look into upgrading to Ent...

That's tricky. I wonder if those characters makes it badly formed XML. You could try preprocessing the file using XLS. Do a forum search on XLS for previous threads, I don't know a lot about it myself. You could also try stripping out these characters using an operating system script such as search ...

I think in the current version of DataStage Server jobs you can find the CRC32 function on the right mouse click menu within a Transformer stage. It is now part of the standard DataStage install. Generating surrogate keys or sequence numbers is easy, just create a Stage Variable in your transformer ...

They are on server edition, they would need to procrastinate and come up with a bundle of money to upgrade to enterprise edition. The tricky part is change data capture. You need to check to see if incoming rows supersede existing rows. You can either write a long statement in a transformer comparin...

In your DataStage Director open up the job monitor, from a right mouse click display all stage instances, what you should see in your row counts is that one instance of the Transformer processed about 50 rows and the other instance processed 66 rows. That gave Transformer instance 1 the odd numbers ...

Parallel edition does give you C++ for transformations. Microsoft SSIS will also be allowing C programming for transformations in a future version. Comparisons of server jobs versus parallel jobs shows the C++ of parallel jobs is many times more efficient so for pure performance I don't see a reason...

I would stick with a simple meaningless counter where the seed value is the current maximum value in the target table. I wouldn't get fancy concatenating intelligent fields to derive a dumb surrogate, it would just take longer. You can use the surrogate key stage or you can also generate a key in a ...

Normally comparing jobs via export file comparison, html report comparison or reporting assistant querying can be quite difficult unless you are focusing on a particular aspect of the jobs. In your case database output stage comparisons. This narrow requirement makes it worthwhile building a custom ...

Generated SQL code does not appear in export or reports because it is generated, not stored! Your SQL statement is built from the input column list, the update type and the key fields. If you compare the column lists of output stages this gives you most of the SQL statement logic. When you see a htm...

I had a couple blogs about it, IBM Information Server for Dummies and the old My top ten features in DataStage Hawk and Ray had a good overview of the next release in The Product Formerly Known as Hawk.

Change data capture or replication between the databases so you don't have to move all the data every day. Both of these are not in the standard DataStage product though they are both options for the IBM Information Server along with DataStage 8.

We get so many server job to parallel job questions, this might be the first conversion the other way, are you completely dropping parallel edition? There is a summary in DataStage tip: What do you mean I need to optimise small jobs? You can add a config file job parameter to your job to restrict a ...

I don't think you can use and update a lookup in the one job unless you used an inefficient sparse database lookup. There is a new function in DataStage 8 to update in memory lookups. In server edition you can read from and write to a hash file but it doesn't work the same way in parallel jobs. You ...