DSXchange

Has anybody used InfoSphere DataStage Balanced Optimization? If yes, how well is it implemented? i.e. is it buggy? Is it as good as Informatica's push down optimization? Based on what I've read in IBM's docs it seems like a quick and dirty implementation that is not integrated very well in to the to...

I disagree. Development time in Ab Initio is faster than in DataStage for any job that is moderate or more complex. Basic jobs may be faster in DataStage. 1) making reusable jobs in Ab Initio is easy. Reusable jobs in datastage are impossible if the job is is not basic. This makes development longer...

I'm going to get some official specs on the hardware after the new year... I think the abinitio hardware is better. In particular the I/O speed. Re: join one cool thing about joins in ab initio is that you can overwrite the default comparison methods. So you can program how the comparison between tw...

I know I should use the join stage in a real life scenario, but I'm trying to see which tool can handle large lookups better in a test scenario. Switching from 4 nodes to 16 node helped a bit, but not even close to 2x. Here are some more results: # records: 1 million 1 node (\w disk pool) 00:31 2 no...

{ node "node0" { fastname "localhost" pools "" resource disk "mask/partn/00" {pools ""} resource disk "mask/partn/01" {pools ""} resource disk "mask/partn/02" {pools ""} resource disk "mask/partn/03" ...

Everybody has been telling me for years that Ab Initio is the best ETL tool. I finally got a chance to use it and it is sweet! From a developers point of view it is much more versatile, intuitive, and stable. You have to do more scripting, but it's simple. I ran a couple of tests to see how it perfo...

Well then a thumbs down to the SP stage. They should make a connector stage that allows you to execute SP as a transformation.

it does allow you to pass through columns that are not part of the SP's output, but you have to explicitly define them.... no RCP. I'm trying to make a shared container utilizing it, but I'll have to take another approach.

Hi, Has anybody been able to get RCP working with the stored procedure stage? It doesn't have an RCP checkbox like every other stage, and when I tried to run the job then all the columns that were expected to move through RCP were dropped. There is no mention of RCP in the Connectivity Guide for Sto...

no I never figured it out. We decided to drop the SCD stage and stick with a traditional design for SCD.... (because of the bugs and because it's not as good as I thought it would be) maybe they'll make a better version in the future.

Can anybody comment on how effective system cached hash files are in production? Are they reliable for large lookups (10 milion records)? We're thinking of using them for a realtime EDW solution instead of sparse lookups.

Any idea why they are not supported in parallel jobs?

That's odd. I tried that initially and it didn't work. It would always generate a new SK. Maybe I'm missing some DataStage fix or patch or something.

The SCD stage works in 8.01, but not in 8.1. I get this error message: scd_SCD2: Error when checking operator: Caught unknown exception during wrapDescribeOperator(). scd_SCD2: Error when checking operator: setInputInterfaceSchema() was not called by describeOperator() for input: 1. Error when check...

hi nirdesh2,

what do you have in the expression for the SK column on the Dim update tab?

Is it just NextSurrogateKey() or something else?

yes.