DSXchange

For join to work, the sort order of records should match in both input links.

Regards,
Senthil

For join to work, the sort order of records should match in both input links.

Regards,
Senthil

Hi - Thanks for your comments. Ray/ArndW - Is it mandatory to pick only the 'first' key in sort as partition key? Will there be any issues if the data is partitioned on the fourth or fifth key? The reason I am asking this is, I am dealing with huge input datasets (>500million records) that is partit...

Hi, When using the aggregator in sort option the input record must be sorted using ALL the aggregate key columns, but, is it mandatory to partition it based on ALL the key columns (as documentation specifies) - isn't it enough if it is partitioned based on just one of the Key column? Thanks and Rega...

Hi, I am trying to use the resource estimation feature in Datastage8.5. I have a job that runs successfully and wanted to estimate its resource usage. So when I click File-> Estimate Resource for that job in designer, a new windows opens asking me to execute the job. When I run the job, the abends w...

Hi Kumar,

Can you please let us know if you found any performance differences between the lookup and join solutions?

Thanks,
Senthil

The datatype of two columns are char(1). If use @ or any special character .Then i need to change into space in final job which will load into target table. If you are planning to load a null value as null into the target table, you can specify @ (or any other character) when exporting the null val...

What is the volume of records in the input dataset? Is the key used for partitioning distributing the records reasonably (doesn't create a bottleneck) without making the flow sequential?

Regards
Senthil

What is the ratatype of two columns when writing to file? I guess Since these are char(1) columns it cannot have null field value of empty string. Try a value that is 1 char long example @ or ! Or some control character.

Thanks senthil

Is it possible that the records were dropped in file stage?

It has 15 transformers 6 Joins 3 aggregates and two lookups.

I think you should split the job.

It's couple of years I connected to DB2 but if i remember correctly you have to setup .rhosts file in home directory of the Etl Id (or Db Id?) in each of the nodes used. The rhosts file contains server name and user id and it should have read permission.

Thanks
Senthil

What is your target?

I would suggest you to go thorugh the DS manual for these stages.

To answer your question Lookup stage is used only when reference data is small (less than 20000 records in my dictionary) and can fit in memory.

Thanks,
Senthil

2. Selecting 'same' partition in source/output link will try to use the same partition in the source dataset created by a prior job - avoids repartitioning of data. Though 'same' can be used wtih source database stages, we need to be careful when data is read in parallel from a partitioned DB2 (and ...