Work-around for SPARSE lookups on Windows

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
jzparad
Charter Member
Charter Member
Posts: 151
Joined: Thu Apr 01, 2004 9:37 pm

Work-around for SPARSE lookups on Windows

Post by jzparad »

I'm currently on a project using 7.5x2 EE on Windows with ODBC connections to a DB2 database on a mainframe. I have a need to do database lookups to populate a number of fact tables from an ODS which is also on DB2. The obvious solution would be to use sparse database lookups. However, since this feature doesn't appear to work on Windows I'm trying to find some work-around. Normal lookups are not an option due to the size of the tables. We simpy run out of memory. I thought of using a Server job but the performance drops from about 1700 rows/sec to 45 rows/sec. Other options are pulling complete tables across and performing joins and/or lookups from within DS but I'm not too keen on this.

Has anyone out there come up with a better solution?
Jim Paradies
jzparad
Charter Member
Charter Member
Posts: 151
Joined: Thu Apr 01, 2004 9:37 pm

Post by jzparad »

Sorry,

I sent this to the wrong forum.
Jim Paradies
Post Reply