Search found 7 matches

by sql.alp
Thu Jul 10, 2014 5:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

im sure they are experts and experienced. and i am figuring that it is better for IBM developer's community. my quote was based on comparison with microsoft resource online! Everyone says, i personally experienced, it is very easy to find anything for any question you have about Microsoft! which mak...
by sql.alp
Thu Jul 10, 2014 3:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

wow! what a difference! it executes now way faster and i dont even have to put where clause to eliminate the unnecessary rows! even it selects all columns, still it is 5 times faster! unbelievable :D thank you All Guys! your expertise on DS solved another issue! without you, IBM's limited source wou...
by sql.alp
Thu Jul 10, 2014 11:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

Q4 : well it was set up to 0 as default, and it was getting timed out error on sql server 324 rows upsert. then i set it up for array= 1, transaction rows =1 then it executed. but still it took about 5 min! data type = smallint total row= 300-500 max (usually less) table to upsert= only PK index, no...
by sql.alp
Thu Jul 10, 2014 10:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

Q2: is it more efficient to use another hash file that captures the data from output of look up and direct it to final ODBC inst/updt stage?

Q4: what would be the best Parameter array size and Rows per transaction value on upsert stage for SQL server?
by sql.alp
Thu Jul 10, 2014 8:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

My etl background is SSIS and SQL server based(believe me i got into some transitions to become an IBM developer :) ) and i used to create a file rather than looking directly into the DB. Plus, it does back n fort for every single data. as i mentioned earlier i'm new to DS but i mentioned anything a...
by sql.alp
Wed Jul 09, 2014 9:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

Thx for the response so quick, Well they all have PKs. The reason for 3 join is nz to reach the A's PK by c then b. I know it's been set up inefficient but I have no control over A b and c tables which are in SQL server. At the end I will have to update A with all the values in nz. The look up is fo...
by sql.alp
Wed Jul 09, 2014 5:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE
Replies: 14
Views: 12842

LOOK UP PERFORMANCE TUNING WITH A BIG SQL SERVER TABLE

HI GUYS! i thank you all even now for your responses! i am fairly new to DS, and i am having issue with a job that checks the existing data in a SQL SERVER 3 table joins. (A, b,c) only one of the table is big sized (A). and there is very small table in NETEZZA (nz). i need to insert/update a field i...