Page 1 of 1

Job Start Up Time

Posted: Tue Jan 27, 2009 2:04 pm
by snt_ds
Hi,

We have a job with src as Oracle table with 6 lookup stages(In memory) , followed by the Transforer for the business rules and then loads an Oracle table. It gets roughly 2k records

Ths job takes startup time as 2.06 mins and 0.21 mins as production run time.So almost 90% of the time is used for Startup.

Any way by which I can reduce on the this startup time by making some design changes or any other settings that can help?

Thanks.

Posted: Tue Jan 27, 2009 5:32 pm
by ray.wurlod
One of the major invisible things in version 8.0 is reduced startup time. There's not a whole lot you can do about it in version 7. That's one of the reasons I advocate server jobs for small to medium loads.

Posted: Wed Jan 28, 2009 9:48 am
by Sainath.Srinivasan
If source and lookup are both Ora, why not do in db itself !!?

Search for Sparse and Performance.

Posted: Wed Jan 28, 2009 10:57 am
by Pierre
I faced this problem several times (with DS Server).
Clearing the log reduced the startup time.

Pierre.

Posted: Wed Jan 28, 2009 2:17 pm
by DSguru2B
I concur with Ray on this. Server jobs are at your disposal. Use them for such jobs.

Posted: Thu Jan 29, 2009 9:56 am
by snt_ds
Sainath.Srinivasan wrote:If source and lookup are both Ora, why not do in db itself !!?

Search for Sparse and Performance.
Thanks ..in that case why use ETL itself if everything could be done efficiently in DB.!!

Posted: Thu Jan 29, 2009 3:21 pm
by ray.wurlod
The "T" of ETL can rarely be done as efficiently or as flexibly in the database.