Job Start Up Time

snt_ds · Post by **snt_ds** » Tue Jan 27, 2009 2:04 pm

Hi,

We have a job with src as Oracle table with 6 lookup stages(In memory) , followed by the Transforer for the business rules and then loads an Oracle table. It gets roughly 2k records

Ths job takes startup time as 2.06 mins and 0.21 mins as production run time.So almost 90% of the time is used for Startup.

Any way by which I can reduce on the this startup time by making some design changes or any other settings that can help?

Thanks.

ray.wurlod · Post by **ray.wurlod** » Tue Jan 27, 2009 5:32 pm

One of the major invisible things in version 8.0 is reduced startup time. There's not a whole lot you can do about it in version 7. That's one of the reasons I advocate server jobs for small to medium loads.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Wed Jan 28, 2009 9:48 am

If source and lookup are both Ora, why not do in db itself !!?

Search for Sparse and Performance.

Pierre · Post by **Pierre** » Wed Jan 28, 2009 10:57 am

I faced this problem several times (with DS Server).
Clearing the log reduced the startup time.

Pierre.

DSguru2B · Post by **DSguru2B** » Wed Jan 28, 2009 2:17 pm

I concur with Ray on this. Server jobs are at your disposal. Use them for such jobs.

snt_ds · Post by **snt_ds** » Thu Jan 29, 2009 9:56 am

Sainath.Srinivasan wrote:If source and lookup are both Ora, why not do in db itself !!?

Search for Sparse and Performance.

Thanks ..in that case why use ETL itself if everything could be done efficiently in DB.!!

ray.wurlod · Post by **ray.wurlod** » Thu Jan 29, 2009 3:21 pm

The "T" of ETL can rarely be done as efficiently or as flexibly in the database.