Job runs Longer while reading Sequential File

[anjan.k]

Hi,
I have job running more than one hour which has totally three stages as mentioned below.
Sequential File -> Transformer -> Dataset

It is reading about 12598197 records from the Sequential file and below transformation being done on most of columns in stage variables. It has totally 10 columns.

Code: Select all

If(TrimLeadingTrailing(LkInto_Trns_Validation.STKRM_PULL_Q) <>'' And IsValid("decimal[10,0]", TrimLeadingTrailing(LkInto_Trns_Validation.STKRM_PULL_Q))) Then 1 Else 0

Could you please suggest me if we can reduce run time by any chance?

Thanks!

[ray.wurlod]

Lose the If Then 1 Else 0 - the test expression itself will generate 1 or 0 in any case. Don't evaluate the TrimLeadingTrailing() function twice - pre-load it into a separate stage variable.

Code: Select all

sv1  <--  TrimLeadingTrailing(LkInto_Trns_Validation.STKRM_PULL_Q
sv2  <--  sv1 > "" And IsValid("decimal[10,0]",sv1)