Strange Input buffer overrun problem

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Aruna Gutti
Premium Member
Premium Member
Posts: 145
Joined: Fri Sep 21, 2007 9:35 am
Location: Boston

Strange Input buffer overrun problem

Post by Aruna Gutti »

We are getting 'Input Buffer overrun at field' warning while reading one of the CFF files. The import is skipping rest of the records after this warning.

Failed Job log:
Cff_Fws054_in,0: Input buffer overrun at field "cff_fws054_in_record_type.Mdse_rec.WS054_AUD_ADJ_FLASH_IND_2", at offset: 31
Cff_Fws054_in,0: Import warning at record 129012.
Cff_Fws054_in,0: Import unsuccessful at record 129012.
Cff_Fws054_in,0: Import complete; 129012 records imported successfully, 1 rejected.

When resubmitted the job runs successfully without any import issues. Also, we use this exact same file and same job for our parallel run environment without any issues. This is happening in production for the past 3 days.

Successful Job Log:

Cff_Fws054_in,0: Import complete; 7630936 records imported successfully, 0 rejected.

Could anyone suggest what may cause this other than metadata mapping issue.

Many Thanks,

Aruna.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Did you check the record # 129012 at the field WS054_AUD_ADJ_FLASH_IND_2 for any abnormality?
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Aruna Gutti
Premium Member
Premium Member
Posts: 145
Joined: Fri Sep 21, 2007 9:35 am
Location: Boston

Post by Aruna Gutti »

Hi Kumar,

I didn't, as the job ran successfully when we reran it. I thought it may be some other issue other than bad data/mapping as we could read the same file successfully with same metadata.

Thanks,

Aruna.
Aruna Gutti
Premium Member
Premium Member
Posts: 145
Joined: Fri Sep 21, 2007 9:35 am
Location: Boston

Post by Aruna Gutti »

We checked the contents of file and the data for the failing record looks fine.

Thanks,

Aruna.
Aruna Gutti
Premium Member
Premium Member
Posts: 145
Joined: Fri Sep 21, 2007 9:35 am
Location: Boston

Post by Aruna Gutti »

This issue is resolved. We tracked the issue down to a parallel process that is copying the file at the time job is running.
Post Reply