Sequential file stage strange behaviour

[jpraveen]

Hi

I am facing a strange issue with sequential file stage.

I have a file with 2 columns with only one records.
Date: varchar(10)
seqno:char(3).

I am using the above file as a lookup reference.

ISSUE:-

When ever i compile the job or run after 2- 3 hrs later, the data from file is not importing and it shows as

"src_Date_Counter,0: Import complete; 0 records imported successfully, 0 rejected."

but the record is there when i check in file.


is anything i am missing basics.

[ArndW]

Does that mean if you compile and run the job immediately, it processes 1 record but if you repeat after a period of time then it doesn't read that record?

[chulett]

As noted, a little unclear. Can you clarify - does this ever work and if so, when? Or does it always import zero records?

[jpraveen]

Hi Chullet,

This will work if i ran the job 4-5 times continuously..

If the job is compiled, then the record is not imported, though there will be 1 record and i am able to see the record in file in unix directory.

"Dt_Counter,0: Import complete; 0 records imported successfully, 0 rejected"

[ray.wurlod]

Is this file re-created between runs? If so might there be occasions when the data in the file do not match the defined record schema (metadata)?

Add a reject link to the Sequential File stage. Direct the reject link to a Peek stage so that you can see what the Sequential File stage attempted to read.

Another possibility is that the First Line is Column Headings property was set to True before the job was compiled. This will cause DataStage to skip the first (and only) line.

[jpraveen]

Yes this file will overwrite on every run and i have put the reject link also.

But still i can see the same issue that after a gap of 2-3 hours, the record is not imported.

[ray.wurlod]

What did you get on the reject link?