Validate text file against the meta data

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Sachin K.C.
Participant
Posts: 12
Joined: Thu Sep 14, 2006 5:18 am
Location: Thane
Contact:

Validate text file against the meta data

Post by Sachin K.C. »

Hi,

I have the requirement of loading the sequential file data into the data set.

But before tranformation of data , i have to check the input sequential file has the proper no. of columns, column sequence , proper column data type, mandatory data in a column.

In short, i have to validate my input sequential file with the meta data define for that sequential file.

How i will pre validate that sequential file in above context before actual data transformation with business validation on of data .

Guide me on above context which will help me to proceed in my job.

Thank you
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

is it delimited file or fixed width??

you can easily do this in a transform stage.
BalageBaju
Participant
Posts: 34
Joined: Fri Sep 22, 2006 10:59 pm
Location: India

Post by BalageBaju »

Sachin,

Also you can get the rejected rows from the Sequential file stage itself by selecting the option "Reject Mode=Output".


Balaji.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I wrote a routine which tries to resolve this issue. It is called KgdDebugMetadata. I hope you can find it. It was geared more to finding a bad column in line xxxx in the sequential file. I think you can modify it to meet your needs.
Mamu Kim
Post Reply