CSV files unformated in Parallel jobs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
fahmida
Participant
Posts: 1
Joined: Sun Apr 29, 2007 11:19 am
Location: Chennai

CSV files unformated in Parallel jobs

Post by fahmida »

Iam having problems in reading a CSV file in the required format,the target columns are calculated based on the fileds in the flat file,the problem is iam using a mod and NROWNUM condition to read the data which has 1 rec split across 5 lines but my file has 1 rec split over different lines sumtimes 3 and sumtimes 4 ,the only way we can identify the start of a record which is definite ,is thr any way to load my CSV file into target table with all the recs being read and written in the target table.
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. :D

Get "them" to send you a valid CSV file. The CSV rules stipulate the same number of fields in each row.

If you can't get that, read each row as a single VarChar and parse it yourself, perhaps in a Transformer stage, perhaps in a Column Import stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply