Job Design

kumar66 · Post by **kumar66** » Mon Aug 10, 2009 8:26 am

Hi All,

I have some 10 files . All these files do have the same table definitions.
These files should need to be processed for some data validation and load into target.

I need to create some generic jobs to do this . Becasue I dont want to create 10 jobs .

So what will be the best way to do this.

Please Advice.

Thanks & Regards,
Kumar66

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Aug 10, 2009 8:27 am

Use parameters.

kumar66 · Post by **kumar66** » Mon Aug 10, 2009 8:33 am

Hi Sainath,

Thanks for your reply. But how to load the meta data for each file.
Because the meta data will be diffrent for all files.

Please Advice.

Thanks & Regards,
Kumar66

miwinter · Post by **miwinter** » Mon Aug 10, 2009 8:35 am

Sequential files? Multi-read the files (file pattern) in in one job and do the processing required.

By the way, confusion here is added from my view, as your first post contradicts this one:

Because the meta data will be diffrent for all files

chulett · Post by **chulett** » Mon Aug 10, 2009 8:37 am

So... "the meta data will be different for all files" but "All these files do have the same table definitions". ??

kumar66 · Post by **kumar66** » Mon Aug 10, 2009 8:37 am

Hi Miwinter,

Can you please explain in detail.

Thanks & Regards,
Kumar66

chulett · Post by **chulett** » Mon Aug 10, 2009 8:38 am

First you need to clarify your seemingly contradictory statements.

miwinter · Post by **miwinter** » Mon Aug 10, 2009 8:39 am

Please refer to the product documentation - see the Parallel Job Developer's Guide and refer to the Sequential File stage (see File Pattern)

kumar66 · Post by **kumar66** » Mon Aug 10, 2009 8:42 am

Hi All,

Sorry .My files wont have the same table definition.
The table definition will be diffrent for all the files.

Please Advice.

Thanks & Regrds,
Kumar66

chulett · Post by **chulett** » Mon Aug 10, 2009 8:55 am

So... you've got 10 files with different metadata that load to 10 different tables after some 'data validation' and you want to do this with one 'generic' job?

miwinter · Post by **miwinter** » Mon Aug 10, 2009 9:01 am

That's the impression I got - in which case, you're out of luck I'm afraid. At best, you could look to make use of shared containers where possible. RCP won't be of any use to you here either as you're looking to perform some validation (maybe also change?) on these data items.

kumar66 · Post by **kumar66** » Mon Aug 10, 2009 9:01 am

Hi Chulett,

Yes.

Thanks & Regards,
Kumar66

chulett · Post by **chulett** » Mon Aug 10, 2009 9:35 am

As noted, no can do.