Reusing same job to load multiple tables of different DDL.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
gsherry1
Charter Member
Charter Member
Posts: 173
Joined: Fri Jun 17, 2005 8:31 am
Location: Canada

Reusing same job to load multiple tables of different DDL.

Post by gsherry1 »

Hello Forum,

Is it possible to use the same load job to load multiple load files with different columns and delimiters to different target tables.

My idea was to use parameterized schema files to handle/parse the load file, and parameters for the rest of the connectivity information. I've done such things with normal ETL processing before, but was wondering if there is something special about the load stages that might make using schema files not work.

Thanks,

Greg
aakashahuja
Premium Member
Premium Member
Posts: 210
Joined: Wed Feb 16, 2005 7:17 am

Post by aakashahuja »

Not sure if schema files work with database stages..... !!!!! you might want to check that out...

Cheers
Aakash
L'arrêt essayant d'être parfait… évoluons.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's possible; it's not best practice.

Parameterized schema files for the source files, and rely on RCP and parameterized table names for the loads.

No guarantees - you may need to tweak some other aspects.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Maveric
Participant
Posts: 388
Joined: Tue Mar 13, 2007 1:28 am

Post by Maveric »

gsherry1 wrote :"multiple load files with different columns and delimiters to different target tables".

Different columns can be handled by using RCP. Different tables using parameters. But different delimiters? can that be handled? i have a similar requirement and i am using a multi instance job. But the source files are all DataSets. So not sure if different delimiters can be handled?
Maveric
Participant
Posts: 388
Joined: Tue Mar 13, 2007 1:28 am

Post by Maveric »

since u said different "delimiters" i assumed it to be sequential file. Is that correct?
Post Reply