Hi all,
Is there any way I can generate the xml for a datastage job and then import it into my environment? The requirement is that different jobs need to be generated for different user needs at runtime.
For eg, I may not need the transformer stage on some condition provided by the user at runtime. If I had designed the job in designer, then this stage will always be there.
Thanks!
Deepak
Generate data stage jobs?
Wow. While I have been involved in generating fixed design jobs based on variable metadata, I can't imagine being able to do this based on the whim of 'different users needs at runtime'. And I don't see how 'user needs' play all that much into the ETL world. Who would these users be? What kind of needs are you anticipating? You sure this isn't more the purview of a BI tool in the hands of a 'Power User'?
Well... at some point here there will be Fast Track, which generates jobs based on Excel source-to-target mappings. Or at least as much of a job as it can based on what it was given, which would then be fleshed out by an ETL developer. But trying to roll your own, generating .xml or .dsx formatted 'code' based on user 'needs'... I don't see it.
Curious what others think.
Well... at some point here there will be Fast Track, which generates jobs based on Excel source-to-target mappings. Or at least as much of a job as it can based on what it was given, which would then be fleshed out by an ETL developer. But trying to roll your own, generating .xml or .dsx formatted 'code' based on user 'needs'... I don't see it.
Curious what others think.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There is a vague logic to the choice of forum - the OP requires dynamic design in real time.
Some parts of it can be done (for example by specifying entire expressions as parameters) but, as a general observation, I'd have to agree with Craig that it does not sit well as something one would expect to do with an ETL tool.
Some parts of it can be done (for example by specifying entire expressions as parameters) but, as a general observation, I'd have to agree with Craig that it does not sit well as something one would expect to do with an ETL tool.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
Someone at IOD last year mentioned they had built a processing engine using Parallel jobs with custom stages or native stages where all the column metadata came from schema files, the database commands were SQL files and the modify commands passed in as job parameters. You need a lot of skill in parallel jobs to set this up and some coding outside of DataStage to generate all the required files and commands.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn