DataStage Server job - need help with transformer

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
iShoreETL
Premium Member
Premium Member
Posts: 36
Joined: Wed Sep 05, 2012 9:40 pm

DataStage Server job - need help with transformer

Post by iShoreETL »

I have a special need to use Trensformer in a server job. There is one input file with 1 record and a reference file (Oracle connector) with about 10k.
On my output link I need all the records from reference file (10k).
When I run the job I only get 1 row (same as my input).
I linked the state code which is the same on all reference table rows as well as the input row.
I must use the Oracle connector for my reference.
I must use server job and not to use parallel with look up.
Any online documentation?

Thanks
iShoreETL
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Why not reverse the polarity? Meaning stream in the 10K and use the 1 record input file as the source for a hashed file lookup?
-craig

"You can never have too many knives" -- Logan Nine Fingers
iShoreETL
Premium Member
Premium Member
Posts: 36
Joined: Wed Sep 05, 2012 9:40 pm

Post by iShoreETL »

True, though in this situation will not work. The primary input will ultimately be from an ISD stage.
iShoreETL
ssnegi
Participant
Posts: 138
Joined: Thu Nov 15, 2007 4:17 am
Location: Sydney, Australia

Reply

Post by ssnegi »

you can use merge stage. first file - source file (one record) . Second file - reference file (10K records). Join Type - Right Outer Join. You can use transformer for any tranformation before or after the merge stage.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: Reply

Post by ray.wurlod »

ssnegi wrote:you can use merge stage. first file - source file (one record) . Second file - reference file (10K records). Join Type - Right Outer Join. You can use transformer for any tranformation before or after the merge stage.
Not true.
The server Merge stage performs SQL joins on a pair of text files.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You need to enable "reference link with multi-row result set".

Right click in the background of the Transformer stage and open Stage Properties. Choose the Inputs tab, then the reference input from the drop down list of link names. The check box you need is at the bottom of the page.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
iShoreETL
Premium Member
Premium Member
Posts: 36
Joined: Wed Sep 05, 2012 9:40 pm

Post by iShoreETL »

This option is only available Where a reference link originates from a UniVerse or ODBC stage. Does not work with my case (Oracle connector)
iShoreETL
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Maybe the simplest solution is to use ODBC to connect to Oracle.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply