Joining two datasets.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsadm_ws
Premium Member
Premium Member
Posts: 65
Joined: Mon Apr 12, 2010 10:30 am

Joining two datasets.

Post by dsadm_ws »

Hi all,

I have an issue, when I am trying to Join two Dataset files. If I join them using a Look-up stage, I get the desired output. However, If I use Join/Merge with the same keys, I am not getting the desired output.

Also, some of my records also has null values, but I am not joining them using Join/Merge.

Has it got anything to do with this. I am stuck here can anyone please throw some light on this issue.


Thanks!!
I_Server_Whale
Premium Member
Premium Member
Posts: 1255
Joined: Wed Feb 02, 2005 11:54 am
Location: United States of America

Post by I_Server_Whale »

Please post/provide a sample of your desired output and the current undesired output with the inputs for the same. May that will help us understanding your problem better.

Regards,
Whale.
Anything that won't sell, I don't want to invent. Its sale is proof of utility, and utility is success.
Author: Thomas A. Edison 1847-1931, American Inventor, Entrepreneur, Founder of GE
dsadm_ws
Premium Member
Premium Member
Posts: 65
Joined: Mon Apr 12, 2010 10:30 am

Post by dsadm_ws »

Thanks for the reply.

Have two datasets with the following columns:
first_name, Mi_Name, Lats_Name, Gender, Birth_dt
adam , l, supko, M, 1985-06-20
sri , k, kumar,
tia, suder, f , 1978-07-20

I am trying to join the two datasets through first_name, Mi_name, Last_Name, Gender, Birth_dt to extract the "person_sk" from the second dataset.

If use a Look-up then I get distinct "person_sk" for each distinct person.(with 260 records)

If, I use join/merge:
1. it is dropping most of the records when using the same keys as above.

I would really appreciate, if you can throw light on this issue. I can't figure out whats going wrong.

Thanks!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Merge stage consumes rows from its Update input link(s). That is, they are deleted from the "reference" data set as they are used.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply