Change Capture not giving proper output

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
G.K.K
Participant
Posts: 61
Joined: Tue May 13, 2008 6:54 am

Change Capture not giving proper output

Post by G.K.K »

Hi All,
We are using 8.5 version of datastage.
We have 3 columns (Key_Column, Column1, Column2) in the Before and After link of the Change Capture stage. The properties are set as below,
Change key : Key_Column
Change Values: Column1 & Column2
Change Mode: Explicit Keys and Values

When we run the first time, the insert records are sent in the output link as expected.
But when we run the job again with the same set of input data, change_code value is either 0(copy) or 3(update) randomly for different runs. But it must always be only "copy". This looks wierd.

We tried the below options, but all are giving the same wierd results.
- Auto Partition
- Hash Partition
- Running on single node config file
- Inline sort option
- Preserve Partitioning is set to Clear in both input links
- Execution mode for Change capture stage set as Sequential
- Used External Sort to sort the input links data

Please advise how to fix this issue or Do we need to install any patch to solve this issue??

Thanks in Advance!!
K.K
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

Can you confirm that you do not have any duplicate record in before/ after link?

Put a remove duplicate stage before and validate the counts.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
Dodge
Participant
Posts: 4
Joined: Sun Apr 18, 2010 4:59 pm

Re: Change Capture not giving proper output

Post by Dodge »

Do Proper Null handling on Source data and use the option : Explicit Keys and all Values..
KoolKid
Post Reply