CDC Stage - issue capturing deletes

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sapitke
Participant
Posts: 2
Joined: Mon Aug 27, 2007 1:01 pm
Location: USA

CDC Stage - issue capturing deletes

Post by sapitke »

hello there. i am running a job that compares latest extract with the before extract and captures new, updated and deleted records in a dataset each. change mode is set to "explicit keys, all values".

everything works beautifully except for the fact that "excluded as value" column on the dataset that has deleted records has null values in it. all the other columns have values except for this particular column. what is strange is that this column DOES NOT have null values in other datasets (such as updates dataset or the inserts dataset).

i have runtime column propagation on throughout the job and all the metadata is read from the schema files.

any clues why?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Did you set 'Drop output for Delete' = false in the stage?
-craig

"You can never have too many knives" -- Logan Nine Fingers
sapitke
Participant
Posts: 2
Joined: Mon Aug 27, 2007 1:01 pm
Location: USA

Post by sapitke »

[i]Did you set 'Drop output for Delete' = false in the stage?[/i]

yes, i did. all the fields on the "deletes" dataset have values in them except for the key that is set as "excluded as value". this is bizzare.

thanks for replying.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Suggest you try a Search for all terms with a phrase like "CDC deletes" and see if anything that comes up helps.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply