DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
goelumesh
Participant



Joined: 17 Jun 2009
Posts: 1
Location: IL
Points: 19

Post Posted: Mon Apr 09, 2018 2:53 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Friends,
Please let me know how CDC work in Datastage 11.7 , IS new release removed CDC stage and How we can migrate old DS 11.5 jobs to DS 11.7 which has CDC stage.

_________________
Umesh G
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42672
Location: Denver, CO
Points: 219765

Post Posted: Mon Apr 09, 2018 3:45 pm Reply with quote    Back to top    

Unless one of the fine people here knows the official answer, that sounds like something for your official support provider. All the documentation for the release only seems to note is "The IBM InfoSphere Change Data Capture (CDC) stage is deprecated. The stage will be removed after the Version 11.7 release." with no hint of what you can replace it with that I've seen. Yet. Confused

_________________
-craig

Research shows that 6 out of 7 dwarves aren't happy
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2798
Location: USA
Points: 21145

Post Posted: Tue Apr 10, 2018 8:21 am Reply with quote    Back to top    

Just a guess: most likely it will be or has been replaced by Kafka. In fact, if you look in the DataStage Designer 11.7 on the palette under the Real Time category, there is a Kafka Connector stage where the CDC Transaction stage used to be.

Furthermore, the CDC stage is still there in 11.7 if you look under Repository, Stage Types, Parallel, Real Time folder. It has cleverly been renamed to CDC_Transaction_has_been_DEPRECATED and assigned an all-gray icon. It sounds like it will no longer be included after version 11.7.

You need to ask IBM what the migration path is and where the documentation is. You might try talking with your IBM InfoSphere sales rep and see what they have to say about it. Please let us know what you find out.

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1249

Points: 8216

Post Posted: Mon Apr 30, 2018 6:57 am Reply with quote    Back to top    

Ban Famingoy as a bot please.
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42672
Location: Denver, CO
Points: 219765

Post Posted: Mon Apr 30, 2018 7:17 am Reply with quote    Back to top    

I will send out a raven in a bit...

_________________
-craig

Research shows that 6 out of 7 dwarves aren't happy
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1249

Points: 8216

Post Posted: Mon Apr 30, 2018 7:21 am Reply with quote    Back to top    

I prefer to send a fox.
Rate this response:  
Not yet rated
asorrell
Site Admin

Group memberships:
Premium Members, DSXchange Team, Inner Circle, Server to Parallel Transition Group

Joined: 04 Apr 2003
Posts: 1680
Location: Colleyville, Texas
Points: 22817

Post Posted: Mon Apr 30, 2018 8:17 am Reply with quote    Back to top    

Raven received...

Famingoy banned... posts deleted.

_________________
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2017
Rate this response:  
Not yet rated
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3585
Location: Australia, Melbourne
Points: 28045

Post Posted: Tue May 01, 2018 10:53 pm Reply with quote    Back to top    

The DataStage CDC stage has been discontinued and while it is in the DataStage 11.7 release it will be removed from future DataStage releases. I believe this is due to problems they had with performance and data consistency. The recommendation is that you land the data to file or database first and then read it with DataStage, so you can continue to use the CDD license as long as the data is processed by DataStage after it is staged.

https://www.ibm.com/support/knowledgecenter/en/SSZJPZ_11.7.0/com.ibm.swg.im.iis.productization.iisinfsv.relinfo.doc/topics/iisihrinfo_infsv_rnote_v117.html

"The IBM InfoSphere Change Data Capture (CDC) stage is deprecated. The stage will be removed after the Version 11.7 release."

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2798
Location: USA
Points: 21145

Post Posted: Wed May 02, 2018 5:08 am Reply with quote    Back to top    

Thank you for shedding some light on that mystery.

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
jackson.eyton



Group memberships:
Premium Members

Joined: 26 Oct 2017
Posts: 109

Points: 1819

Post Posted: Tue Jun 12, 2018 8:51 am Reply with quote    Back to top    

Sorry to dig this back up but when I search for Change Data Capture stage all I get are documents referring to the Change Capture stage, which I am really hoping is different from the Change Data Capture (CDC) stage referenced in the release notes. From just poking around I believe the Change Data Capture stage referenced in the notes is the CDC Transaction stage in the Real Time folder is that correct?

_________________
-Me
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2798
Location: USA
Points: 21145

Post Posted: Wed Jun 13, 2018 5:31 am Reply with quote    Back to top    

Correct.

See also: IBM InfoSphere Change Data Capture

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours