DSXchange

I am using Change Data capture stage not CDC transaction stage.

I am using CDC stage in one of my parallel job. Initially, my target table is empty. First time CDC outputs 10 rows (which are new rows). Next time when I run job it gives same 10 rows for update with change_code=3, which is not correct because this time it should output no rows.

In connector use Before SQL and do following;
CREATE TABLE T1
(
Column_Name Type PRIMARY KEY
)
;
INSERT INTO T1
SELECT Column
FROM Table_1 , Table_2
WHERE Table_1.column = Table_2.column;

Then extract data to Data Set

Is there any configuration for extracting multiple tables of same database into multiple Data Set using single connector(On Single DB Connection).
My DBMS is DB2.

#1,#2: Can you kindly provide some detail.

#4: If CDC stage execution is parallel then how it compare data If same KEY records of before data set is on one server and after data set record is on other server.
Kindly review this.....

"ray.wurlod" Thanks for reply

My job Design is Like Source1==>SortStage1==> CDC Stage ==> SortStage3 ==> Target Source2==>SortStage2==> My questions are; 1: As CDC has built in option regarding sorting data so, before CDC using Sort stage is bad approach and is this performance overhead? 2: Is it CDC Stage output data is sorted ...

Thanks for reply

1: No information or data passes to reject link. As, 0 rows output to reject link.
2: There is no specific warnings about this.
3: File import 100 percent shows in log with Number of records are 3.

Thanks for reply

We explicitly define all collumns of right table to Nullable.

Thanks for reply Go into DataStage Administrator, open your project settings, and enable the option to collect Operational Metadata. We need to do auditing without enable Operational Metadata. If you are using DataStage Operations Console (and its associated database) this information is already bei...

I want to store job information like Job Name, Job time before job started and after job ending(Succfuly or failure).
Kindly give in detail procedure to achive this task.(Ideal senario)

After left join its right table columns having varchar datatype value should be NULL but columns have values like empty single quote ''

Here is my file contens

[CR LF]
00001 N N MO 021698 DM UNFI [CR LF]
00002 N N MO 021698 DM UNFI [CR LF]
00003 N N MO 021698 DM UNFI [CR LF]
[CR LF]
----------------------------EndFile

Total records are 5
But data stage sequential stage ignore [CR LF] and read only 3 records

I have file whose 1st and last row is enter, NULL or space when I set sequential file stage formatting even nullfield to '' it's not inserting . Let me know how i can read all records even empty one having space,enter or Null. Formate as below 1. 2. 00001 T , N N MO 021698 DM UNFI . . .... 45050

Yes we want Script but the new filename will be generated from DataStage using user variable stage of Sequence job and pass variable to script.

How to move to another folder and rename specific pattern files using shell script in Datastage like file_name_currentDate()_123.txt to file_name to file_name_olddate.txt ?