DSXchange

How to terminate a job if the Surrogate Key value reaches the max value be it signed/unsigned 32/64 bit while processing a single dataset.

Thanks !

Also to let you know, for every record there will be a key generated which will be a primary key on table. And we have 4 composite keys to identify unique record.

And you cannot reload the same record again else it will abort due to uniqe constraint.

Not sure how your straight forward logic works.

Hi Arndw,

Thanks for you promt response.

You mean to say that the design is direct extract and update.

What if your job aborts after 10 milliion, will you agan reload the data from row 1?

Hi All, Given below is the logic that need to implement Step1: Extract data from table x In where clause (load_ind = 'N') Step2 : Load to another table Y Step3 : Commit for every 50K Step4 : Update the load_ind = 'Y" Then continue with step1 which goes in loop. We need step 4 for the restarabil...

Hi,

Any idea team.

Ray,

Sorry for posting on server forum. Its a parallel job.

Thanks!

Hi All, Need help in implementing the following logic I have three files as shown in the below given format File1 ID IND 1 Y File2 ID IND 1 Y 1 X 1 A 1 X File3 ID IND 1 Y 1 Z All the above 3 files are the reference files and the input file or the main file will look like Main File ID IND1 IND2 IND3 ...

Hi Ray,

I am bit confused on how to use aggregator if I want to use the third dominant also apart from first and second dominant value.

The first point ie the aggregator is bit confusing, how can i get count on DT within group ID

Is there a way to check without using a trnasformer stage.

Hi All, I have the data as shown below and I need to pull the most dominant value, pl give me the best logic applicable ID DT 1 X 1 X 1 Y 1 Y 1 Y 1 Z There are two fields primary and secondary and my data should look like ID DT Primary Secondary 1 X Y X 1 Y Y X 1 Z Y X Here Y is the most domianant a...

Hi Creg,

The records need to be deleted and thats the requirement and we don't want to have a table exclusively to remove the dups.

If there are any more options to do this task would help greatly.

Hi All,

I have to create a one time job that has to identfy duplicate records based on 20 fields and delete the latest record (can be identified based on DATE1). There are millions of duplicate records in the table.

Please suggest the approach to resolve the issue.

HI Ray, thiis what i suppose to do first extract query select c1, c2, c3 ... from x WHERE x.ID > 0 AND x.ID <= 10000000 second and so on select c1, c2, c3 ... from x WHERE x.ID > 10000000 AND x.ID <= 20000000 select c1, c2, c3 ... from x WHERE x.ID > 20000000 AND x.ID <= 30000000 select c1, c2, c3 ....

The where clause is in sql. we need to extract within the range ids and I know the starting and end id. why I am doing the multiple extracts is , if iam using the complete id range then it will take huge amount of time, so i want to split and want to extract in ranges ie to run in loop and pass the ...