DSXchange

Venkata Jaggamma wrote: When I tried to debug the job, I was able to find out that there is a problem at the DRS stage.

How?
And what is the precise nature of the problem?
Have you had your diagnosis verified by your support provider?

Try writing out a clear specification. By doing so you may even solve it yourself! If you do, please post your solution, so as to aid future searchers.

Use a Sort stage to sort by the three keys and the generate a key change column. Use a Transformer stage, with stage variables to "remember" the value of the date from the previous row. Reset on key change.

Then I suggest using a Difference or Compare stage, or use a Copy stage then join a copy of your "old" input to the output of the Change Capture stage. There are no QualityStage stages in your design - it's purely a DataStage job.

Moderator: please move to parallel forum

No, because all the detail there will ever be is in this thread. For less than 30c per day you can purchase premium membership which, among other things, allows you to read the entirety of posts by the five premium posters. Premium membership is 100% allocated to the hosting and bandwidth costs incu...

Keep running totals and other derived values in stage variables.
Detect group change either in stage variables or (easier) in Sort stage (key change column or cluster key change column).
Use detected change to constrain output.

It's usually called a "fork join" design.

As long as it takes. Depends on too many variables, including available bandwidth at the time.

As to the indexes, some argue yes, others argue no.

Define "performance" in an ETL context. The short answer is that each job must initialize its own connection(s) to Oracle - what you seek to do is not possible on a project-wide basis. Version 8 gives you Connector technology, which improves developer productivity, but it remains the case that, at r...

Welcome aboard. What do you even mean by "parallel mode"? Job sequences do not run as parallel jobs - they always execute on the Conductor node. However a job sequence can run server jobs, parallel jobs, other job sequences, and pretty much anything else (except mainframe jobs). If you are looking t...

The syntax of dsjob does not change at all

No.

It's not clear (a) what your design is doing and (b) where QualityStage fits in to the picture. Can you please document your design more fully? I am not aware that the Change Capture stage supports reference links.

The DSParams file is created when the project is created.

If the file does not exist then many things, such as the Administrator client, the Expression Editor, and so on will not work.

No.

That's why I suggested that you could re-write it.