DSXchange

Running in Sequential mode does not eliminate duplicates - it merely processes the duplicates in one node. Eliminating duplicates must be coded for, for example using a Remove Duplicates stage.

Import them into DataStage then right click and convert the local table definition into a shared table definition.

Very soon you will see a Premium Member logo beside your name in the Author column. Then you will be able to see all content. Please be aware that it's a manual process, not an automated process.

Ernie Ostic has a blogon this very topic.

Does this mean you can mark this thread as Resolved?

A red line indicates that the job has aborted. You then look in the job log to find out what caused the job to abort. I have already asked you to post that information, and am still waiting.

How are your data partitioned?

You need to determine when a new group is starting. Set up a stage variable svIsNewGroup derived as DNo = 0 Or CNo = 0 Or, if that's not correct, sort the data by PNo and generate a KeyChange column. Derive the value of rtno in a stage variable svRtNo as If svNewGroup Then If (DNo = 0 And CNo = 0) T...

There is no such thing as "junk data". Any data in your client's database is your client's data. Since the data are being read successfully, the values are valid. Somewhere in your job design - possibly in the loading phase - you are having mapping issues. You need to resolve these. Try wr...

Yes, that's precisely what I suggested. If network latency is an issue, pre-load the table (only the rows and columns you actually need) into a hashed file.

Use an after-job subroutine. When a file is opened with OpenSeq statement the System() function can return the file size (among other things). Then use CloseSeq and execute a command to delete the file. Pass the file's pathname as the input argument.

You can post images on an image server and refer to them here. But do try to answer the questions we've asked as completely as possible.

How long is a piece of string? How many jobs, how much information is collected from each? With what granularity is system information being collected? And so on. You do need to pick a number out of the hat, start with that, and be prepared to monitor. I've not been running the Ops Console long enou...

You might also consider before-job and after-job subroutines. Shared Containers could be used. They would have to be the first and last stages in each job design. Jobs invoked from sequences could be used. I'd be using server jobs here, since only one row (the count) needs to be processed. They're a...

WHAT failure?

Right now your diagnosis is in the same league as "my car won't start" and you expect us to guess at the cause.

Post full details of any error messages you have received.

What's the data type of deptno?