DSXchange

RT_BPnnn, RT_SCnnn, RT_SCTEMP and RT_BPnnn.O are directories and must remain so. RT_CONFIGnnn and RT_STATUSnnn contain small and unvarying volumes of data, and so are good candidates for static hashed structure. RT_LOGnnn is the job log, and would cause lots of headaches keeping it tuned if you conv...

Welcome aboard.

Are you talking about a DataStage data set here, or something else?

If so, how are you identifying the partition to FTP?

Today the number of topics in the Enterprise Edition (parallel) forum passed 20,000.

How long, I wonder, before it overtakes the Server Edition forum topic count?

Actually DS.CHECKER only checks for orphaned entries. I suspect what Arnd meant was the CLEAN.ACCOUNT utility.

Use Record Delimiter String property rather than Record Delimiter property.

The SCD stage caches the dimension table (or at least those rows thus far processed) in memory, so it should be able to detect that the natural key has already been seen in the current run.

Can you look in the job log (job starting event) to determine what parameter values are actually being passed? That's about the only place there might be difference if the job runs OK from the DataStage client.

Parse the comma-delimited values into separate fields (using a Transformer or Column Import stage) then use a Pivot stage to generate the rows with the first four fields defined as the Pivot Keys.

I would imagine that SCD stage would handle multiple changes in the one stream.

That's what I thought you meant, and why I answered that particular question. To read the entirety of that answer you will need to get yourself a premium membership. Premium membership is one of the ways that the hosting and bandwidth costs of DSXchange (which you will notice carries no advertising)...

There is a limit on the number of subdirectories, and it's approximately 32655. There is no practical limit on the number of files. Your ls command lists files as well as directories - use a filtered ls or find command to limit the list to directories only. Consider deleting unwanted jobs, using mor...

For processing efficiency load the first four characters into a stage variable, for example svFirstFour. Map to upper case if your data contain mixed case.

Have you also installed the SDK? You need to.

The same as any other stage. You connect links to it and edit its properties.

DB2 is exactly the same except for the name of the command which, unsurprisingly perhaps, is "db2".