DSXchange

Having oversized configuration files is a waste of time and effort. All the nodes have to be started even if they process no rows. DataStage parallel jobs move data in chunks not smaller than 32KB (and often larger). Best practice, therefore, is to have a selection of configuration files available, ...

Data Set without a doubt. The other two require export/import or index-building operations. The operator to write/read a Data Set is copy (which tells you that it's very low cost - the virtual Data Set associated with the link is simply copied to/from the Data Set's data files on disk).

Read the help for DSGetLinkInfo(). It can obtain single node count or total count. You can adapt ETLStats routines to suit a particular need. That said, I am surprised at your assertion, and await Kim's response to it.

Yes you can.

Even in parallel jobs, before-job and after-job subroutines are written in DataStage BASIC and executed by the conductor process.

Or you could essay GetEnvironment("USER") in a Transformer stage.

For test purposes you might even like to set APT_CONFIG_FILE explicitly in the routine under test.

Doesn't Search work for you?


Learn about the UNIX split command.

Please post the exact, complete error message and the record schema associated with the link.

Tip: create/import a table definition with "metadata supports multi-valued fields" check box checked. Then use a UniVerse stage to extract from DS_AUDIT. Use two output links, one un-normalized and the other normalized on MODS.

The piece of the manual that you have quoted says it all - you need to create a Data Set with one field, of type Raw, that contains the data record specified by the QualityStage file definition. There are several ways you might accomplish this, such as a StringToRaw() function or reading your file w...

Here is a sample of how you might go about it; I have supplied a suitable after-job subroutine. Full error handling has been omitted for clarity. SUBROUTINE NoRows(InputArg,ErrorCode) $IFNDEF JOBCONTROL.H $INCLUDE DSINCLUDE JOBCONTROL.H $ENDIF DEFFUN UtilityRunJob(Arg1,Arg2,Arg3,Arg4)...

Restart works by a checkpoint being created for each successfully completed activity. On restart, if checkpoints exist, DataStage skips any checkpointed activity. Sometimes, however, you need a particular activity to run even though it completed successfully on the previous run - for example an acti...

Or, indeed, in an External Source stage.

ETLStats is still applicable.

The only way to aggregate over the entire data set is to run the Aggregator stage in a single node (that is, sequentially). You can use a Sort/Merge collector to preserve any existing sorting.

The ODBC Enterprise stage will establish one connection to the data source per processing node defined in the configuration file.