DSXchange

First and obvious question - do all of these tables and the target table have the same record structure?

Hey, it may work. Try it and see. Let us know.

Yes, there are validation rule sets VEMAIL and VPHONE (good at least for US email addresses and phone numbers).

I haven't tried exactly this, Ray, but in 8.7 you can limit access to Categories by user, and then establish Workflow and simply never approve or authorize new categories that an Author might accidentally create (ie...they'll stay in draft). ...then remove them from Draft. Ernie Which raises the in...

I've never done it that way.

Right click in the associated table definition, and you get Save As presented as a menu option.

Don't add so much load to start with. Schedule tasks more intelligently.

Stopping DataStage services must perforce remove some of the load from your system. Some of that load may well be connected clients and running jobs that you do not consider when taking the sledgehammer approach. These just die.

A combined operator is where the conductor process identifies two or more parallel operators that are adjacent in the design, and specified to execute with the same degree of parallelism on the same nodes. It will (aggressively) cause these to be executed as a single process as APT_CombinedOperatorC...

No.

But you can save the table definitions from DataStage into schema files - you don't actually have to "write" them.

You need terminators, for example "\n" characters or @FM system variables.

Not a single stage, unless you create your own (Build stage). The buffering mechanism within parallel jobs handles your requirement non-absolutely - if the producer stage is producing data faster than the consumer stage can process those data, then the buffer "resists" input, effectively s...

Usually this means that your system or network was too busy for the connection to be established within a reasonable time.

The workaround, if it may be called such, is to address supply and demand. Don't load your system so much, or get a more powerful system.

As Paul noted, the entire Data Set has to be sorted, not just the keys. Estimate not less than two times the entire volume of the Data Set as the requirement for scratch space when sorting. More is always better.

Your understanding of the compilation process is essentially correct. You will note that the generated OSH contains no mention of parallelism. There's a step that occurs before execution actually starts, though after the job run request has been issued, and that step is composition of the "scor...

Check with your network administrator what the packet size is. Obviously such hugely wide rows will need multi-packet transmission. Don't worry about trying to tune Array Size yet - leave it at 1 (that's still 958KB of network traffic per row!). Work with your network administrator to achieve a bett...