DSXchange

Assuming you have imported the table definition and then loaded it into the job, it should work OK.

If you're worried about accented characters and the like, use one of the maps that handle these such as UTF-8 or ISO8859-1 (depending on the character set used to encode your actual data).

We do some of that reverse engineering for a living. That's enough brain strain.

Not all stage types are in the Palette. This is intentional. Another example is the BASIC Transformer stage.

All stage types are in the Stage Types branch of the Repository.

You can customize your Palette by selecting stage types from there as well as from elsewhere in the Palette.

You're not stripping the mapped newline from the command output. Search DSXchange for examples of how to do so.

It may be (I can't test at this time) that you can only have a single specification in one field in the GUI, but can have more than one in a job parameter that you refer to in the Modify stage itself.

One we should have asked at the top. Is the character being passed through accurately and only being misreported in View Data? That is, is the character correct in the target which viewed with something other than DataStage data browser (which is notoriously bad at "un-American" characters...

Hmm. Have you tried setting the map to ISO8859-1 explicitly in the job or stage?

Without writing a routine you can't execute shell commands directly from a User Variables activity. Use an upstream Execute Command activity.

If you're on version 8.5 you could also use loop variables in the Transformer stage. Use the LastInGroup() function to reset the counter.

U was born in Burma. At the time, Burma was not a part of India.

To answer your final question, Data Set is perfect for staging data between parallel jobs. It preserves internal format, sorted order and partitioning. None of these is true for a sequential file. The operator generated by a Data Set stage is copy - it simply copies the virtual Data Set (what's on t...

What, no punched cards, paper tape, drum storage... ?

(Been there, done that.)

Five 19 inch platters for 80MB of disk storage?
Been there, done that also.

An NLS map name is the name of an in-memory map that specifies how to translate between the external encoding of the data and the internal Unicode encoding used within DataStage. You must specify the correct map that describes all code points in the external character set with which you're dealing. ...

Welcome aboard.

DSXchange's Search utility will find your answer; your question has been asked and answered fairly recently.

Your scratch (temp) disk is filling. Clean it up.

Getting more memory in the machine would help too.

It is possible to tune the memory consumption of the in-memory table created by the Aggregator stage, but I suspect you're not ready to go there yet.