DSXchange

apt = Applied Parallel Technologies (the precursor company to Torrent) vds = virtual Data Set The numeric components deal with the node number and other factors that place the data set within the step (job). The error (failed to find file or directory) was reported by the link that is connected to i...

Why do you want to invoke what amounts to one ETL tool from another?!!

Don't you hate the way Oracle, and Oracle practitioners, put the Oracle entries at the beginning of PATH and LD_LIBRARY_PATH, as if they were the only software worth considering. This has caused problems in the past. For DataStage, you should ensure that the DataStage libraries, etc., are found befo...

Or, if your UNIX Administrator can't/won't do it, add the following line to your dsenv file.

I thought you weren't allowed to use the Extract Date ?

Note that delimiter and delimiter string are different properties. The delimiter property is limited to a single character, the delimiter string property is not.

So, to reiterate what Craig advised, try setting the delimiter string property to "|".

Welcome aboard.

I'm not aware of any such stage out of the box, but DataStage does permit you to write your own custom stage types, so that may be an avenue to explore if you are comfortable with the C++ programming language. (Otherwise you could hire someone to do that work for you.)

You are correct that the encrypt utility does not exist in version 8,5. Since dsrun.sh is one of your own, one solution would be to have it read the password from a file owned by the executing user and to which no-one else has any access. Another way would be to use 700 permission on the dsrun.sh sc...

Why not just change the maximum number of Remote Desktop users on the server?

Use a Modify stage, which can accept a job parameter as a column name in a derivation expression.

Unlimited dynamic array size until you run out of memory.

You can, of course, use the job's User Status area to communicate back to its controlling sequence; contents of the User Status area are available through the $UserStatus activity variable for the Job activity.

I prefer to use two jobs from a sequence. The first job identifies the inserts and updates, writes the inserts to a Data Set, and performs the updates. The second job performs the inserts.

Keep in mind, too, that "the file" is not necessary a valid concept in Big Data. Data in what is logically "a file" will more than likely be distributed across nodes in a Hadoop distributed file system or similar. So what can "row number" mean in this context?

Why not perform some experiments and let us know?