DSXchange

Take the IBM beginner's class (DataStage Essentials, code DX334). Among other things it takes you through this technique.

"Job aborted after 50 warnings" appears to rule out View Data as the culprit.

That the error is being generated by nls_read_fixedwidth() informs us that the error is occurring during import. Add a reject-handling link to the Sequential File stage that is reading the file to capture any row that fails to satisfy the main output link's metadata, and direct those rows to - for ...

Data are never "kept" within DataStage, so there's no limit on how much data a stage can handle. Data just flow through DataStage. A well-considered design will include one or two staging areas, for the purposes of restart/recovery, but theoretically (and as advised by DataStage sales folks over the...

20 Terabytes. Per partition. (I think there's a limit of 1 million partitions, too, but not totally certain on that one.)

One of the presenters at IOD 2006 also mentioned that your client machine needs 2GB minimum memory. How much is needed on the server side depends on how you distribute the various server components. For example, you can have the Application Server, the Domain Server and the database server all on on...

With a Modify stage it might work even faster. You will still need a string_trim function, however. Refer to Orchestrate Operators guide for more information, as they seem to have left this function out of the Parallel Job Developer's Guide. This document may also prove useful.

That the error is being generated by nls_read_fixedwidth() informs us that the error is occurring during import. Add a reject-handling link to the Sequential File stage that is reading the file to capture any row that fails to satisfy the main output link's metadata, and direct those rows to - for e...

Interview question?

The file name can be passed into the job as a parameter - after all, it's going to read that file. Therefore, the filename column is derived as the value of this job parameter. The file name parameter is given its value in the job sequence via the $Counter activity variable from the Start Loop activ...

It follows that you need to configure your Oracle client software (files such as tnsnames.ora, in/below the $ORACLE_HOME directory). Your Oracle DBA ought to be able to assist. A running DataStage job is, as far as Oracle is concerned, just another client application.

There is no STR function, alas. Certainly you could do something like RPAD('', 6, '*') to generate six asterisk characters. But I don't think the second argument can be an expression. That is, you could not use RPAD('', (CHARACTER_LENGTH(InLink.ColName)), '*') Maybe that will give you some ideas, ho...

20TB x #partitions (approximately).

You're much more likely to run out of disk space than to hit this limit.

9 million records poses no problem at all, even if they're very wide records.

Is this mainframe edition of DataStage?

But not accurate.