DSXchange

You'd have to be dead unlucky to hit a problem in the last two bytes of a data segment! However, DataStage pre-checks that you can allocate the entire space and, when it encounters the discrepancy, you get that message. Looks like it's not allowing for some kind of two-byte "magic number" in the seg...

On a point though - would it make sense for DS to manage its own users and groups? Whatever you decide must work on Windows platforms too! On Windows platforms user and group management is quite different, for example domain\user , machine\user and user may or may not all exist. FYI, project names ...

I would be reluctant to advise anyone to move straight from development to production; I would always advocate an interim Test/UA/QA environment. For each environment (development, test/UA/QA and production) you require a DataStage project. Have you created these, and created in them any settings yo...

I have seen similar messages resulting from the LANG environment variable not being set correctly. Chances are that Oracle has its own LANG environment variable and that the two must agree.

Did you search for "filter" and/or "sequential"?

This post, particularly the second last entry, may help.

One configuration node is capable of 200 million rows. You didn't specify what the time window requirement was, but even with one configuration node (or, indeed, one server job), you should be able to get through this amount of data in a single-digit number of hours. The actual time would, of course...

Routines don't have an exit status (unless they call DSLogFatal, but then they don't really exit). I suspect that the "activities that finish with status" hasn't been properly thought through for what it means in respect of Routine Activities; obviously it makes sense for Job and Command Activities....

You can extract one from a database table, where the column contains a NULL. The concept of null is irrelevant to text files. It is mainly text files that you pass using FTP. Therefore, you can decide any convention you like for passing null values. In general there are two strategies. Choose some s...

It defines a string with which NULL is represented in the data stream to be transferred via FTP. For example, the remote file might represent NULL as the string "<NULL>".

Can you be more precise about the actual version number of DataStage for this question please?

DIY, including staging of data at intermediate points (after extraction and before loading at the very least), with recording of how far you successfully reached. There's limited "restart" capability in Job Sequences in 7.1, basically checkpoints and skip jobs that were successful on the last run (u...

Technically it's not possible in a before-stage subroutine because the first row in a stream has not been processed when the before-stage subroutine is executed. Do you mean null in every row, null in any row, null in the first row? How is NULL represented in this particular text file. A zero-length...

DataStage is an ETL tool. Extraction, transformation and load. You could design jobs that extract data from tables and move them elsewhere, with or without transformation, but archiving (and retrieval from archive) are not really the main intended purpose. Most database products have their own archi...

Not only can, but should.

This is serious. DS_JOBOBJECTS is, as you're finding out, THE critical table for design time information. You can use UVFIXFILE from the command prompt, or fixtool or uvfixfile from the operating system prompt, to trace the file to report whether there is, indeed any internal corruption. If there is...