DSXchange

The issue might be the spaces in "Documents and Settings". Try replacing that with "DOCUMEN~1". Try also leaving off the drive letter so that a UNIX pathname is formed:

Are you really expecting messages larger than this?

You need two passes through the data - just like you would in SQL (an outer query and an inner query). In the parallel world that will involve two jobs, since blocking operations are not permitted. The first job gets the average salary - probably using an Aggregator stage - and stores that somewhere...

That is true, however the underlying operating system in the engine may impose a limit on the amount of memory that is available and/or on the maximum width of a line in a file, either of which could thwart your evil plan to process 20,000 columns.

mail2hfz wrote:I am able to get this done with seperate lookups. Would like to know if any other way I can achieve it.

No. According to your explanation each word/token must be looked up individually.

Fully booked through at least November 2011 (see my website).

Please reveal your sequence design - in particular does it have an EndLoop as well as a StartLoop?

Welcome aboard. If you have Cognos 8.4 you don't need anything else.

What is the delimiter of your "list of things" list in the StartLoop activity, and how did you get this delimiter into your list?

Had you thought to Search DSXchange you would have had your answer by now. The output of the command includes a newline character that has been translated into a field mark character - you need either to trim that off or use a dynamic array reference or Field() function to extract the first field.

rubik wrote:My understanding is that DataStage is a 32bit app and therefore will only be able to use up to 2Gb of memory.

This is not the case on 64-bit AIX systems (such as version 6.1). I'm not sure what the bittage of version 5.3 is. Another thing you might look at is the setting of LDR_CNTRL.

Let's nail that last point before seeking a solution. Why does "A B C D E F" match "A B C * * *" and not match "A _ _ * * *"? Assuming there is a small number of patterns, I'd be using stage variables to determine the matches (one variable for each pattern with a six-wa...

If you want this in one go, you can use file pattern in your sequential file stage. No you can't - it's a server job. However - assuming the files all have the same structure (metadata) you could include a Filter command in your Sequential File stage that concatenates all the files into a single st...

Alas, it is not easy in a parallel job, since you don't have direct access to the DataStage API - and, I believe, the C-callable API does not include the DSSetUserStatus() function in any case.

Any reason not to use a hierarchy of sequences, where it would be a lot easier to handle failure detection? To continue with your current approach you need to emplace a method of aborting the caller (which is anathema to me). One way would be to constrain the first output of the Transformer stage ba...