DSXchange

Please mark thread as Resolved using green button at top.

Columns have a drop on import property available.

rumu wrote:Still,Sparse lookup is expensive since it executes the SQL qry for each incoming row....

That depends on your Array Size setting.

You have NLS enabled so the Sequential File stage is expecting the first byte of the file to indicate whether byte order is Big-Endian or Little-Endian. There's probably a property in the stage where this can be disabled.

Only from IBM as far as I am aware. But, then, I'm not in the USA.

Your "problem" is with stage Sequential_File_188 - is the file empty? Does this stage have a reject link?

Everything is an option. Don't be tied down by what are only guidelines. Be prepared to think about the actual mechanism to make these decisions. For example, if the OP has vast amounts of memory available, then a normal lookup may even be possible. 15 million short rows is not such a great burden.

Why would you create a parallel job to process a single row?

Since parallel jobs move data in chunks of not less than 32KiB, and typically much larger slabs (128KiB, 1MiB or 3MiB), why would you use a parallel job to process less then 32KiB of data?

Since 0000-00-00 is not a valid date, the StringToTimestamp() throws an exception. Handle it as an ordinary string in the If..Then..Else construct, and handle the conversion in the Else clause.

Most database tables have an index on the primary key. If this is the case then sparse lookups will perform reasonably well if the database server is on the same machine as the DataStage server.

Welcome aboard.
1. You need to interrogate the "interim status".
2. A long time ago I posted a routine called OpenSequentialFile which shows, among other things, how to position to end-of-file using SEEK statement.

In the Manager client you can select any object (for example a table definition) and elect to perform a Usage Analysis (which is effectively an impact analysis) - it will retrieve every job that uses that object (for example table definition) and provide detailed information about where it's used in...

Well it's easy to isolate where the blame needs to be placed, isn't it? You have to make sure that softricity installs ALL required files. Compare a manually installed client with a softricify installed client machine.

dougcl wrote:... starting today ...

What's changed since the day beore today?

"Nothing" is clearly not the correct answer.