DSXchange

What are the various parameters needed for ETL performance The first thing you need is some definition of "performance". In ETL the key performance indicator is usually the ability to meet some time window in which access to the databases in question is permissible. Nothing else really matters. For...

stiwari wrote:Thanks for the reply, Do we have any property in ODBC Stage by which i can set commit after some intervel of records.

There would be. Since it's the weekend I don't have access to DataStage, so can't tell you what the actual property name is. Do some detective work and let us know!

This one is almost certainly an indexing problem. Get exclusive access to the project then, as the administrator (dsadm or root) execute the DS.REINDEX ALL command from the Administrator client command window.

The whole point of PX is to process huge volumes. It is usually some external event, such as a kill command, that kills DataStage process. If it is an internal event, you may see a core file where that process executes.

No it's not overload. Someone has killed one of the processes (if not more) with kill -9 on the server. That's what generated the "Unexpected termination by Unix signal 9 (SIGKILL)" message. If you do that you deserve all of the problems that you get. If it was someone else, penalize them in some way.

Estimating design effort is fraught with difficulty. I don't think I (an experienced developer) would take as long to bring a project to fruition as someone new to the product. But even that does not always hold. I worked on one project where we were given some preliminary specifications by business...

DataStage does not process rejected records automatically in any way. It delivers them onto the rejects-handling output link of the stage in question. For Sequential File stage at least, the record is delivered as Raw - you can further process these rows by converting from Raw to something else, but...

I missed the fact that it's a BLOB. DataStage does not have capability to use View Data on BLOBs (or even CLOBs, unless you define them as large strings).

I agree - that would be almost impossible in PAL. Alexander's advice to use PGM is sound.

The original post by hhh specified server job, which means we are in the correct forum.

What are the permissions on the folder C:\AFL\HASH_FILE ? Particularly for the user ID that executes DataStage jobs.

It appears that the installation of the project has not been completely successful, or that someone has removed some catalog entries. Can you please count all records from the VOC whose names begin with DS, by type? SELECT "TYPE", COUNT(*) FROM VOC WHERE @ID LIKE 'DS%' GROUP BY &qu...

A parallel job is like an orchestra. There is one conductor process exerting overall control. On each processing node there is a section leader process exerting control over all the player processes (one per stage, unless combined) on that processing node. For some reason, the section leader process...

There's no problem putting as many functions as you like into one object file. The make procedure will ensure that they are all visible.
Is this library visible via your shared library search path (that is, the directories named in the LD_LIBRARY_PATH, LIBPATH or SHLIB_PATH environment variable)?

Welcome aboard. :D Basically the answer is no. DataStage is metadata driven; the metadata (column definitions) need to be in place before the job is compiled. Some people have implemented strategies to get around this, which you can read about by searching the forum. But there is nothing "out of the...