DSXchange

That's because you appended rows with X+1 columns in them onto the end of rows with only X columns. If you want to keep the old rows in the file and still be able to read them in, in the reader stage scroll the Columns tab over to the right and change the value of Incomplete Columns. It defaults to ...

As long as the performance is acceptable to you - no.

... and get those DBAs to add that index over the key fields so it doesn't have to do a full table scan on every row to find the one to update.

As noted, one of your best sources of inspiration are the routines supplied with DataStage itself. The source for all of them are easily accessed in the Manager. Study them. Make copies of them and then change them to suit your own needs.

Craig -- How to increase the write cache at the project level?? If i turn off the write caching the performance is very slow. I hardly ever have write caching turned on and I can get very high speed performance from hashed file writes - provided the hashed file is properly precreated. That being sa...

Sure - stop sending update rows to it for keys that don't exist.

Seriously... hashed file lookup... existing keys... only issue an update when you get a hit on the hashed file.

2. add_to_heap() - Unable to allocate memory (Warning) This job reads from oracle and loads in to two hash files. Each hash file has around 15 million records. Once it reaches around 2 miilion records it gives this warning and the job continues. Both hash files are dynamic and write caching is enab...

Even with this, when the hiredate is NULL, I am getting the difference as 0, and not 100 as specified. Point of fact - your hiredate is not null or the check would in fact succeed. Question would be what is the source of this data - flat file, database, what? Probably better to do something more ge...

Manager - Routines / Built-In / Utilities - DSSendMailTester.

I think when the first record is processed, the stage variable (svKey) doesn't hold any value (probably NULL). Don't "think" - know what it is by explicitly setting it's Initial Value in the stage variables property box. And set it to something non-null that you know will be different than any firs...

Can't be done there.

The typical answer there would be to use the routine (via the Routine Activity stage) in a Sequencer job. The output of the routine, the dynamic filename, could then easily be passed as a parameter to a downstream job. Keep in mind that, if you try and let the sequencer 'automatically handle failure...

What kind of "routine"? If you mean stored procedure, then you can call it in the before- or after-sql tab of the OCI stage.

By entering the columns in that order.

Seconldy how can i use the macro in Job Paramater to assign value as in some cases it is very helpful. I don't believe that you can as this would seem to me to fall into the same class of problem as the "job parameter in a job parameter" one. The manual states that the various macros "can be used i...