DSXchange

What is the relationship between the two files/datasets? Are you matching on order number? Your example isn't quite clear.

ODBC

One of the difficulties is how the ETL is going to be used. One good practice for ETL in a data warehouse of small volume and large processing window won't apply to a high volume and small processing window. You may have to factor in staff competency and ability to maintain the code. If your source ...

Your post sheds more light. Once jobs are done the STOP button doesn't really work anymore while 3rd party external processing are running. So, if you're doing Routine calls to go out and run shell scripts, connect to databases via command line, etc, you're in a blackout zone. Until those commands r...

Is this problem only on one PC? If so, it's probably a Windoze issue. You should consider a re-isntall of the DS Client.

Rather than hanging could it be writing out its write-delayed hashed files? As for killing/stopping jobs, the Director STOP button is the first best recommendation. Usually a Task Manager kill is the second last thing to do, right before a server reboot. Try the STOP button, try the Cleanup Resource...

Please don't post with a color of pink. I could not read your post clearly.

Cleanup Resources is only valid if there are active threads on the job. If you try to cleanup a job that has finished, what would be there to cleanup/logout?

Make sure there isn't an active thread still running, like a zombie. Of course, rebooting the server is like a Microsoft solution but it just may be the easiest.

Keep it simple. Always use DYNAMIC, for tuning, pretty much setting a minimum modulus should be about it. Don't overcalculate it, just simply set it high enough to keep from dynamically resizing. A modulus of 200K is a 400M DATA file, 300K is 600M, 400K is 800M, get the pattern? Just size higher tha...

How are you calling the SP? In before/after-SQL tab or as the SQL query? Has this job previously worked and is it now failing?

Does your procedure return any rows to DataStage?

TX is the old Mercator product, used for realtime processing. EE is the former Orchestrate product, now deeply ingrained as the parallel processing framework for all future processing in the larger tool suite.

Unless, of course, you install a full DataStage Engine on every machine. Talk to your account rep - they'd LOVE to hear from you ($$$$$$). Only on each SMP machine in the cluster - the MPP are out of consideration. I doubt anyone will pay to license a DS Engine on every phyiscal machine in the SMP ...

Partitioned Parallelism and either a mixed MPP and SMP environment or clustered environment won't work with DS BASIC Transformers. Then DS BASIC Transformer is only available on the one SMP server running the DS Engine.

I'm absolutely correct in my original statement. There are NO executables generated by Server or PX. The RT_CONFIG has no executable or near-executable stored in it. Jobs are generated subroutines or linked objects called by a third party - either DSD.RUN or the osh interpreter.