DSXchange

Download EtlStats from my tips page. It has several seqeunces in it. You can get and example of how to do it. All you need is one exception handler. It will only execute when a job aborts though. You do not need to link to it except if you want warnings to go to it too. The going theory is to elimin...

I am confused. How can you start 32 jobs without 32 stages?

clarity (lack of obfuscation) Perfectly clear Professor Ray man. Definitely a good point. Documentation of any kind adds value. Either a project is over documented and nothing gets done. Usually this is done by one of the big accounting firms pretending to be consultants. Or the other situation is ...

This has been talked about a lot. Do a search for exception handler.

Check out http://www.dsxchange.com/viewtopic.php?t=93464

This usually means your machine was too busy to start another job.

I think you need to gather stats. What is your average number of stages? What is your average number of columns per stage? What is the most used stage types? All concepts like simple, medium and complex should be based on stats like average and standard deviation. We had lengthly discussion about th...

Just a few PX jobs running can kill the performance of any machine. So look at what is running. We had hung processes which had been running for days and CPU was at 100% without any real jobs running. When we killed all of these processes and rebooted then performance was awesome. I would reboot a D...

When you exceed cache size while writing to a hash file then it will write a warning into the log file and start writing to disk and no longer use cache. The rows per second slows way down. Reading is the same. It will never cache the file if it is larger than cache size. If you can delete some colu...

There are some bugs in EVAL especially in GROUP BY clauses. You have to play around with it to get it to work. If you delete a column then make sure you delete it in the group by. The error messages are not very useful and in fact misleading when you are playing around with the respository files.

Thanks Ray. DsWebMon lets you monitor jobs from a web page. There are 2 jobs in EtlStats which will generate a web page from any SQL statement against an ODBC source. I am sure you could overwrite the same page all the time to show jobs stats like jobs that just finished. EtlStats is free and stores...

This works for me. I am not sure what is the difference between what you are doing and what we do but I expect something is set differently.

You need to check this before you run the job either in a routine or in batch job. You can open the file and use STATUS command to see how old it is or use a DOS or UNIX command like DIR or ls -l.

He has no life like the rest of the top posters.

When you go for ""Reset if required, then run" this option , when there is an abort even the checkpoint will be erased. This is not true. We do this all the time. It should only run the jobs which have not run or aborted when you restart a sequence. This works fine. We use it in all our sequences. ...