DSXchange

Ray Based on your tip I was able to get an average row length. I modified the routine KgdEstimateDiskSpace. I plan on adding this to EtlStats so i can get megabytes per second by multiplying rows by average row length. Anyway here is the routine. * ---------------------------------------------------...

I would use a UV stage and a SQL SELECT. You can either fix the dictionary item or add one or use an EVAL.

We might of had the same problem only we were using Oracle. I had to break 2 jobs up into multiple streams which also made it run faster. ASCL could not figure it out. We did not push the issue because it runs faster. Both jobs were at about 10 million rows before they failed. I think it is a memory...

The dsjob -report XML will output row counts as a XML file. I use this in EtlStats.zip which you can download on my tips page or on ADN. This should give you an example of how to do what you want. I extract job run times, row counts and parameter values in 3 different extracts from the same XML file...

If you download EtlStats from my tips page or from ADN then all you need is to run GenHtmlJobLog and give it the job name. It will email a web page with the log in an html table. Looks real nice. Super easy. It would be easy to change this into a source query in a job and dump the log to a flat file...

Done. This will get row counts post to Oracle. Email you the row counts. Email you the logs of all jobs which failed or had warnings. You do not need to modify any sequence. You kick it off right before your sequence. MonitorSeq: * ------------------------------------------------------------ * Monit...

Hash files are covered under http://www.dsxchange.com/viewtopic.php?t=88914 I am not sure there is a similar post for sequential files.

Nice solution.

But the best way to implement this is at the end of each sequence either good end or through the exception handler then run DSJobReportDbDriver. This job will call all the jobs above. It will also calcutate your row counts and save them. It will also email you the row counts of the last run of all t...

The problem is how do you know which job failed in a sequence. Job EtlChkSeqJobsNotRun will figure out which job in a sequence failed. It will mail you the log files of all jobs that finished with other than "OK" status. * Parameters: * 1. SeqName * 2. EmailFlag * 3. CheckParentFlag - not used yet *...

GenHtmlJobLog is the job that will generate a web page with the job log information in it. Parameters: 1. EmailFlag 2. JobNameToLog 3. EmailTo 4. DebugSw EmailFlag = 1 if you want it to email you the web page as an attachment otherwise the results will be stored in "Sql2Html" folder below the projec...

I got this email. I thought I would answer it here in case someone else needed the same answer. while i was looking in your jobs, i have got a question and a requiremnt as well(like if the job aborts it won't tell you the reason, it will tell u onle 'it is aborted' in the email notification stage). ...

There is SAMPLE 1 which I have no idea if it works after an order by clause.

You want it at the start of a job then http://www.dsxchange.com/viewtopic.php? ... highlight= link will get you close.

New EtlStats.zip is posted along with updated MonitorSeq and a couple more jobs. Please download from my tips page or ADN. Rows per second and Elapsed Time are fixed. I changed the documentation from bmp files to jpg files so it loads lots faster. Sorry about that. You got to try GenHtmlFromSqlDrive...