DSXchange

All this changes based on what you are populating. Is it a datamart, data warehouse, ODS or whatever? How complex is it? What are the sources? How much profiling have you done? How clean is the source data?

The dsjob command can output these in XML format. Do a search for dsjob.

There is a known bug in older versions of DataStage where this does not work. Let us know your version.

I think the starting point would be to know or track the success or failure of every job. Next you need to check this success or failure and not rerun something that has already run successfully.

I posted a training flash video which shows how to install EtlStats. That might help you some. My tips page also has a few SQL statements which might help.

I think several of us have posted routines which use blat.exe. Might save you some time to search for those posts.

It deletes them all. You need to write something more complicated to do that. That is why I did not recommend it. It points out what to delete. You need to add more logic to figure out if a instance id is still running. I would say you want to delete old ones. Turn the Delete statements into Selects...

I gave you the code. Run it.

There are several jobs in EtlStats which can extract this information and report on it or load it into a table.

Ray knows that writing that routine is not simple especially when you need the information on the client. I have given away a part of DwNav called Dwn_ExecTCL.exe. This could easily get a list jobs in a category. It writes results into a log file. You would still need to clean up the results.

There is no command line tool for getting jobs in a category. I have scripted exporting all job, one at a time to its own dsx file. You need a combination.

Is any of this in our future? Can we get input into some of these products?

data lineage ought to show (IMHO) everything that "really" is happening within the infrastructure....incuding that Pivot you needed in order to get access to the Revenue figures, and the trims or substrings you needed to derive codes that controlled certain if/then/else logic. Ernie I disagree. I t...

You can extract it using the Reporting Assistant. It would take me a while to hack a solution otherwise. How bad you need it?

Wow, I get credit even without answering. Thanks.