Search found 4605 matches

by kduke
Wed Dec 13, 2006 8:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job Statistics
Replies: 8
Views: 4119

I have several jobs in EtlStats which create this kind of metadata in a target table. Try to run these jobs. You will be amazed on how much good use you can make out of these types of tables. The Reporting Assistant cannot report on sequences or PX jobs. You can create your own metadata this way and...
by kduke
Wed Dec 13, 2006 8:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job Statistics
Replies: 8
Views: 4119

If you take the previous query then you could create your own metadata. Now create a job and output the above to a table like:

Code: Select all

Create Table MdSequenceJobs (
   SequenceJobName   varchar(60),
   LinkName          varchar(60),
   DependJobName     varchar(60)
)
by kduke
Wed Dec 13, 2006 8:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job Statistics
Replies: 8
Views: 4119

Thanks for all the nice words but please I do not normally answer emails. If you create this dictionary item then you can report or extract the jobs from a sequence. INSERT INTO DICT DS_JOBOBJECTS ( FIELD, CODE, EXP, NAME, FORMAT, SM ) VALUES ( 'JobActJobName', 'D', '12', 'JobActJobName'...
by kduke
Wed Dec 13, 2006 7:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML file with multiple repetitive columns
Replies: 6
Views: 2397

Welcome Ernie. An IBMer awesome.
by kduke
Wed Dec 13, 2006 7:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clear Log of Multiple Instance jobs
Replies: 8
Views: 2290

I would turn on the automatic clearing of logs after 3 runs instead of days or something like that. That will help. I posted a SQL statement which will delete RT_STATUSnnn records using instance id. Search for this post. I will post the link if you cannot find it. I know Director slows down a lot wh...
by kduke
Wed Dec 13, 2006 7:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSJobReportDb
Replies: 9
Views: 1527

I wish they would buy something but no matter. I think every site needs integrated ETL stats. This is important to performance tuning and managing your ETL. Some of the simple metadata is also very powerful to report against. This is just the bare minimum you may need. IBM must agree because a lot m...
by kduke
Tue Dec 12, 2006 8:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSJobReportDb
Replies: 9
Views: 1527

Geez, Ray. Everyone needs this job. Pretty useful job.
by kduke
Tue Dec 12, 2006 8:08 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSJobReportDb
Replies: 9
Views: 1527

DSJobReportDbDriver runs DSJobReportDb over and over for evey job in the sequence. You have source code so you can see how I did it.
by kduke
Tue Dec 12, 2006 6:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HowTo parametrize dataset?
Replies: 12
Views: 4233

Parameters are stored in 2 places. I have thought about this too. Lists are stored I think with tabs between each value. I would have to dig into the code to be sure. DS_JOBOBJECTS stores the first set of values. You would have to understand a lot about the DataStage engine to update these values. T...
by kduke
Mon Dec 11, 2006 9:53 pm
Forum: General
Topic: Running batch file from DS job
Replies: 11
Views: 6106

I got an idea, XCOPY sucks. You found a bug.
by kduke
Mon Dec 11, 2006 9:45 pm
Forum: General
Topic: Automatic Job Generator - does one exist??
Replies: 39
Views: 18825

If it is not a lot of work then I will post the solution or email back to you.
by kduke
Sun Dec 10, 2006 7:52 am
Forum: Site/Forum
Topic: Great Sixer!!!
Replies: 12
Views: 5137

Thanks Arnd.
by kduke
Sat Dec 09, 2006 7:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: regaring universe
Replies: 14
Views: 4676

Reverse engineering implies replacing this product with another product. Is that what you intend to do?

We use these methods to only better understand our ETL designs. We actually like DataStage and just want to be better DataStage developers.
by kduke
Fri Dec 08, 2006 10:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: regaring universe
Replies: 14
Views: 4676

Post removed per Ray's post below.
by kduke
Fri Dec 08, 2006 10:16 pm
Forum: General
Topic: Automatic Job Generator - does one exist??
Replies: 39
Views: 18825

I am assuming you are doing straight table copies. Send sample jobs you want to use as a prototype. I should bill you for it but I want to see if it would be a lot of work first. So mail it to Kim_G_Duke@hotmail.com I will let you know how much work is involved. I will post my answer if you like. Se...