Search found 4605 matches

by kduke
Fri Oct 13, 2006 4:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Verifying if database indices were dropped
Replies: 8
Views: 1696

You need to ask your DBA how they would check to see if an index is enabled or not. I am sure they have stored procedures for this. You need some way to call this procedure and get an answer as to yes or no they are enabled.
by kduke
Fri Oct 13, 2006 1:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: STAGECOM Data structures & Hawk
Replies: 15
Views: 3630

By the way Ken's stuff is always professional, productionalized and well documented. My free stuff is not always documented and often one off jobs so they never get productionalized. I just want to point you in the right direction and not neccessarily give you the total solution. The total solution ...
by kduke
Fri Oct 13, 2006 1:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: STAGECOM Data structures & Hawk
Replies: 15
Views: 3630

Ken

Can we still download these off your web site?
by kduke
Fri Oct 13, 2006 1:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Verifying if database indices were dropped
Replies: 8
Views: 1696

Sure you can do this but usually we create stored procedures to do this. I prefer functions that return 1 or 0. Then you select MyFunction('tablename') from dual; then write it to a hashed file. If it is a 1 then good else bad. Call a DS routine to see what this value is.
by kduke
Fri Oct 13, 2006 11:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: job performance
Replies: 9
Views: 2008

They are talking about SQL Server partitioning where you break one table up into to many tables but they still act as one. You usually want to break a table by either a reporting field or a date field or both. Some people want to partition by state or country for reporting purposes. Another way woul...
by kduke
Fri Oct 13, 2006 10:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: job performance
Replies: 9
Views: 2008

Partitioning has changed a lot in 2005. It is starting to look more like Oracle and other databases. Before that is was ugly. It is sort ugly now in the way it picks a partition. Not real flexible.
by kduke
Fri Oct 13, 2006 10:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: STAGECOM Data structures & Hawk
Replies: 15
Views: 3630

You may need to run a batch job before you run your sequences. This might be part of Ken's jobs Craig mentioned. You are probably reading the parameter values out of sequential file. This can be and should be done before a job sequence starts and not during. This is an unsupported way to load these ...
by kduke
Thu Oct 12, 2006 9:32 pm
Forum: General
Topic: Here's some Perl code for Parameter replacement
Replies: 7
Views: 4274

By the way Ken's batch processes are totally his invention as far as I know. I don't think he has used any code from me or anyone else. I think Craig actually uses Ken's jobs and methodolgy.
by kduke
Thu Oct 12, 2006 9:30 pm
Forum: General
Topic: Here's some Perl code for Parameter replacement
Replies: 7
Views: 4274

Good job. I do not like Perl. I think it is hard to read but you came up with a solution which works. Well done.

Most of us have used Universe for many years so we tend to deal with the repository tables directly with jobs or routines. This is a very clever solution. Thanks for sharing.
by kduke
Thu Oct 12, 2006 9:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Required Proj Name to a AutoSys job
Replies: 4
Views: 1554

Do not have autosys run dsjob directly. Put it in a shell script or a batch file if on Windows.
by kduke
Thu Oct 12, 2006 9:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Sequence design
Replies: 5
Views: 1812

Create a variable with the current date. Write this to a hashed file. Check this hashed file before writing to it. Make sure it is yesterday. If it is not today then run job A and write the new date to the hashed file when job A finishes.
by kduke
Thu Oct 12, 2006 4:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Allowing multiple instances when it is not necessary
Replies: 6
Views: 1961

Good point. There is not much down side. It complicates the Director listings and that is about it. I think restartability is a little more complicated but is not an issue.
by kduke
Thu Oct 12, 2006 3:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Handling KeyMgtGetNextValue() while moving machines - Post2
Replies: 13
Views: 18512

Hashed files should not be considered persistent meaning these values should be recreated every job run. Select max(surrogate_key) from dimension_table -> SDKSequences This is a job included in EtlStats called reseed_sequences. The surrogate_key is a parameter and so is the table name so the SQL loo...