Search found 4605 matches

by kduke
Thu Oct 02, 2008 4:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Insurance Datawarehouse Model
Replies: 5
Views: 3235

You have at least a couple fact tables to worry about. I would say premiums and claims would be the first fact tables. If you can get with underwriting and figure out how they rate then your fact tables need to track the data elements to validate the rating formulas. I would say some dimension would...
by kduke
Tue Sep 30, 2008 4:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Black Magic
Replies: 18
Views: 4500

Maybe you are running out of connections on the database.
by kduke
Mon Sep 29, 2008 9:09 pm
Forum: General
Topic: Migrating DataStage resources...a sort of poll
Replies: 20
Views: 6344

Ernie We have a DataStage admin team. We scripted a solution using DOS batch files which do almost all of what VC does. You create a list of jobs to migrate. These are stored in a folder with the same name as the project. You edit one batch file to pick the command line options of from and to server...
by kduke
Fri Sep 26, 2008 6:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Output Stage -
Replies: 8
Views: 3814

You are welcome.
by kduke
Fri Sep 26, 2008 6:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Getting Handle of Job Controller
Replies: 6
Views: 2483

Rolling your own is complicated. You need to store when a job finishes successfully either in a table, sequential file or maybe a hashed file. You need to compare this last completion to the start of the current run even if this run has been stopped. If you run once a day then you can compare to tod...
by kduke
Fri Sep 26, 2008 6:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: values are combined in repetitive tags of xml output
Replies: 8
Views: 1838

Used to be a bug in that DataStage could not process 2 repeating groups in one stage. You should be able create a lookup out of one repeating group from the other to combine them.
by kduke
Fri Sep 26, 2008 6:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP
Replies: 7
Views: 1676

RCP can make a job a lot more readable. If you use shared containers then you can feed in only the columns needed. Lot less columns mean less mistakes, cleaner more readable design. Metadata management within DataStage is one of the weakess parts of the product. I do not consider this more valuable ...
by kduke
Wed Sep 24, 2008 7:50 pm
Forum: General
Topic: Work Load Scheduler for DataStage - Information request
Replies: 2
Views: 903

If you are talking about load balancing then you need to measure the load on the system during your ETL job runs. EtlStats will get you part the way there. You still need to know the load on the system. Are you paging? Are you waiting on disk IO? What jobs are running during peak load times on the s...
by kduke
Tue Sep 23, 2008 8:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Scheduling DataStage Sequences with Zeke
Replies: 3
Views: 2752

We use Zeke on our mainframes and Zena on our UNIX servers with DataStage. We have a shell script we call datastage_wrapper.ksh which runs our jobs. If you are part of a BlueCross then we might be able to share ours otherwise I doubt it. Most of us have many hours invested in these scripts. Ours is ...
by kduke
Sat Sep 13, 2008 11:56 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: set read only jobs to not read only
Replies: 7
Views: 2312

I think some are set in the ROOT record in DS_JOBOBJECTS as well. Update statement looks similar.
by kduke
Thu Sep 04, 2008 8:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Find the "Last_Run_Time" and insert it in a table
Replies: 10
Views: 2327

Search for EtlStats.
by kduke
Fri Aug 29, 2008 11:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: reset job from command prompt
Replies: 4
Views: 1539

You probably need a -wait option to wait on the reset to finish as well.
by kduke
Fri Aug 29, 2008 11:15 pm
Forum: General
Topic: Generate Report Format
Replies: 1
Views: 1382

Edit the generated html.
by kduke
Tue Aug 26, 2008 8:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Shelll Script for row count
Replies: 16
Views: 4217

EtlGetRowCountsFromLog is designed to get row counts from the log files for previous job runs. It works like DSJobReportDb in where it writes the results.