Search found 4992 matches

by kcbland
Mon Oct 18, 2004 12:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Complex Routine
Replies: 2
Views: 775

Spend some time reading this forum. There's a wealth of posts, and thousands of examples. Instead of asking for the short course, enjoy the fruits of hundreds of hours of our time spent reading and responding to questors.
by kcbland
Mon Oct 18, 2004 11:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date Validation
Replies: 6
Views: 1194

Sure, use a lot of stage variables. So much for reusability, modularity, etc. You'll have to copy that logic to all jobs who need to use it. Also, it will be realllllly easy to debug a function and then use it in a job.
by kcbland
Mon Oct 18, 2004 11:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Different nodes for different projects
Replies: 5
Views: 1687

You can budget resources via the node pools. If you wish a job to use a different node pool than another, then supply that to the job. If you wish to segregate along project lines, then use the same node pool for all jobs in a given project.
by kcbland
Mon Oct 18, 2004 11:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Complex Jobs
Replies: 2
Views: 658

A complex job is one which has multiple inputs and multiple targets and has a bunch of moving parts. It's a job that may involve sophicated custom lookups and utilizes a custom library of functions. This is opposed to a "simple" job, one which either simply writes data from a table to a file, or a f...
by kcbland
Mon Oct 18, 2004 11:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date Validation
Replies: 6
Views: 1194

Here's the post of date difference calculation I mentioned m But, you need to do date math. Since you're going to use whole months, your math is easy. I'm not going to write the logic for you, but, if you need to subtract 5 years from a date, simply subtract 5 years from the year portion of a date a...
by kcbland
Mon Oct 18, 2004 10:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date Validation
Replies: 6
Views: 1194

You need to clarify what a "month" means. If subtracting two dates, you can get the difference in days, but this doesn't mean months. Your problem is you're using a bad calculation in 1825 days, as it doesn't take individual months into consideration, or leap years. If you take 2004-04-16 and 2004-0...
by kcbland
Wed Oct 13, 2004 2:39 pm
Forum: Data Integration
Topic: DOS job
Replies: 1
Views: 1617

Search this forum for dsjob, it's the command line program for launching DS jobs.
by kcbland
Wed Oct 13, 2004 1:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Memory Usage by data stage server
Replies: 6
Views: 2562

As far as memory leaks, etc, the memory usage could be related to massive write-delay paging that was setup on the server. As far as DataStage is concerned, unless there's a bug, its memory requirements are rather small. Even hash files have read/write caching size limits. I would start with the ide...
by kcbland
Wed Oct 13, 2004 1:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Working with holidays and not working days
Replies: 4
Views: 864

Build a Time dimension table as Kimball recommends. Have a column that is BusinessDayIndicator and set it to 1 on all appropriate days. For days that are holidays you'll want a holiday indicator as well. Add another column to contain the integer number of business days since days 1. Call it somethin...
by kcbland
Wed Oct 13, 2004 12:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Working with holidays and not working days
Replies: 4
Views: 864

Business days differential is really easy to do. When you setup your time dimension, you have to have a column that is the total number of business days since day #1. For example, your first date in the time dimension has the value 1. The next business day has the value 2. Keep assigning the value a...
by kcbland
Wed Oct 13, 2004 7:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dynamic Hash File showing up as multiple small files in OS
Replies: 1
Views: 940

Somehow you're probably missing the ".Type30" file, probably from doing a manual creation of directories as opposed to "mkdbfile" statement or the "CREATE.FILE" statement. Because of that, the hash file reverts to a type 1 which means every row of data is a separate file within the hash file directo...
by kcbland
Tue Oct 12, 2004 10:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Renaming a file on the server with datestamp
Replies: 3
Views: 994

Just shell out and issue the rename command: NTcmd = "ren ":oldfile:" ":newfile Call DSExecute("NT", NTcmd, ScreenOutput, ReturnCode) Call DSLogInfo("Command [":NTcmd:"]" returned [":ReturnCode:"] and screen output was ":Sc...
by kcbland
Tue Oct 12, 2004 9:32 am
Forum: Enhancement Wish List
Topic: DataStage Restricted Mode
Replies: 11
Views: 5582

DSXchange commandment #7: Thou shalt fill out all of the fields when posting a question, so that responders can give specific answers to thine own platforms. Since most DS installs are on Unix, I gave you a reasonable response. You can handle access via the DS Administrator route as I suggested for ...
by kcbland
Mon Oct 11, 2004 2:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look for available number - routine question
Replies: 22
Views: 7529

Your solution is going to be very slow, I hope your volumes are low.
by kcbland
Mon Oct 11, 2004 1:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: job Parameters for Sequencer Jobs
Replies: 16
Views: 7595

Also consider the scalability of a RoutineActivity stage per job parameter. If you have 20+ parameters in a job (paths, credentials, dates, etc), then this becomes an nasty job.