Search found 4992 matches

by kcbland
Thu Mar 02, 2006 3:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: job name length
Replies: 3
Views: 1226

No, back before version 6 it was a bad idea to have really long job and stage names. I seem to remember 40 was about the maximum before DS internally started truncating things.
by kcbland
Thu Mar 02, 2006 1:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Slowness is kicking off jobs
Replies: 9
Views: 2928

If your before-routine is using "openseq" commands on a common sequential file, they will LOCK each other out. Consider passive reads such as calling DSExecute to "type" the file into screen output return variables. I'd bet a box of donuts your jobs are locking each other out. OPENSEQ will obtain an...
by kcbland
Thu Mar 02, 2006 12:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Slowness is kicking off jobs
Replies: 9
Views: 2928

How do you determine if the job is "running"? What is the status of the job in Director? Are there stages that say "Starting" in the Monitor that contain SQL? Are there before-job routines that are executing? What's in the logs of the jobs? Have you check the DS server to see what processes are curr...
by kcbland
Thu Mar 02, 2006 9:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSD.SEQOpen Failed
Replies: 4
Views: 1349

Also, would the suggested change apply to the use of hash files? It's very common for me to see jobs in which a hash file is populated in the same job in which it is referenced. Hashed files are not the same as sequential files in these regards. It's perfectly fine to read and write to the same fil...
by kcbland
Tue Feb 28, 2006 7:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clear Status File
Replies: 6
Views: 1005

Re: Automating the process and not a manual clear status fil

this process has to be automated. What do they mean by automated? How about the compiler wizard in DS Manager? That would do the trick. How about the free Batch job on my site that compiles jobs and routines? That would show you the logic you need. Those same jobs have their logic posted on this si...
by kcbland
Tue Feb 28, 2006 4:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dividing '-20' by '-10' gives me 2, as i needed '-2'
Replies: 7
Views: 1015

Per the user's requirement, the polarity of the percentage doesn't matter:

Code: Select all

If Divisor = 0 Then 0 Else Dividend/ABS(Divisor)
by kcbland
Tue Feb 28, 2006 3:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dividing '-20' by '-10' gives me 2, as i needed '-2'
Replies: 7
Views: 1015

You get 2 because the laws of mathematics dictates that is the answer. Two negative numbers multiplied together always produce a positive, and division is the same.

If you don't like your answer, just multiply by -1 whenever you need to change polarity.
by kcbland
Tue Feb 28, 2006 1:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: passing parameter to a select query
Replies: 4
Views: 1060

I never wrote a looping Sequencer that passes the loop argument to jobs as a variable. I'm sure others have written one. In a Batch job, it's a piece of cake. In pseudo code: For i=1 to 40 ...Call DSAttachJob... ...Call DSSetParam(jobhandle, parameter name, i) ...Call DSRunJob... ...Call DSW...
by kcbland
Tue Feb 28, 2006 9:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: passing parameter to a select query
Replies: 4
Views: 1060

Batch job control with a loop, or a Sequencer with a loop. Both feed the appropriate parameters to controlled jobs.
by kcbland
Tue Feb 28, 2006 9:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fundamentals of Basics Routines
Replies: 21
Views: 5659

Let's all remember that premium content answers are not visible to everyone, and therefore, some non-premium folks may answer something similar to a premium content answer without knowing it. :wink:
by kcbland
Mon Feb 27, 2006 10:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cleanse/Confirm Question ?
Replies: 25
Views: 5979

You're on the right track. My company wrote a data cleansing function library to use an external table of data quality rules that is called from DS. It's a lot like you've suggested. The basic idea I would recommend is to not call a function on every column in every row, but rather develop a stand-a...
by kcbland
Mon Feb 27, 2006 10:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error when writing records to hash file
Replies: 13
Views: 3155

Chances are the job aborts and you're just getting a message from the CLI driver about it terminating. The root cause I'm guessing is the hash file size exceeded 2.2GB.
by kcbland
Mon Feb 27, 2006 9:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error when writing records to hash file
Replies: 2
Views: 774

This is a duplicate post.
by kcbland
Mon Feb 27, 2006 9:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error when writing records to hash file
Replies: 13
Views: 3155

My guess is that you blew thru the 2.2GB hash limit on the 32BIT hash file and the job aborted. Consider creating the file as a 64BIT file.