Search found 4992 matches

by kcbland
Mon Dec 20, 2004 8:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a DataStage Basic Program be run from Unix shell
Replies: 10
Views: 3593

Oh, and to run a program from the command line you have execute using the uvsh or dssh program. Something like "dssh YourCatalogedProgram" from the directory of the project in which it is compiled and cataloged.
by kcbland
Mon Dec 20, 2004 8:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can a DataStage Basic Program be run from Unix shell
Replies: 10
Views: 3593

All jobs or programs execute on the server side, your client is irrelevant. To create a DS BASIC program, you're going to have to learn how to develop DS BASIC programs. I suggest you head over to IBMs website and download the Universe manuals, as DS BASIC is a derivative of Universe. You'll have to...
by kcbland
Sun Dec 19, 2004 11:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Duducting Some Minutes from a TIMESTAMP field
Replies: 3
Views: 841

You'll have to write your own. You may want to look here:
http://www.dsxchange.com/viewtopic.php?t=85788
to get a headstart. This function subtracts two timestamps. You basically have to subtract minutes and deal with rolling under hours and potentially days. Write a good function and post it for all to share! :D
by kcbland
Sun Dec 19, 2004 9:42 pm
Forum: Data Integration
Topic: about drill concept
Replies: 1
Views: 1649

This is a 101 analytical processing question. Just like your previous post "What is metadata", it seems to be a question one would find on a technical job interview. I'd suggest you read Ralph Kimballs DataWarehouse Lifecycle Toolkit. It will guide you in the 1000 other questions that will follow. I...
by kcbland
Thu Dec 16, 2004 5:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can SSELECT command be used in the "Hashed File" S
Replies: 19
Views: 4800

The SELECT statement is not available on externally pathed hash files, you must use a project-based hash file. So, externally pathed hash files have to have a VOC entry in the project (search forum for SETFILE), and you no longer use the fully qualified path in the front tab of the hash file stage, ...
by kcbland
Wed Dec 15, 2004 6:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal termination of the jobs
Replies: 3
Views: 1164

Tell us what stages are in the job doing what, we have no clue where to begin.
by kcbland
Wed Dec 15, 2004 12:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash file size
Replies: 6
Views: 3392

20 million rows, how many average characters per row? If each row is 100 characters, then you need o store 20 X 100 million characters, which I would guess exceeds 2.2 gigabytes. So, you need to do a little "data profiling" and figure out if your average row will keep you in 32-bit sizing or send to...
by kcbland
Tue Dec 14, 2004 11:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to abort a job in a routine if the source file is empty?
Replies: 8
Views: 1926

Why not write a before/after routine that uses Unix commands? In the routine, you can use the DSExecute API (search the forum for LOADS of examples) to execute a shell command. You can do heads and tails and lots of stuff that will return the screen output in a variable, then look at the variable an...
by kcbland
Tue Dec 14, 2004 11:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Write failed on hash file
Replies: 3
Views: 915

Also, all links MUST have the hash filename defined and have the exact same metadata. If you have one link clearing the hash file, it must be the link that always gets the first row. Depending on how your constraints are discriminating, link ordering may not be enough as the first output link may no...
by kcbland
Tue Dec 14, 2004 12:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: (DSOpenJob) Cannot get shared access to executable file for
Replies: 6
Views: 2181

I commonly use this technique on varying jobs designs, some just OCI-->XFM-->SEQ others really complex w/ lots of hash lookups. I regularly have designs with 10-20 instances of the same job. I've seen your error only when the number of instances have vastly overwhelmed the system resources. Say, 20 ...
by kcbland
Mon Dec 13, 2004 1:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Null columns
Replies: 2
Views: 484

NULL is not the same as spaces. ISNULL is used to detect for the null condition, but to check for spaces requires that you do a string comparison. If you want to trim for spaces and then check for blank and also deal with the null condition, use the following statement: NOT(ISNULL(link.colum...
by kcbland
Fri Dec 10, 2004 1:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage repository behind the scenes.
Replies: 2
Views: 1238

It's a code branch of IBMs Universe product. Check it out.
by kcbland
Thu Dec 09, 2004 10:56 pm
Forum: Enhancement Wish List
Topic: Cancel button on Data Browser
Replies: 1
Views: 1503

I hate a malformed file definition where the delimiter is wrong or it's a DOS file on a unix box. Grrrrr. Over dialup on a large file, you wait a long time for that whole file to network to you just to get an unusable viewing.
by kcbland
Thu Dec 09, 2004 10:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Merging Multiple Hash Files
Replies: 5
Views: 1346

Dump each copy of hash file to a text file HASH --> SEQ and look at the file contents. You need to look at the jobs that write the hash files, that metadata is the metadata of record. As Vincent guesses (and his guesses are better than some peoples facts) your metadata is bound to be wrong in one of...
by kcbland
Thu Dec 09, 2004 12:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: date dimension problem
Replies: 2
Views: 837

Your problem is your code is unreadable. Name your links! Also, you include stage variables with no informatin about how they are derived. What's the result you're getting, and what were you expecting? Did you run a few different test cases and figure out if anything is working? How about posting yo...