Search found 4992 matches

by kcbland
Wed Mar 09, 2005 10:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Loop Conditions
Replies: 7
Views: 1928

You will need to do two passes thru the source data. The first pass will establish the highest importance code encountered for a group. You will want to write that to a hash file with a group key and the highest importance code encountered. Your job will reference the same hash file it is writing to...
by kcbland
Wed Mar 09, 2005 9:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date Arithmetic
Replies: 9
Views: 2521

This DS Function, KBAAddMonthsToDate, takes Arg1 as the date and Arg2 as the integer number of months. It assumes you want to add whole months, and will give you N months into the future. If you add 3 months to 1/1, you should get an answer of 4/1. But, if you have 1/31 and add 3 months, you should ...
by kcbland
Wed Mar 09, 2005 7:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: view read
Replies: 4
Views: 684

Smart aleck young whippersnapper.
by kcbland
Wed Mar 09, 2005 7:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash file lookup and simultaneous update
Replies: 22
Views: 6195

I don't know why you're using the UV stage. Simply use the hash file stage and map all reference columns to the output hash file. The act of using the UV stage simply hides the fact that under the covers, DataStage is reading the whole row, updating the interested column in the row in memory, then w...
by kcbland
Wed Mar 09, 2005 3:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading RT_LOG files
Replies: 2
Views: 1200

Use the "uvsh" or "dssh" (depends on your version) command line and use any of the following commands to access the arcane/cryptic raw information: LIST-ITEM RT_LOGxxx LIST RT_LOGxxx SORT-ITEM RT_LOGxxx SORT RT_LOGxxx Now, write a process to use the DS API library to extract the information you need...
by kcbland
Wed Mar 09, 2005 3:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: view read
Replies: 4
Views: 684

Convert your job to write to a parameterized output file and run 5 instances of it. Have the select statement portion the data out into 1/5th chunks, perhaps using a WHERE MOD(somekeycolumn,5) = 0,1,2,3,4 where 0 to 4 is fed as a value to each instance. Hopefully, your source database can handle you...
by kcbland
Wed Mar 09, 2005 11:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to create a sequential file?
Replies: 11
Views: 3581

Actually, Arnd is wrong, you use the CREATE command if the file does not exist. If you have all of your data in a dynamic array, you can use this logic to write the dynamic array to a file: txt = "your data you want to write out" ValidOpen = @FALSE filename = "/path/to/your/filename&q...
by kcbland
Wed Mar 09, 2005 10:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Remove Duplicates from Sequential File
Replies: 16
Views: 7323

The CRC32 is a technique that is optimally used on extremely large data sets. You've got 5000 rows, a "sort -u yourfilename > newfilename" will probably take 2 seconds. This is BY FAR the simplest and fastest solution for your volume. When you hit 50 million rows in your file, then we can talk about...
by kcbland
Tue Mar 08, 2005 8:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Remove Duplicates from Sequential File
Replies: 16
Views: 7323

By duplicate row, do you mean repeated key but different attributes or do you mean the entire row is a duplicate? If just a repeating key, is the data sorted in the order you like and you need to get either the first or last occurence of the row, or something more tricky? How much data are we talkin...
by kcbland
Mon Mar 07, 2005 8:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Phantom
Replies: 2
Views: 1295

Your job tried to write a row to a hash file with a primary key value of NULL. Phantom is the name of the process under which jobs are controlled. Basically, a phantom process manages running the job in the background after the DS engine daemon starts the job. Any unanticipated error conditions are ...
by kcbland
Sun Mar 06, 2005 11:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How delete files into drive with Job batch
Replies: 2
Views: 560

Please try to state your issue again, your wording is difficult to understand. Are you asking two questions? How to delete files? Use DOS shell commands (erase, del) using any of the methods available for executing system commands programmatically. These include before/after job/stage routine calls ...
by kcbland
Sat Mar 05, 2005 9:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Shell script
Replies: 10
Views: 4129

You can't work on a Unix system and not understand (and love) Unix. You must learn that Unix servers are NOT just a big PC. You must know how to monitor system load, see how things are running. The first thing I say to a young developer who comes to me to tell me their job/process/script is running ...
by kcbland
Sat Mar 05, 2005 9:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Oracle Numeric data type precision and scale
Replies: 2
Views: 847

Always visually inspect and correct your metadata once imported. Not having the correct scale will cause DataStage to round values. It's kind of spurious, it only re-scales the data if you manipulate the column in some fashion, such as adding columns. Sorry 'bout that.
by kcbland
Fri Mar 04, 2005 12:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "cyclic or linear dependencies"
Replies: 4
Views: 3677

The original job design would have worked if you would have temporarily landed the data in the BSID and BSIK links to files and then read them back. But, your re-design is much better.
by kcbland
Fri Mar 04, 2005 9:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "cyclic or linear dependencies"
Replies: 4
Views: 3677

You must have a stage icon that is both reading and writing to it. Try just using separate icons and your problem will go away. There must always be a starting point and ending point. The compiler can't figure out which because of the design.