Search found 15603 matches

by ArndW
Tue May 29, 2007 6:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: why hashed file is prefered to sequential file
Replies: 5
Views: 939

dvpawankumar - there are so many contexts that just using our own wouldn't make sense. Generally, hashed files are preferred over sequential files when you need to access the records randomly for reading. Hashed files are analogous to database tables for this example, so just think of reasons why yo...
by ArndW
Tue May 29, 2007 6:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: executing a bunch of SQL Statements
Replies: 7
Views: 1569

mystuff - could you post the SQL that is causing the error message you listed?
by ArndW
Tue May 29, 2007 6:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Automating Job Exports
Replies: 2
Views: 663

you can trigger an export from your client PC using "dscmdexport", and you can add that call to your PC's scheduling tool (probably AT)
by ArndW
Mon May 28, 2007 10:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Jobs getting unscheduled.
Replies: 7
Views: 2484

What do you mean by "getting automatically unscheduled"? Does this happen immediately, or after a couple of executions or days? Since DataStage doesn't have its own scheduler you are probably using cron on your system - have you looked at the cron tabs or checked to see if someone is modifying thing...
by ArndW
Fri Apr 27, 2007 5:28 pm
Forum: General
Topic: Storage calculation
Replies: 2
Views: 1163

The amount of storage required depends upon several factors, starting with the amount of data you have and then depending upon what you are doing with this data - if you pass the data through and just do transformations the amount of temp storage can be as small as 0. If you store all your data in i...
by ArndW
Tue Apr 17, 2007 7:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash file not populating
Replies: 7
Views: 1722

When the hashed file was not populated, how many rows went from the OCI stage to the hashed file? If "0" then you need to look at your database and SELECT statement.
by ArndW
Tue Apr 17, 2007 6:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Tuning a routine
Replies: 4
Views: 1216

This routine and job use inordinate amounts of CPU time to perform a relatively simple action. I would recommend re-writing it from scratch using somewhat different logic. Pseudocode recommendation: Loop execute shell to return "exists(control file)" true or false IF not(exists...
by ArndW
Mon Apr 16, 2007 6:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SMP to MPP Systems
Replies: 3
Views: 1207

How jobs are run using Enterprise Edition depends upon how the configuration files are set up. Unless you configure specifically for distributed processing jobs written on a SMP box but run on another system and using the same configuration files will run just the same way.
by ArndW
Mon Apr 16, 2007 6:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ORA-01830 understandable
Replies: 5
Views: 2678

What happens when you run this from your favorite query tool? Does it return a (correct) result or the same error?
by ArndW
Mon Apr 16, 2007 5:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS EE 7.5 : Migration from DS Server 3.0
Replies: 7
Views: 1863

Yoga, it seems that you are actually talking about 2 distinct migrations here, a) Migrating from DataStage V3.x server to DataStage 7.5.x server b) Converting from Server jobs to Parallel jobs. Step (a) might not be as difficult as you assume, whereas step (b) is going to be time-consuming. There is...
by ArndW
Fri Apr 13, 2007 6:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Read And Wirte the same named pipe in different jobs
Replies: 5
Views: 1442

The named pipe mechanism requires that you have both a writer process and a reader process running at the same time. You have timeout or wait attributes that control how much time you have available before you get a "broken pipe". So a question would be "are you certain you are running the 2 jobs at...
by ArndW
Wed Apr 11, 2007 6:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Timed out while waiting for an event
Replies: 7
Views: 6843

In your sequence, put in a call to "SLEEP RND(5)+5" to give you a minimum 5 second delay with a random additional delay. This might be enough to keep your server from overloading while starting up all those processes.
by ArndW
Fri Apr 06, 2007 6:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error Connecting from Client in Windows to DS Server in Unix
Replies: 19
Views: 6065

ds_ram, Ray already suggested you check to see if you have security software and if so, to see if it is blocking the DataStage port. Have you checked with your system administrator? Also, have you used the default port or chosen another, in which case you need to specify the port in the datastage cl...
by ArndW
Fri Apr 06, 2007 6:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet Performance
Replies: 2
Views: 1170

Datasets are not magically faster than sequential files. In this case with a 2 node configuration the overhead for splitting the data might be just enough to end up being the same speed as a single threaded sequential file. You should try a controlled test. Write a job with a row generator to write ...
by ArndW
Fri Apr 06, 2007 6:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: logic for deleting duplicate rows
Replies: 1
Views: 919

Hello Bhaggu and welcome to DSXchange. This question has been posed and answered many time in the past. If you use the SEARCH facility you will find a lot of threads on this subject. If you have a specific situation which isn't covered by the other answers, you would need to explain in a bit more de...