Search found 15603 matches

by ArndW
Thu Jan 10, 2008 7:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: use of unix commands in the execute command stage
Replies: 9
Views: 2070

There should be a lot more output in the director log entry for that call. Could you please post that as well?
by ArndW
Thu Jan 10, 2008 7:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Failed to call datastage from Grid Unix Server
Replies: 3
Views: 1392

What is your exact dsjob command? Try "dsjob -lprojects"; do you get a list of projects?
by ArndW
Thu Jan 10, 2008 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading a Oracle table with Partitions
Replies: 6
Views: 1294

You first need to identify the bottleneck in your processing. If you write a job that just reads the view into a peek stage what speeds do you achieve - are they the same as when you are writing to Oracle or slower?
by ArndW
Thu Jan 10, 2008 7:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to assign Header and Footer in Sequential file?
Replies: 8
Views: 4113

The filter works differently, imagine it is as being implemented as "cat {data stream} | {filter command list}". In different terms, the filter needs to be written so it gets the DataStage job data from Stdin and writes the output stream to Stdout.
by ArndW
Thu Jan 10, 2008 6:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ulimit problem
Replies: 19
Views: 6268

I would check with your support provider. I just looked through the list of bugs fixed in DataStage V8 Fix Pack 1 and one of them is "Solaris version of ds.rc uses ulimit setting" which can open up speculation that this might be a similar issue to what you are seeing on AIX.
by ArndW
Thu Jan 10, 2008 6:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Slow Down
Replies: 6
Views: 1769

Projects don't use memory, jobs do. I would use one user id per project and then measure system memory by userid at runtime to determine what you are looking for.
by ArndW
Thu Jan 10, 2008 6:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: problem with director
Replies: 6
Views: 2793

340 jobs in a category will significantly degrade Director performance. Try to break that down into several categories (perhaps ~50 jobs per category) and you will notice a significant improvement.
by ArndW
Thu Jan 10, 2008 6:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating pdf files from datastage
Replies: 3
Views: 2757

You could do it easily indirectly, just create a sequential file and print it to a PDF document. I am sure that Adobe allows automated PDF creation, but don't know which mechanism is used.
by ArndW
Thu Jan 10, 2008 4:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ulimit problem
Replies: 19
Views: 6268

I'm at a loss to explain this, my assumption is that process spawned off user "1" inherit some ulimit settings and that the solution is make sure that the root process has unlimited settings. I have a vague memory of having seen this issue years ago but cannot recall any of the details apart from th...
by ArndW
Thu Jan 10, 2008 4:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem While inserting the data in DB2 EE stage
Replies: 3
Views: 2460

The dbx and sed error is only secondary to the actual problem in this case, you should concentrate on the Internal Error: (group_.exportSize() <= dbquery->dataBufLength()): db2writeop.C: 985 part. If you change the load method in the stage, does the error go away? In fact, which load method are you ...
by ArndW
Thu Jan 10, 2008 4:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problems with Datastage - Date format & Null Handling
Replies: 12
Views: 29517

An empty string, "" is not a null field. Your schema specifications should read "null_field='NULL'" if I recall correctly.
by ArndW
Thu Jan 10, 2008 4:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Issue in removing new line character
Replies: 5
Views: 3473

Can you not edit the sequential file stage and add the newline to Format -> Record Level -> Record Delimiter?
by ArndW
Thu Jan 10, 2008 3:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HOW CAN WE DELETE DATASET FILES IN DATASTAGE PX
Replies: 4
Views: 3271

Or, from the command line, use "orchadmin rm {DataSetName}"
by ArndW
Thu Jan 10, 2008 3:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Suppose for lookup primary data is having 10 million records
Replies: 5
Views: 1343

Umm, if you are using a lookup stage you should use entire partitioning for the lookup.
by ArndW
Wed Jan 09, 2008 12:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: make something that calls attention when an abort occurs
Replies: 10
Views: 3301

If they use Windows and don't have the messaging facility turned off (which I think it is by default, after all those internet exploits), then you can issue the message command from the DataStage process via a shell.