Search found 15603 matches

by ArndW
Mon Jun 08, 2009 6:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: accidentally delete all data in DS_JOBS
Replies: 13
Views: 4528

I think that the DS_JOBS contents could be rebuilt with some effort if all other files are still present. Much of the DS_JOBS metadata could be reconstructed from the DS_JOBOBJECTS.

Do you have a UNIX level or DataStage export file backup?
by ArndW
Mon Jun 08, 2009 6:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to parse a datastage job and fetch all col derivations
Replies: 12
Views: 3800

The API call to DSGetLinkMetaData() will return a complete list of column names and metadata for each link in a stage. You would need to use DSOpenJob(), DSGetJobInfo(), DSGetStageInfo() and DSCloseJob() in order to get this to work.
by ArndW
Mon Jun 08, 2009 5:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to parametrized wait for file activity stage
Replies: 5
Views: 2012

What is preventing you from using parameters for the file names in the stage?
by ArndW
Mon Jun 08, 2009 4:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to delete or rename a job
Replies: 8
Views: 2853

NEVER delete DataStage files from UNIX unless you know exactly what you are doing. If you had deleted the job correctly, from the Designer or Director, it would have freed the disk space and you would not have any problems now.

What happened when you tried my suggestion?
by ArndW
Mon Jun 08, 2009 4:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Wait for file activity stage
Replies: 1
Views: 1552

Please don't post multiple threads simultaneously with the same question, this thread is already active.
by ArndW
Mon Jun 08, 2009 4:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to parametrized wait for file activity stage
Replies: 5
Views: 2012

The stage itself will only take one filename, but if you need to wait for all the files you can just put them sequentially, one stage per file. If more "intelligence" is needed then you could always call a shell script from your job and return an appropriate code for "all files presen...
by ArndW
Mon Jun 08, 2009 2:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to delete or rename a job
Replies: 8
Views: 2853

This is exactly why we always state that you should never remove files from the OS level! The name "Config" should have been a warning - it is not a log file but a necessary configuration file. From the OS level, the RT_CONFIGnnnn files are subdirectories. Copy another RT_CONFIGnnn (any on...
by ArndW
Fri Jun 05, 2009 8:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to compile a job - through command line
Replies: 8
Views: 4818

The command is on your client PC, not on the UNIX server.
by ArndW
Fri Jun 05, 2009 12:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Remote execute DS Job on Windows OS 64 bit failing
Replies: 2
Views: 1219

This might have to go to IBM support and they will probably just state "not supported". It would seem that even just the dsrun.exe won't work on your 64bit installation. Do you have options to execute the program in some sort of 32bit compatibility mode or 32bit environment from Win64?
by ArndW
Fri Jun 05, 2009 12:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataStage dsjob -jobinfo Command Output
Replies: 7
Views: 10315

Balayya - I don't mean to sound petty, but why can you not do that yourself - you must have DS since you are debugging a script; just choose a job in a project on your installation and execute the command. I'd attach some output if I were at a DS installation, but you should be able to take care of ...
by ArndW
Fri Jun 05, 2009 12:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameters
Replies: 7
Views: 3106

As has been answered twice in this thread already, you need 2 steps, the first to get values from your table and the second to use those values to call jobs. You cannot set parameter values inside the job that uses those values, therefore you need a sequence that does this work and then calls the job.
by ArndW
Fri Jun 05, 2009 12:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: filter condition
Replies: 6
Views: 1604

Is your database on the same server as DataStage? If not, then it might be best to do it in the DB. Even if both applications are on the same server it can be faster to limit the data at the first (database) level. Do you mean that you wish to use non-indexed columns are part of your selection crite...
by ArndW
Fri Jun 05, 2009 12:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Memory Error
Replies: 10
Views: 3274

Although I haven't had my morning coffee yet, it would seem that 4057M is quite close to 3.9G which looks like your physical memory is equal to your virtual memory - meaning no swap!
Does your job repartition or sort the data? This would explain larger memory use.
by ArndW
Fri Jun 05, 2009 12:31 am
Forum: General
Topic: Housekeeping
Replies: 2
Views: 1572

There is very little housekeeping that can be done from the OS level. I can think of cleaning up the /tmp and Project/&PH& directories, that is about it. The rest needs to be approached from within DS - i.e. autopurge settings for logs.
by ArndW
Fri Jun 05, 2009 12:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup with Blank
Replies: 10
Views: 1864

Blanks are not modified or trimmed automatically in DataStage. A Char(2) definition will have length 2 regardless of contents, otherwise it is a VarChar column. Hmm, I just saw that you posted in PX but marked it as a server job. Data is not typed strictly in server and you could get a length of 1. ...