Search found 15603 matches

by ArndW
Sun Jul 13, 2008 9:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: scratch folder filling very fast for a particular table
Replies: 10
Views: 2466

I think there is some information missing that might explain this behaviour. Are you doing a straight load from table to dataset, and are you doing any sorting (implicit or explicit)?
by ArndW
Sun Jul 13, 2008 7:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: split one record to multiple records and field delemeter &qu
Replies: 4
Views: 1484

The first problem isn't too tough, you need to apply the rule as the first and last characters must be double-quotes and the internal delimiters must be '","'. This can be done with simple left(), right(), and count functions in your transform logic. Once you have that solved, you can look up "pivot"
by ArndW
Sun Jul 13, 2008 4:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ORA-03113: end-of-file on communication channel
Replies: 11
Views: 4719

Have you changed anything in DataStage or on the server? Do you have other DataStage jobs that connect to this Oracle instance and are they working or also failing? Have you talked to your Oracle DBA to see if he/she can find something amiss in the database?
by ArndW
Fri Jul 11, 2008 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abnormal termination of datastage job
Replies: 3
Views: 2222

Phantoms are background processes, but I would suggest that you don't follow the advice and terminate these processes without knowing to which job they belong. By far the best thing to do is let DataStage take care of locks by enabling the deadlock daemon (you can search this site for references on ...
by ArndW
Fri Jul 11, 2008 7:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS server crash
Replies: 4
Views: 1341

Can you explain what "server getting crashed" means? Does it mean that your job aborts or that the DS Engine stops? In either case, an error message posted here will go a long way towards getting a qualified response.
by ArndW
Fri Jul 11, 2008 2:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: dsjob -run
Replies: 2
Views: 988

To take part of your command line, "-param prmDbSrcName=prmDbSrcName " means that your Oracle instance name is "prmDbSrcName" which I doubt is what you wanted to specify. What are you trying to do - use environment values, i.e. "-param prmDbSrcName=$prmDbSrcName"
by ArndW
Thu Jul 10, 2008 8:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: A plethora of sshd processes
Replies: 7
Views: 3144

No, I think that they are part of DataStage. I recall having had to clean up after processes at one site before, we wrote scripts to to the cleanup. I think it was because of network or system timeouts.
by ArndW
Thu Jul 10, 2008 7:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading the data file
Replies: 7
Views: 1554

ray.wurlod wrote:I'm uncertain what the Heisenberg effect is - can you please amplify?
:wink:

Sorry, Ray, I cannot do that; since it would change the result for others. But I do have a [live] cat in a sealed box for you....
by ArndW
Thu Jul 10, 2008 4:05 am
Forum: General
Topic: Backup of DataStage ver 8
Replies: 4
Views: 2442

Unfortunately the old approach of a UNIX backup is no longer sufficient with Version 8 as it has other components and metadata stored in the Information Server repository.
by ArndW
Thu Jul 10, 2008 3:46 am
Forum: General
Topic: How to learn Datastage Parallel jobs?
Replies: 7
Views: 1383

There are few, if any, good free materials available to learn PX jobs. If your site has PX installed then you can use the tutorial that comes with the product along with the manuals to "play" on a real system. Learning becomes quite difficult without access to a PX system.
by ArndW
Thu Jul 10, 2008 1:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: A plethora of sshd processes
Replies: 7
Views: 3144

Craig, "kill 'em all and let the big FNUXI in /dev/null sort 'em out" is what I say. The file unit 13 might just be a pipe that, while not closed, isn't communicating
by ArndW
Thu Jul 10, 2008 1:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: TrimLeadingTrailing() function usage in Transformer
Replies: 8
Views: 6039

Open up your transform stage details and set the compiler flags, including the "-O0" option, in the "Compiler Flags" line f the "Build" tab. I don't think that there is much of a penalty if you remove the optimization at the project level (through the Administrator tool), since much of transform pro...
by ArndW
Thu Jul 10, 2008 12:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading the data file
Replies: 7
Views: 1554

I don't know where your problem might be happening, but you might think about using the debugger. Find out the last "good" output line and put a breakpoint on that value, then step to the next one and see if the data contents might give a clue as to the cause of your problem. Sometimes the debugger ...
by ArndW
Wed Jul 09, 2008 11:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: A plethora of sshd processes
Replies: 7
Views: 3144

DataStage telnet sessions that have timed out? Can you see what system calls they are doing (i.e. "truss -p 4392")? I recall I have seen lots of semi-defunct processes on a system, so think that these really are DataStage processes.
by ArndW
Wed Jul 09, 2008 11:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS Designer Hangs during Job compilation
Replies: 6
Views: 3138

Probably locks of some kind. If you have a small project and access to root/dsadm, then shutting down and restarting Datastage might be your quickest solution.