Search found 15603 matches

by ArndW
Wed Apr 21, 2010 3:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Moving all Duplicate records to second file
Replies: 5
Views: 2280

Sort your input file on the key in DataStage, then use 2 transform stages and stage variables to detect duplicates and split the 2 streams. Sort 1 sort by ascending Key Transform 1 Stage Variables svDuplicate : IF In.Key=svLastKey THEN svDuplicate+1 ELSE 0 svLastKey : In.Key Add column DuplicateNumb...
by ArndW
Wed Apr 21, 2010 3:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX Job not running
Replies: 6
Views: 2162

Does your config file reference multiple nodes?
by ArndW
Wed Apr 21, 2010 2:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with creation of score file
Replies: 5
Views: 3086

Just as a test, login to a UNIX shell as dsadm, and try "touch /tmp/testfile.txt" - does that work? Also, if there are any files in the /tmp directory starting with APT... who are their owners?
by ArndW
Tue Apr 20, 2010 10:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sort error
Replies: 3
Views: 1468

Server sort stage, right? and are you 100% certain that you aren't running out of disk space (assume your whole file lands in that directory temporarily)
by ArndW
Tue Apr 20, 2010 10:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle error messages relating to the rejected records
Replies: 8
Views: 2139

Why not do your truncate as part of the before-sql?
by ArndW
Tue Apr 20, 2010 8:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle error messages relating to the rejected records
Replies: 8
Views: 2139

The Load method is executed outside of DataStage and that is why the single rejected rows and messages aren't visible the way they are with 'upsert'. I think that the error log files should be visible after the job run is finished and has errors, and that file can be read and interpreted.
by ArndW
Tue Apr 20, 2010 3:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compile a job through command line....
Replies: 2
Views: 1331

Rohith,

please use the Search functionality before posting questions; in this case there are 21 thread matching the search terms "command line compile", and this one is just an example of one of them that answers your questions.
by ArndW
Mon Apr 19, 2010 8:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: My job is running runnig still runnig
Replies: 7
Views: 1554

Typically neverending jobs are causing by blocks or locks on the database side. Try your job writing to a peek stage instead of to Oracle. Does it hang?
by ArndW
Mon Apr 19, 2010 8:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Running multi instance job from sequence job
Replies: 10
Views: 4418

Now that you've fixed the path issue, you have hit the next common error, discussed many times here. You need to source the "dsenv" file in the $DSHOME directory, this script sets up the environment and maps the directories. From UNIX the usual command is ". ./dsenv" when attache...
by ArndW
Mon Apr 19, 2010 6:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Running multi instance job from sequence job
Replies: 10
Views: 4418

And I'll chip in one word as well - "Use"

Now push them all onto a stack and then read :D
by ArndW
Mon Apr 19, 2010 3:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: look up failures
Replies: 7
Views: 1863

In this case I think it is the multiple columns used for the key that is causing the issue, particularly if the file creation metadata and query metadata are not the same. But generally it is as Craig has stated, that unseen spaces cause fields that look the same to not match.
by ArndW
Mon Apr 19, 2010 3:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Moving to 8.1 from 8.0
Replies: 5
Views: 1307

Your first step is going to have to be to make an upgrade plan and decide what level of testing you will need to do in order to satisfy the customer quality requirements. I would also tend to the recommendation of getting or hiring someone with experience to do this, but with a lot of effort you can...
by ArndW
Mon Apr 19, 2010 2:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange Issue - Datastage Going down
Replies: 14
Views: 5492

I still cannot understand the exact problem.

Can you change your job to write to a sequential file or PEEK stage, does that work correctly? If yes, then the cause is most likely in the Oracle portion. Do you have specific SQL in Oracle?
by ArndW
Mon Apr 19, 2010 2:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to achive this
Replies: 10
Views: 5268

You've posted a SQL query, but haven't actually specified if this is the source or target. What is your source data and what is your intended target and what form do both take?
by ArndW
Fri Apr 16, 2010 6:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange Issue - Datastage Going down
Replies: 14
Views: 5492

What do you mean that you cannot find the log? What is meant here is the output from the job and is visible in the Director for that job.