Search found 15603 matches

by ArndW
Fri Jul 13, 2007 1:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Formatted length of fields & record<declared length-W
Replies: 18
Views: 2846

I just wanted to confirm the source of the error, as the message doesn't normally relate to an Oracle write. What happens if you change the Oracle stage to do an UPSERT, does the message also go away?
by ArndW
Fri Jul 13, 2007 12:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Formatted length of fields & record<declared length-W
Replies: 18
Views: 2846

Just for testing sake, can you put a PEEK stage into your job output instead of the Oracle stage and see if the error message persists?
by ArndW
Fri Jul 13, 2007 12:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Finding field in Datastage repository
Replies: 2
Views: 1394

It is possible to do this via access to the hashed file metadata contents; although it does take quite a bit of work. I would recommend you start with doing a project export into a .dsx file or, if you are more comfortable with XML, exporting in that format. The structure of the export file is prett...
by ArndW
Thu Jul 12, 2007 10:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Infinite loop implementaion in Server Job
Replies: 8
Views: 1876

Created a counted loop in your sequence that goes from 1 to a couple of million and let that loop with a command stage of sleep {n-seconds} in the loop so that you don't use too much CPU just looping if there is nothing for the 2 jobs to do.
by ArndW
Thu Jul 12, 2007 10:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Export Job creates 1KB file
Replies: 9
Views: 2627

What about doing a save-as of your job and checking to see if you can export that. If yes, then there might be some corruption in your project.
by ArndW
Thu Jul 12, 2007 8:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CFF - Cobol File Definition w/ Sequential File or DB2 API
Replies: 3
Views: 1430

More tuning work has gone into the sequential file stage than the CFF stage. I think the limiter is the amount of CPU used in the CFF stage, since it needs to parse out all the columns and then interpret them. If that is the case and you have a system with more than 1 CPU you can increase throughput...
by ArndW
Thu Jul 12, 2007 7:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data set stage question
Replies: 6
Views: 1222

The reason I asked about timing was to make you check whether the dataset write job is complete before the dataset read job starts. You haven't confirmed or refuted that possible cause yet.
by ArndW
Thu Jul 12, 2007 7:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CFF - Cobol File Definition w/ Sequential File or DB2 API
Replies: 3
Views: 1430

Unfortunately sequential read speed does decrease significantly as the number of columns increases. If you declare each row as just 1 column in a test job and write out to a sequential file stage what speed does it perform at (this will help give a baseline as to expected best case throughput). If m...
by ArndW
Thu Jul 12, 2007 7:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Decryption using XOR logic
Replies: 5
Views: 2310

The DataStage BASIC programmer's Guide has a description of the BITXOR (V1,V2 ) function which you can use to revert your modified string back to the original one, given you know the string with which you XOR'd in the first place.
by ArndW
Thu Jul 12, 2007 6:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Number of nodes to be used when we have a lot of Lookups....
Replies: 2
Views: 860

There are no hard-and-fast rules regarding number of nodes in the configuration file and number of processes - there are just too many variables introduced by how jobs are designed and coded. If you run your job several times with 1,2,3... nodes and chart the overall runtime you will see that perfor...
by ArndW
Thu Jul 12, 2007 2:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Export Job creates 1KB file
Replies: 9
Views: 2627

Could you explain which buttons/switches you are selecting in your export window? What happens if you export the job, source & objects?
by ArndW
Thu Jul 12, 2007 2:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Export Job creates 1KB file
Replies: 9
Views: 2627

Does your job "CopyOfTCIJBBKORFO" contain anything? It doesn't look like you selected a full project export.
by ArndW
Thu Jul 12, 2007 2:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: default job parameters
Replies: 11
Views: 2062

Rajesh - to reiterate, the default value for a parameter will be used unless the parent sets it. Somewhere you are setting this parameter to a value. If you set the default value in the Job Activity stage explicitly then that value will be used when the job is called. I don't know what else to ask -...
by ArndW
Thu Jul 12, 2007 2:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

Yes, the same error happens regardless of the number of nodes I use (1,2,4 and 8 for both the lookup fileset and test job).

I am leaning towards thinking this is a HP-UX specific issue and am awaiting a response from support (I hope that they have a HP_UX test bed available somewhere).
by ArndW
Thu Jul 12, 2007 2:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: difference betwn look up stage and join satge in PX
Replies: 9
Views: 6571

No, the output will be identical providing you don't change the lookup data while the job is running, in which case the sparse will show the new value and a normal one, which uses a memory image of the data as it was when the job began, will show the old value.