Search found 53125 matches

by ray.wurlod
Mon Nov 26, 2007 12:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: unable to view data in sequential and hashed files
Replies: 1
Views: 937

Welcome aboard. Status 2 is an operating system code meaning "file does not exist". This may mean that the file itself does not exist or that one of the directories in its pathname does not exist, or that somewhere in that path you lack sufficient permission. The fact that the error message includes...
by ray.wurlod
Mon Nov 26, 2007 12:47 am
Forum: General
Topic: I am five tab delimited files(same meta data), i want to app
Replies: 6
Views: 1821

Sure is. Sequential File stage, either with a Filter command as indicated, or with five output links. --------------> Seq --------------> Oracle File --------------> OCI stage --------------> stage --------------> And that's just with server jobs. In parallel jobs there are even more options, for ex...
by ray.wurlod
Sun Nov 25, 2007 2:21 pm
Forum: IBM QualityStage
Topic: multi national address data
Replies: 12
Views: 3037

Which sets go into your matching area and which go into your clerical error depeneds entirely on where you set your match cutoff and clerical cutoff. Aggregate weights larger than the match cutoff go into the match area. Aggregate weights between the clerical cutoff and the match cutoff go into the ...
by ray.wurlod
Sat Nov 24, 2007 12:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage: Delete executable (parallel job)
Replies: 7
Views: 2743

DataStage jobs do not just comprise a single executable component. There are configuration records, status records, log records for run time, and of course design time components also stored in Repository database tables as well. Why, particularly, do you want to delete the executable? Without seein...
by ray.wurlod
Fri Nov 23, 2007 8:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Determining which cpu performs which process in a Job
Replies: 6
Views: 1683

That one's easy. Just have the player processes report their pid when they start - the messages will be logged from their own node. The environment variable, from memory, is APT_PM_SHOW_PIDS.
by ray.wurlod
Fri Nov 23, 2007 8:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error message
Replies: 1
Views: 1091

I presume DSLink16 is the name of the link between the Transformer and Sequential File stages. What is the value of the File property in the Sequential File stage?
by ray.wurlod
Fri Nov 23, 2007 8:24 pm
Forum: General
Topic: How to load huge volumes of data in an Oracle DB? Bulk Load?
Replies: 7
Views: 2461

Oracle Enterprise stage using direct write (effectively parallel bulk load).
by ray.wurlod
Fri Nov 23, 2007 1:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of stages from "Development/Debug" area of the
Replies: 3
Views: 1630

See my response to your other thread.
by ray.wurlod
Fri Nov 23, 2007 1:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove duplicates stage on data sorted on different keys
Replies: 8
Views: 2948

This one looks like a good candidate for a local message handler, to demote the warning to an informational message. It's not strictly required that the upstream sort be exactly right for the RemDups stage (as you have demonstrated); but DataStage alerts you when it isn't.
by ray.wurlod
Fri Nov 23, 2007 1:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Modify Stage - what can it do?
Replies: 4
Views: 1650

Always push back on stupid requirements, and you can tell the PHB that I said so. The categories on the Palette are totally customizable - you can readily move a stage type into another category to suit your personal whim. Row generators and column generators particularly are used in lots of product...
by ray.wurlod
Fri Nov 23, 2007 4:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How Part and Part count working in row generator
Replies: 1
Views: 981

Welcome aboard.
Partition numbers for four nodes are 0, 1, 2 and 3. Partition count is 4.
Plug these into a generator using partnum for initial value and partcount for increment; on the fourth node (node #3) the values will be 3, 7, 11, 15 and so on.
by ray.wurlod
Fri Nov 23, 2007 4:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: time out
Replies: 8
Views: 2482

Yes it is. It is written in very clear English. For less than 30c per day (currently about Rs12) you can purchase premium membership which would permit you to read complete posts by the five premium posters. Revenue from premium memberships is totally dedicated to meeting the hosting and bandwidth c...
by ray.wurlod
Fri Nov 23, 2007 4:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Check for Substring in a string - substring in reference fil
Replies: 4
Views: 998

Code: Select all

Index(RefLink.ColName, "TRUST", 1) > 0 Or Index(RefLink.ColName, "ACCOUNT", 1) > 0 Or Index(RefLink.ColName, "ACCT", 1) > 0 

Put the most likely one first and the least likely one last, for maximum efficiency.
by ray.wurlod
Fri Nov 23, 2007 4:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Use of @TM for hashed file key
Replies: 14
Views: 4449

Yep. Wanted to make sure that BUSINESS_UNIT and OPERATING_UNIT were correctly defined. They are. Therefore I believe your code ought to be OK.
by ray.wurlod
Fri Nov 23, 2007 4:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed file update - only to *some* existing columns
Replies: 5
Views: 1268

That's right. You have to update the other two columns with exactly their same values.