Search found 53125 matches

by ray.wurlod
Mon Aug 09, 2010 3:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Redundant Copy stage
Replies: 2
Views: 956

A Copy stage that makes a single copy of its input will be optimized out of the design. A Copy stage that has no output will consume all of its input at no cost. So, if you remove the stage downstream of the Copy stage but leave the Copy stage in place, there will be no performance penalty.
by ray.wurlod
Mon Aug 09, 2010 2:08 am
Forum: General
Topic: Data Scrubbing in ETL
Replies: 11
Views: 4953

You'll probably spend more writing and testing your own data masking routines, test data management systems (you need to preserve relationships between tables) and control systems than you would to purchase Optim.
by ray.wurlod
Mon Aug 09, 2010 2:06 am
Forum: IBM QualityStage
Topic: Unable to Provision
Replies: 4
Views: 2134

Is there anything useful in the SystemOut.log for the WebSphere Application Server?
by ray.wurlod
Mon Aug 09, 2010 2:05 am
Forum: Enhancement Wish List
Topic: DataStage Parameters
Replies: 9
Views: 16761

OK, I now see the bigger picture. Still don't like your chances of getting this one through (it can be done in a sequence) but, if you don't ask you might die wondering!
by ray.wurlod
Sun Aug 08, 2010 9:29 pm
Forum: General
Topic: Data Scrubbing in ETL
Replies: 11
Views: 4953

My initial thought is that the Optim product from IBM does all this and more.
by ray.wurlod
Sun Aug 08, 2010 9:28 pm
Forum: Enhancement Wish List
Topic: DataStage Parameters
Replies: 9
Views: 16761

Ah. I suspect IBM's response will be that you can use stage variables in a Transformer stage early in the job to effect what you describe as "computed parameters" - simply putting these values onto an output link makes them accessible downstream. A stage variable that has an initialization...
by ray.wurlod
Sat Aug 07, 2010 2:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Trim Issues while sending Data to Fixed length File
Replies: 4
Views: 2086

Code: Select all

Right(("00000" : InLink.TheValue), 5)
The inner set of parentheses is not actually necessary; I included it for clarity.
by ray.wurlod
Sat Aug 07, 2010 2:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to capture the logdata
Replies: 3
Views: 1214

If you're looking for a command line based approach, search for dsjob command.
by ray.wurlod
Sat Aug 07, 2010 2:03 pm
Forum: General
Topic: Data Scrubbing in ETL
Replies: 11
Views: 4953

Please respond on this post!!! We must have our questions answered.
by ray.wurlod
Sat Aug 07, 2010 2:01 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Web service Transformation stage error!!!
Replies: 6
Views: 5354

At a guess, the jar file needed by the stage is not in your CLASSPATH. Unfortunately I do not know which jar file the stage uses.
by ray.wurlod
Sat Aug 07, 2010 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: If then else logic in transformer
Replies: 4
Views: 4903

Code: Select all

Field("ab|ab|ab|cd|cd|ef|ef", "|", InLink.TheValue, 1)
Or use a lookup table in a Modify stage (lookup_string_from_int16() function).
by ray.wurlod
Sat Aug 07, 2010 4:26 am
Forum: General
Topic: Data Scrubbing in ETL
Replies: 11
Views: 4953

PII ? We have no idea what "data scrubbing" means in your context. You need to begin with a written specification of what you need to achieve. Without that no-one would be able to help you. It is also unreasonable to demand answers here, particularly so soon after posting on a weekend. DSX...
by ray.wurlod
Fri Aug 06, 2010 3:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring MPP - Service table transmission failed
Replies: 3
Views: 2513

Re: Configuring MPP - Service table transmission failed

kerpal_dog wrote:Tried setting the APT_AUTO_TRANSPORT_BLOCK_SIZE to True (as per documentation suggestion) and same old stuff.
That can't be right - it would give you a block size of 1, where you really need it to me much higher, maybe 1MB or more.
by ray.wurlod
Fri Aug 06, 2010 3:24 pm
Forum: General
Topic: Before/after subroutine options..
Replies: 6
Views: 1882

The dot can matter, as a reading of the man page for source will reveal.
by ray.wurlod
Fri Aug 06, 2010 7:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sending email to different domain
Replies: 4
Views: 1614

Allow the mail to go through the gateway on your internal mail server.