Search found 53125 matches

by ray.wurlod
Thu Nov 18, 2010 4:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: data scrubbing/scrambling
Replies: 4
Views: 2598

It's usually called "masking". Investigate IBM's Optim product, which has this capability, while preserving the relationships and statistics of the data.
by ray.wurlod
Thu Nov 18, 2010 4:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can I restart loading after a job abort?
Replies: 2
Views: 3088

There is nothing automatic. You must design this capability into your job.
by ray.wurlod
Thu Nov 18, 2010 4:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server job aborts abruptly
Replies: 2
Views: 1301

The maximum buffer size and maximum number of columns can be tuned in the uvodbc.config file on a per-DSN basis or globally. Search DSXchage for MAXFETCHBUFFSIZE and MAXFETCHBUFFCOLS.
by ray.wurlod
Thu Nov 18, 2010 4:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS Routine issue - Job aborting
Replies: 3
Views: 1424

Or you're trying naughtily to WRITE to a record for which you're not the lock owner.
by ray.wurlod
Thu Nov 18, 2010 4:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parse file
Replies: 13
Views: 4245

One for each field.
by ray.wurlod
Thu Nov 18, 2010 4:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Pattern Matching
Replies: 14
Views: 5514

Yes but, as noted, you can not use Char(any) in the value of a routine argument. This needs to have been pre-evaluated. Char(254) is pre-evaluated into the @FM system variable and Char(253) is pre-evaluated into the @VM system variable. But it's more difficult than that. You can not use any form of ...
by ray.wurlod
Thu Nov 18, 2010 4:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job with Merge Stage Abort
Replies: 6
Views: 2178

(Yes, Mo - Megabyte and Go = Gigabyte. These are fairly commonly used abbreviations in southern Europe particularly.)
by ray.wurlod
Thu Nov 18, 2010 4:34 pm
Forum: General
Topic: Recover Datastage 7.5.2.1 from Error calling subroutin
Replies: 2
Views: 2636

What Craig said. You should have sought advice first. Without restoring the necessary components (and we don't know which they are, because we don't know what you thought suitable for eradication) you will not be able to log in to this project.
by ray.wurlod
Wed Nov 17, 2010 11:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: help needed in understanding SQL to Internal data type conv
Replies: 6
Views: 1967

Any time, driven by the metadata. For example, you might extract the following Char(15) string from source: "010017028048100". The record schema in, say, the output link of a Copy stage might specify this as a vector of five three-character fields. It's still the same 15 characters. For ta...
by ray.wurlod
Wed Nov 17, 2010 7:52 pm
Forum: General
Topic: How to pass a variable date as a parameter in dsjob
Replies: 11
Views: 4565

Create the job with a Date type job parameter.
When the job is submitted, provide a legal date value (in YYYY-MM-DD format).
For example

Code: Select all

dsjob -run -param jpMyDate='2010-11-18' -jobstatus project jobname
by ray.wurlod
Wed Nov 17, 2010 7:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Stage - wI/O
Replies: 15
Views: 5848

You are not correct. The Lookup stage maps the reference data set into memory before the first row is processed. No subsequent I/O is involved. Look elsewhere for your I/O bottleneck.
by ray.wurlod
Wed Nov 17, 2010 7:46 pm
Forum:
Topic: transcation size in datastage
Replies: 6
Views: 2721

Moderator: please move to Enterprise Edition (parallel) forum
by ray.wurlod
Wed Nov 17, 2010 7:44 pm
Forum:
Topic: transcation size in datastage
Replies: 6
Views: 2721

It's done with environment variables APT_ORA_UPSERT_COMMIT_INTERVAL and APT_ORA_UPSERT_COMMIT_ROWS.
by ray.wurlod
Wed Nov 17, 2010 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to Update and insert at the same time
Replies: 1
Views: 916

Welcome aboard. Presumably the decision is made in your job logic. Best practice is to use two Connectors - one to handle the inserts and one to handle the updates. To avoid deadlocks, hold one or the other to a Data Set and move those records into the table in a subsequent job.
by ray.wurlod
Wed Nov 17, 2010 1:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Pattern Matching
Replies: 14
Views: 5514

Now show the expression used to generate the value for the job parameter jprFormatMasks. I presume this is done in a sequence.

Also show us the entry from the job log showing the value passed to the job via that parameter.