Search found 53125 matches

by ray.wurlod
Tue Jan 19, 2016 3:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: dynamically select the column at runtime
Replies: 10
Views: 3571

The Modify stage KEEP specification can (and should in your case) be a job parameter.
by ray.wurlod
Tue Jan 19, 2016 3:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Rules Stage How to Validate a TimeStamp
Replies: 6
Views: 2356

2016-01-18T12:34:56.123445 is a valid timestamp. Will your tests handle it? How about "2016.01.18 12.34.56,123445" (which you are unlikely to encounter in Australia)?
by ray.wurlod
Mon Jan 18, 2016 10:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Rules Stage How to Validate a TimeStamp
Replies: 6
Views: 2356

I note that you have marked this as Resolved. I assume that you are only validating a single, very specific timestamp format.
by ray.wurlod
Mon Jan 18, 2016 10:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing Filter conditions dynamically
Replies: 1
Views: 875

The "Where Clause" property of the Filter stage can be a job parameter.

In your examples, this would need to be the entire Where Clause. It could be built dynamically in a sequence job, for example by invoking a routine or by doing something with user variable and loop.
by ray.wurlod
Mon Jan 18, 2016 7:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Rules Stage How to Validate a TimeStamp
Replies: 6
Views: 2356

As noted, MATCHES_REGEX is your friend. Time validation requires a very straightforward regular expression. Design it yourself, or find one on the internet. Two scenarios only are needed. First digit is 0 or 1, second digit is 0-9, third character is ":", fourth character is 0-5, fifth cha...
by ray.wurlod
Mon Jan 18, 2016 7:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Rules Stage How to Validate a TimeStamp
Replies: 6
Views: 2356

In Information Analyzer I prefer to use MATCHES_REGEX as it's more flexible handing variable numbers of fractional seconds. You can also handle variations such as a "T" rather than a space between the date and time components. Google regular expressions that match timestamps. There are sho...
by ray.wurlod
Mon Jan 18, 2016 4:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get First day and last day of Quarter
Replies: 1
Views: 1915

Welcome aboard. Become familiar with the date functions in the parallel environment. For example MonthFromDate() gives you the month number, from which you can obtain the quarter number and, by inference, the beginning and end month of the quarter. The day number of the beginning of the quarter is a...
by ray.wurlod
Mon Jan 18, 2016 4:23 pm
Forum: General
Topic: Recursive lookup
Replies: 1
Views: 1177

I recently posted a routine for "looking up" the jobs called from a sequence. The logic of that may help.
by ray.wurlod
Sun Jan 17, 2016 4:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Event log table requirment through datastage
Replies: 2
Views: 1523

What (precisely) do you mean by "event" here?
by ray.wurlod
Thu Jan 14, 2016 9:46 pm
Forum: General
Topic: Datastage jobs folder organization
Replies: 4
Views: 1616

We prefer to group by neither source nor target but, instead, by major subject area and then by job type (update, insert, recovery, sequence, etc.) For example, the Allowances subject area will have sub-folders Update Jobs, Insert Jobs, Recovery Jobs, Sequence Jobs.
by ray.wurlod
Thu Jan 14, 2016 9:43 pm
Forum: General
Topic: Unable to run the datastage jobs
Replies: 2
Views: 1628

Perhaps it's the buttons in the tools. Try running from the menu. If this works, close the Designer and Director windows (ideally re-boot the client machine) and start with newly-opened clients.
by ray.wurlod
Thu Jan 14, 2016 4:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to output source non-xml columns from xml input stage
Replies: 5
Views: 1858

Welcome aboard. Which stage type(s)? What have you tried?
by ray.wurlod
Wed Jan 13, 2016 9:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformer. Would like to hear some ideas.
Replies: 5
Views: 1848

Code: Select all

N                 1  2  3  4  5  6  7  8  9
Int(N+1)/2)       1  1  2  2  3  3  4  4  5
by ray.wurlod
Wed Jan 13, 2016 9:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformer. Would like to hear some ideas.
Replies: 5
Views: 1848

My solution does not involve @INROWNUM. If you use @INROWNUM it increments on each node, though that would work OK in a two node configuration using Round Robin partitioning if your data were sorted by the integer value to which you referred. But you described your requirement in terms of pairs of r...