Search found 53125 matches

by ray.wurlod
Thu Jun 05, 2014 3:01 am
Forum: IBM QualityStage
Topic: IP Addresses
Replies: 1
Views: 2457

Not PAL, but I do have DataStage server routines that perform this task, if that's any use to you.
by ray.wurlod
Wed Jun 04, 2014 10:15 pm
Forum: IBM QualityStage
Topic: "Does Not Contain" Pattern
Replies: 5
Views: 3508

Have you tried it without the floating position specifier? Assuming you mean !\: would not that identify only that the first character is not a colon? Similarly, *!\: will search for any character that is not a colon and stop as soon as one is found. Neither of these satisfies "does not contai...
by ray.wurlod
Wed Jun 04, 2014 7:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Variable Column Set in File
Replies: 2
Views: 978

Create a preliminary job that reads the header file and creates a schema file (so that the Sequential File stage can use RCP to read the file) and also creates a Modify stage specification to translate from today's columns to the "official" job columns. Provide the Modify stage specificati...
by ray.wurlod
Wed Jun 04, 2014 4:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Source and Target row count matching in Datastage job
Replies: 11
Views: 5681

OK, so you need the DataStage API function DSGetLinkRowCount() and DSSendMail().
You can find examples of the latter under \Routines\Built-In\Utilities in Designer.
by ray.wurlod
Wed Jun 04, 2014 3:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Source and Target row count matching in Datastage job
Replies: 11
Views: 5681

That's the why. What do you actually want to do with them? Write to file? Send email? Something else?
by ray.wurlod
Wed Jun 04, 2014 3:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Source and Target row count matching in Datastage job
Replies: 11
Views: 5681

Welcome aboard.

You could create an after-job subroutine that uses DataStage API functions to retrieve the link row counts.

What do you want to do with these counts?
by ray.wurlod
Wed Jun 04, 2014 3:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: GET N rows in output based on counts
Replies: 11
Views: 3541

Please do not send private message with the same question unless you are seeking to hire services.
by ray.wurlod
Wed Jun 04, 2014 3:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning: the value of the PWD environment variable (/opt/DAT
Replies: 5
Views: 2141

This warning has been around for a long, long time. Easiest solution is to set the value of PWD. For convenience I set it globally for DataStage users to have the value "." (current directory).

Code: Select all

PWD=. ; export PWD
by ray.wurlod
Wed Jun 04, 2014 3:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SMP to MPP datastage code migration
Replies: 1
Views: 1613

Basically you need new configuration file(s), and to ensure that anything that all nodes need to access are accessible from all nodes. Particularly the parallel execution engine needs to be accessible from all nodes.
by ray.wurlod
Wed Jun 04, 2014 2:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bulk orchestrate import of table definitions
Replies: 17
Views: 6105

Welcome aboard.

At current version the answer is "no".
by ray.wurlod
Wed Jun 04, 2014 2:00 am
Forum: General
Topic: what is the max rows in a file to process through datastage
Replies: 1
Views: 1012

There is no limit in DataStage. File contents are streamed through DataStage.

There may, however, be operating system limits on the size of a file, for example 2GB on a 32-bit file system.
by ray.wurlod
Tue Jun 03, 2014 10:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage during extraction of data from table
Replies: 1
Views: 715

You can join the Oracle Connector stage directly to the Data Set stage. A Copy stage that does nothing will be optimized out of the design when the job is run unless you prevent this behaviour (prove this by examining the score). A Transformer stage will waste a small quantity of resources at run ti...
by ray.wurlod
Tue Jun 03, 2014 1:05 am
Forum: General
Topic: different invocation id
Replies: 3
Views: 997

Based on the information you have provided, you are not correct. All three invocations will run. The fact that they can have invocation IDs already tells us that they are configured for multi-instance running. However, the design itself may cause failure. For example, if all three try to write to th...
by ray.wurlod
Mon Jun 02, 2014 4:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Adding columns in transformer (Numeric)
Replies: 16
Views: 6197

Here is a function for adding intervals. They are expected to be in HH:MM or HH:MM:SS or HH:MM:SS.ssss format. It makes great use of the typeless environment available in server routines. Adapt as required. FUNCTION AddInterval(aInterval1, aInterval2) $COPYRIGHT "Copyright (c) 2006 Ray Wurlod. ...
by ray.wurlod
Mon Jun 02, 2014 4:08 pm
Forum: General
Topic: Export 1 .dsx per job (automatically)
Replies: 2
Views: 1525

Otherwise create a script that loops through the result of dsjob -ljobs command.