Search found 53125 matches

by ray.wurlod
Tue Jun 12, 2007 5:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Websphere Customer Center Product information
Replies: 1
Views: 1364

I haven't even seen this product Peter. Maybe it'll be pushed at the October Information on Demand conference in Las Vegas. Meanwhile, have you tried contacting anyone in IBM Australia Software Group?
by ray.wurlod
Tue Jun 12, 2007 5:14 am
Forum: General
Topic: How to capture shell script error in DS parallel jobs
Replies: 1
Views: 1091

Job sequence. Execute Command activity to execute your shell script. The exit status of the shell script is available as an activity variable that can be used to control a trigger that determines whether the Job activity is executed. Or whether some other processing takes place that handles the erro...
by ray.wurlod
Mon Jun 11, 2007 10:53 pm
Forum:
Topic: metadata repository
Replies: 3
Views: 1819

The repository self-installs with versions earlier than 8.0, using DataStage Engine (a derivative of UniVerse RDBMS) as the database server. With effect from version 8.0 scripts are provided to create the repository tables on your choice of DB2 version 9, Oracle version 10g or SQL Server 2003.
by ray.wurlod
Mon Jun 11, 2007 10:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cartesian Join in PX
Replies: 6
Views: 2385

A seven way Cartesian join is going to be massive no matter how you undertake it. With only 10 rows per input, you're looking at 10 million rows (10^7) on the output.
by ray.wurlod
Mon Jun 11, 2007 10:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Set/Get Stage variables?
Replies: 15
Views: 8164

First, there are NO data types in DataStage BASIC. That makes life easier or more difficult, depending upon your mindset. In my project, DSGetVar is not cataloged in VOC the same as yours is, and yours is - I believe - incorrect. First, check whether files called DSGetVar.B and DSSetVar.B exist in a...
by ray.wurlod
Mon Jun 11, 2007 10:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: job parameters
Replies: 6
Views: 2812

Job level parameters exist at three levels. First, there are the design-time defaults. These are stored in a table called DS_JOBOBJECTS in the Repository, and copied into the RT_CONFIGnnn table for the job when the job is compiled. Second, there are the run-time defaults, which can be set in the Dir...
by ray.wurlod
Mon Jun 11, 2007 10:33 pm
Forum: General
Topic: Primary Key for Staging Tables
Replies: 5
Views: 3661

I primarily use text files (or Data Sets in parallel jobs) for staging because they are FAST. What does your "must have primary key" colleague think of that ?!! I agree that primary key is a must for all tables in a Data Warehouse; this is one of the fundamental principles of star schema design. But...
by ray.wurlod
Mon Jun 11, 2007 10:31 pm
Forum:
Topic: How do you define "data lineage"
Replies: 12
Views: 6459

DataStage doesn't have good data lineage tools (prior to version 8.0) because they were in MetaStage.
by ray.wurlod
Mon Jun 11, 2007 10:28 pm
Forum: IBM QualityStage
Topic: Field not found: MatchPrimaryWord1NYSIIS
Replies: 2
Views: 1421

I think your best course is to take a class. There is a standard dictionary for the output of a Standardization task. This is why you apparently don't find it in the data file definitions. But, if you have a file dictionary called something like STANOUT, this should contain the firld names. Also, yo...
by ray.wurlod
Mon Jun 11, 2007 6:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cartesian Join in PX
Replies: 6
Views: 2385

Welcome aboard. The Join stage will perform a Cartesian products for Full Outer Join if there are duplicates on the Left input. You are right that a maximum of two inputs is specified for Full Outer Join. Use more than one Join stage in a cascade. For example for three inputs you would use two Join ...
by ray.wurlod
Mon Jun 11, 2007 6:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading the input data
Replies: 2
Views: 1320

Set up a row containing 18 (9 pairs of) columns and parse the pipe-delimited string into them. Parse NULL into any pair where the pair number is larger than COUNT. Then apply a Pivot stage to generate your required rows. Subsequently filter out the null rows (Filter or Transformer stage).
by ray.wurlod
Mon Jun 11, 2007 6:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filter Stage- Type: Fatal error
Replies: 4
Views: 4610

If that's the fix, please mark this thread as Resolved. You might also choose to rate my answer.
by ray.wurlod
Mon Jun 11, 2007 6:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: removing *s
Replies: 13
Views: 2941

What is the rule for changing abc***def to abc**def (two asterisks instead of one)?

You'll need a little more logic than I first postulated, or maybe less. If there is always a space before the "100" piece, Field(InLink.TheColumn, " ", 1, 1) will return just what occurs prior to the first space.
by ray.wurlod
Mon Jun 11, 2007 6:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Set/Get Stage variables?
Replies: 15
Views: 8164

There's no problem using dynamic arrays in COMMON areas. While there's no COMMON FAQ, there is good coverage in the DataStage BASIC manual. The important thing is that, if the same COMMON area is used in more than one routine, it must be identically defined (in terms of variable types rather than na...
by ray.wurlod
Mon Jun 11, 2007 4:08 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: problem with converting to 64 bit hash file
Replies: 5
Views: 1401

... provided you've got enough disk space to create the new hashed file, and you use MINIMUM.MODULUS (not MINIMUM.MODULO - Arnd is living in the past, static hashed file, world!).