Search found 53125 matches

by ray.wurlod
Sat Aug 09, 2003 5:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: too many warning message
Replies: 9
Views: 2602

As to the slowness, you really need to identify where it is occurring. Normally ODBC doesn't incur that much of a penalty over a native stage when it's doing SELECT, but you could test this with a job that simply does the SELECT and loads the result into a text file. Similarly, another test job coul...
by ray.wurlod
Sat Aug 09, 2003 5:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: too many warning message
Replies: 9
Views: 2602

On DS6 (I have not checked earlier version) the Informix CLI stage has, on its Inputs link General tab, both Array Size and Transaction Size fields. Array size is the number of records that are cached before being written to the database; this is primarily intended to allow more efficient use to be ...
by ray.wurlod
Sat Aug 09, 2003 5:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Design Patterns for Standard ETL
Replies: 4
Views: 1558

Your description misses the most powerful aspect of ETL as performed by DataStage, and that is inherent metadata management. IF you have established your business rules, designed your target database and contemplated "luggage labels" (data elements) for your data, all these can be imported into, or ...
by ray.wurlod
Sat Aug 09, 2003 5:01 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Environment Variables - Runtime $ENV
Replies: 9
Views: 7013

You need version 6.0 or later for the following. When you create job parameters, there is a command button labelled "Add Environment Variable" on the Parameters page in the job properties window. This opens a dialog in which all currently available environment variables are displayed. This is partic...
by ray.wurlod
Thu Aug 07, 2003 8:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DB2 to SQL Server (Urgent)
Replies: 2
Views: 1096

Are the data actually being successfully loaded into SQL Server? That is, can you see the data with some other client? To get the data browser in DataStage to work (if you don't mind a metadata mismatch warning) lie about the data type; specify it as VarChar while you're trying to View Data. Are the...
by ray.wurlod
Thu Aug 07, 2003 8:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Transformer output rows reduced!
Replies: 16
Views: 2990

It's really difficult to diagnose this without an explicit explanation of the job design. For example, you did not mention whether there is any constraint on the Transformer stage's output link. If there were, it would be expected to limit the number of rows output. Were I consulting to solve this, ...
by ray.wurlod
Thu Aug 07, 2003 4:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Transformer output rows reduced!
Replies: 16
Views: 2990

Just a thought. It might be worth checking whether a DataSet can have duplicate rows or whether, like hashed files in server jobs, a duplicate (key) performs a destructive overwrite (with no warnings).

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Thu Aug 07, 2003 4:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage in cluster
Replies: 4
Views: 1701

The answer at version 6 and earlier is no on Windows. Parallel jobs can execute in an MPP environment but this is not supported on Windows at version 6. Server jobs simply don't take advantage of an MPP environment. Mike has described a backup/failover situation, but has not indicated how the two Da...
by ray.wurlod
Thu Aug 07, 2003 4:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: To store a value from DB2 table as variable in job
Replies: 4
Views: 626

To expand briefly on Ken's suggestion, the mechanism would be to call the DSExecute subroutine to run the script, using its third argument to recover the result. Shell = "UNIX" Command = "./MySQLscript.sh" Output = "" Code = 0 ; * exit status of script after call Call DSExecute(Shell, Command, Outpu...
by ray.wurlod
Thu Aug 07, 2003 12:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Loading Data takes a too long.
Replies: 2
Views: 531

Before you blame DataStage, how long does it take in PL/SQL? And what is the SQL statement you are using? It should be something like SELECT contract_no FROM table WHERE id = (SELECT MAX(id) FROM table) ; The index on id should mean that the subquery is executed fast and the outer query is executed ...
by ray.wurlod
Thu Aug 07, 2003 12:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Wait For File Activity
Replies: 4
Views: 2130

I don't have access to DataStage at the moment, but could you not specify a wildcard in the name of the file for which you're waiting?

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Thu Aug 07, 2003 12:09 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Security for Datastage Jobs
Replies: 1
Views: 559

Essentially the answer is no since release 5.2, since when all job design elements are stored in the same file (DS_JOBOBJECTS). Anyone who is a member of the DataStage Developer role can view, save and compile any job design in the repository. If this is important to you, why not lodge an enhancemen...
by ray.wurlod
Wed Aug 06, 2003 4:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: decimal point
Replies: 2
Views: 844

Try adding zero to the input number. This forces the result to be a number. You can also format it so that it specifically meets your output requirements. For example:
Fmt((InputLink.ColumnName + 0), "6R2")


Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Wed Aug 06, 2003 4:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: common variables
Replies: 6
Views: 1413

Note also that variables declared to be in a COMMON area of memory (which is not the same thing as shared memory) are only accessible within a single process. That is not the same thing as a job; for example, such a variable can be accessible from a before-stage subroutine, within routines called fr...
by ray.wurlod
Wed Aug 06, 2003 4:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Silly parameter question
Replies: 2
Views: 828

If you're in the controlling job, you can obtain the values of the controlling job's parameter values using DSGetParamInfo function. You can then use DSSetParam to set parameter values for a controlled job, before starting that controlled job's run. There is no sensible way to obtain a value from a ...