Search found 53125 matches

by ray.wurlod
Tue Jan 30, 2007 7:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32 in PX
Replies: 15
Views: 5005

When you read the three pertinent chapters in the Parallel Job Developer's Guide what did you discern the differences to be?

I would be happy to read these chapters for you, in return for my usual fee.
by ray.wurlod
Tue Jan 30, 2007 7:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dateformat from Currentdate
Replies: 5
Views: 1854

Then don't apply a DateToString() function. Just assign CurrentDate() to this column. You can change the display format (but not the storage format, which is "date") by selecting this row in the Columns grid, right click, choose Edit Row, and provide the date format string there. If you want all dat...
by ray.wurlod
Tue Jan 30, 2007 7:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to implement intersect
Replies: 11
Views: 2470

A lookup against table2 with the Transformer output constrained to put only those records for which the lookup succeeded will satisfy your requirement.
by ray.wurlod
Tue Jan 30, 2007 7:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to get sequence number in Datastage
Replies: 6
Views: 3255

The two SDK routines KeyMgt... manage generation of sequence numbers by keeping each sequence name as a record in a hashed file called SDKSequences, which is automatically created as necessary. Sequences in SDKSequences can be initialized with simple INSERT or UPDATE statements, or with a routine. S...
by ray.wurlod
Tue Jan 30, 2007 7:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dateformat from Currentdate
Replies: 5
Views: 1854

What is the data type of current_dt?
by ray.wurlod
Tue Jan 30, 2007 7:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Quality via DSRoutine
Replies: 5
Views: 2184

Out of band null is represented in DataStage as 10000000 (binary). You can represent this as 128 in decimal, 200 in octal or 80 in hex. For example \x80
by ray.wurlod
Tue Jan 30, 2007 7:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Input buffer overrun at field
Replies: 7
Views: 5125

Post your record schema, and the row for which the error was generated. Remember that row numbers begin at 0.
by ray.wurlod
Tue Jan 30, 2007 6:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Correct way to remove sort folders
Replies: 1
Views: 607

If you have the permissions you can just delete them - no special procedures are required. Make sure to use the recursive form of delete, just in case they have contents.
by ray.wurlod
Tue Jan 30, 2007 6:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dateformat from Currentdate
Replies: 5
Views: 1854

First, CurrentDate() returns a date. There is no format. When you use DateToString() you can specify a format. Derivation expressions do not contain "=" characters to assign values. Try just DateToString(CurrentDate(), "%mm/%dd/%yyyy") as the derivation of the current_dt fi...
by ray.wurlod
Tue Jan 30, 2007 6:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32 in PX
Replies: 15
Views: 5005

The data volumes I would expect to process with a parallel job would make the risks involved in using CRC32 too great. CRC32 has about a one in four million chance of generating false positives. Parallel jobs have their own, quite efficient, change detection mechanisms; the Difference stage, the Com...
by ray.wurlod
Tue Jan 30, 2007 6:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Renaming and deleting a dataset
Replies: 34
Views: 12192

Use find to determine where liborchgeneral686.so is on your file system.
Make sure that its parent directory appears in LD_LIBRARY_PATH.
Which stage generated this error?
by ray.wurlod
Tue Jan 30, 2007 6:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Processing multiple files
Replies: 11
Views: 3374

Your difficulty is with your operating system's output line length limit. You may be able to modify that. You could certainly adapt your Convert() function to remove the line terminators as well (on UNIX - on Windows you'd need Ereplace()). Or you could use ls -1 to get a single COLUMN of output, an...
by ray.wurlod
Tue Jan 30, 2007 6:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: STATUS FILES NOT ABLE TO OPEN....
Replies: 2
Views: 1418

:idea:
Perhaps we could introduce a fee for searching when experienced posters fail to search?
by ray.wurlod
Tue Jan 30, 2007 6:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Set Management is very slow!
Replies: 20
Views: 4288

The partitioning of the Data Set is determined by the job that created it.

Are you using Overwrite or Append in the slow "load" job?
by ray.wurlod
Tue Jan 30, 2007 6:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Checking Operator Error
Replies: 5
Views: 2026

Even when used as a target a Sequential File stage may have multiple File properties, writing to different files. In this case it will execute in parallel mode unless constrained to do otherwise.