Search found 53125 matches

by ray.wurlod
Thu Nov 29, 2007 2:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Restructure stages- vectors, subrecord, column imports etc
Replies: 1
Views: 739

They are totally different. Vectors typically arise from single-element OCCURS in COBOL-generated data - every element in the vector must have the same data type. The number of elements in the vector may be fixed or variable; in the latter case there must be another field in the record containing th...
by ray.wurlod
Thu Nov 29, 2007 2:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Internal data error
Replies: 10
Views: 2974

If you've never used fixtool, involve your support provider. Take a backup copy of the hashed file first - fixtool can (in rare circumstances) damage the file further. The fixtool executable is in $DSHOME/bin. You can use any or all options without -fix entirely safely to report what fixtool finds t...
by ray.wurlod
Thu Nov 29, 2007 2:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compile jobs on dev; Deploy to prod machines.
Replies: 8
Views: 1668

It probably also needs to be mentioned that the runtimes must be 100% compatible with the compilation environment.
by ray.wurlod
Thu Nov 29, 2007 2:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to read Continous Records, No delimeter
Replies: 4
Views: 908

You said the file is fixed record width. Now you say it isn't. The solution is different - you will need to pre-process the file, reading it a block of bytes (or even a character) at a time, to produce a line-terminated file in the second case. If you're good with sed or awk you could use those; you...
by ray.wurlod
Thu Nov 29, 2007 1:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: REG. DATASETS
Replies: 5
Views: 1386

Welcome aboard. Spend some time learning about configuration files, in which you specify the location of the Data Set data files. The pathname you have given is not a file, as you state; it's a directory in which data files are written. It's the default location because it is guaranteed to exist whe...
by ray.wurlod
Thu Nov 29, 2007 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformers columns and value
Replies: 8
Views: 1778

Assuming you mean the derivation expression, yes of course it's stored with the design-time metadata. However no tools are provided with the product to accessing this information, so you would need to learn the internal structure of a parallel Transformer record in wherever it's stored in the Respos...
by ray.wurlod
Thu Nov 29, 2007 1:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Guarenteeing uniqueness...
Replies: 1
Views: 704

How about processing the file with a UNIX uniq command? This could be done as a filter command in a Sequential File stage that reads the file; the stage would then read stdout of the uniq command.

Or even sort -u command.
by ray.wurlod
Thu Nov 29, 2007 1:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Deleting existing rows of the table
Replies: 2
Views: 1161

You could fake it with user-defined SQL, but you still have to pass a row with a key column.

Code: Select all

DELETE FROM tablename WHERE :1 = :1 AND col1 = 0 AND col2 = 0
by ray.wurlod
Thu Nov 29, 2007 1:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multi Instance Log
Replies: 3
Views: 1024

Within the single Repository table that stores all events from all instances of the job, events are logged in timestamp order. Event ID exists only to establish uniqueness; there is no meaning to be attached to its value. Events from multiple instances are intermixed, depending on their arrival time...
by ray.wurlod
Thu Nov 29, 2007 1:40 pm
Forum: Site/Forum
Topic: Rating Posts
Replies: 0
Views: 1537

Rating Posts

Can we please have a -1 value for marking posts that are bad advice, or just plain wrong? The bar could show red, perhaps. Such responses would automatically be excluded from searches.
by ray.wurlod
Thu Nov 29, 2007 1:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job is Aborting with Insufficient System Resources
Replies: 2
Views: 962

Clearly at the server side Memory and Hardware Configuration resources are NOT sufficient, at the time when that error occurs. You may, for example, have run out of file units for that process. You may have had too many processes running at that time . Checking resources afterwards contributes nothi...
by ray.wurlod
Thu Nov 29, 2007 1:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looping a Job on Windows
Replies: 12
Views: 3390

Any Microsoft education center would probably be able to help you. There are lots of books out there, such as DOS For Dummies - it's not a DataStage problem that you want to learn batch programming. You might also acquire a UNIX emulator, such as MKS Toolkit or CygWin, that would mean that you can r...
by ray.wurlod
Thu Nov 29, 2007 1:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look-up based on 42 columns
Replies: 2
Views: 734

Maybe not. There is an upper limit to the physical size of a key in a hashed file. It is set by the MAXKEYSIZE configuration parameter (default value, from memory, is 768 bytes). There are considerable implications to increasing it; for example the GROUP.SIZE or separation parameter of the hashed fi...
by ray.wurlod
Thu Nov 29, 2007 1:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Vs Parallel
Replies: 3
Views: 1104

Start by defining "performance" in an ETL environment.
by ray.wurlod
Thu Nov 29, 2007 1:19 pm
Forum: General
Topic: Plugins
Replies: 1
Views: 1257

Have you, in fact, installed and registered the OCI plug-in stage?

Search the forum for the text of your error message; you just might find the answer!