Search found 53125 matches

by ray.wurlod
Thu Apr 01, 2004 4:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Do Persistent Variables exist in DataStage 6?
Replies: 7
Views: 2245

The easiest and cheapest "persistent variable" for use between adjacent Transformer stages (or any active stage types) is an extra column on the link. The job itself has a "user status area" which acts like a single variable accessible from anywhere within the job. Its value is set using the DSSetUs...
by ray.wurlod
Thu Apr 01, 2004 3:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is lookup stage an alternative to hash file stage
Replies: 5
Views: 4769

Your beliefs about hashed files (except the file names) being disk based are correct. However, nearly everyone enables pre-load for read, which is why I claim that they are - or, properly, can be - memory based. The file names are DATA.30, OVER.30 and .Type30. File sets and data sets are different i...
by ray.wurlod
Thu Apr 01, 2004 3:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Import Table definition
Replies: 3
Views: 927

It actually makes a difference. The Oracle stage types can use any of the data types that Oracle knows about, whereas the ODBC path means that everything has to be translated into ODBC-compliant terminology. For a very simple example, Oracle's VARCHAR2 is known as VARCHAR in ODBC. Dates can be a nig...
by ray.wurlod
Thu Apr 01, 2004 3:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is lookup stage an alternative to hash file stage
Replies: 5
Views: 4769

Well, you're part way there. In the PX environment you get the choice of three stages that do in-memory "joins" (the Join stage, the Lookup stage and the Merge stage). You have to select the correct tool. Read about them in the Parallel Job Developer's Guide . (If you think about it, what you were d...
by ray.wurlod
Thu Apr 01, 2004 1:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Import Table definition
Replies: 3
Views: 927

Definitely! Simply use the appropriate Stage type, for example ORAOCI8 for Oracle 8. When importing, choose Import > Table Definition > Plug-In Metadata Definitions - you will be presented with a list of plug-in (= optionally installed) stage types installed on your server. Choose the correct one an...
by ray.wurlod
Thu Apr 01, 2004 1:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Get Job Status from Command Line
Replies: 3
Views: 2057

Not from the UniVerse command line, unless you know the internal structure in the Repository where status is recorded (it's based on a concept of "resources" - active stages that run in separate processes are also "resources"). You can, however, use the dsjob command from the operating system comman...
by ray.wurlod
Thu Apr 01, 2004 1:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is lookup stage an alternative to hash file stage
Replies: 5
Views: 4769

The PX engine does not know about hashed files. The only way you can use them is to encapsulate a server job in a shared container, and run that in the parallel environment. Probably more trouble than it's worth; the datasets used by the Lookup stage (and the other stages that can do reference looku...
by ray.wurlod
Thu Apr 01, 2004 1:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SQL Tuning
Replies: 6
Views: 4380

Most databases have some way to force extra (parallel) tasks to be used in processing a query. The real skill is in being able to determine when extra tasks will be useful. If some other aspect of your query demands single-threading, you can request hundreds of extra tasks, but you won't get them. F...
by ray.wurlod
Wed Mar 31, 2004 8:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Putting value from Oracle select statement into job parametr
Replies: 2
Views: 1337

Welcome aboard! There are several techniques. The one that most closely adheres to the GUI model is to run a separate job that fetches the row in question into a text file. You run this from a job control routine which then reads the file and uses the values therein to set parameter value(s) in the ...
by ray.wurlod
Wed Mar 31, 2004 4:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Lookup & update of HashFile from same transformer
Replies: 13
Views: 3896

You could do it but for a fundamental rule in DataStage; no passive stage can open any of its outputs until all its inputs are closed. It has always been thus. The per-compiler detects this situation and reports a cyclic dependency if the input and output links come from the same active stage. That'...
by ray.wurlod
Wed Mar 31, 2004 4:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: UV Stage
Replies: 3
Views: 1852

Just reverse your logic, and SCD becomes straightforward. Hashed file stage can only be used for "=" lookup on the key - that's exactly what it's for. UV stage can access the same structure, but perform totally general queries; it's more flexible and therefore not quite as fast. In summary: pre-load...
by ray.wurlod
Wed Mar 31, 2004 4:08 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CLEAR.FILE
Replies: 8
Views: 3090

The hidden file .uvnlsmap should not be deleted, and is not deleted by CLEAR.FILE.
This records the NLS character map used for this particular directory.
It is only present if NLS is installed.
by ray.wurlod
Wed Mar 31, 2004 4:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Differences between Job control routines and Job scheduler
Replies: 3
Views: 1286

Job Sequencers are GUIs that, when you "compile" them, write job control routines that you can inspect. Job control routines are inspected on the Job Properties window Job Control tab. In some situations a job sequencer can do everything you need. In other situations a job sequencer can be used to g...
by ray.wurlod
Wed Mar 31, 2004 3:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: &PH& jobnotify error 911
Replies: 8
Views: 2329

Segmentation violation is ultimately an operating system error, though caused by software attempting to access a memory address which either does not exist or to which they have no rights. Read the man page on signal() for more information. I decoded the 911 using DataStage's SYS.MESSAGE table, in w...
by ray.wurlod
Tue Mar 30, 2004 8:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Parameters to UNIX shell scripting from Routine
Replies: 9
Views: 2641

That's a test from the Test Grid for a DataStage Routine. If you want that (rather than a shell script) analyzed, you'll need to post the code. The routine has called DSLogInfo() with the first variable containing a lot of junk - perhaps the OREIGN comes from FOREIGN KEY. Anyway, post the Routine so...