Search found 53125 matches
- Thu Apr 01, 2004 4:05 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Do Persistent Variables exist in DataStage 6?
- Replies: 7
- Views: 2245
The easiest and cheapest "persistent variable" for use between adjacent Transformer stages (or any active stage types) is an extra column on the link. The job itself has a "user status area" which acts like a single variable accessible from anywhere within the job. Its value is set using the DSSetUs...
- Thu Apr 01, 2004 3:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Is lookup stage an alternative to hash file stage
- Replies: 5
- Views: 4769
Your beliefs about hashed files (except the file names) being disk based are correct. However, nearly everyone enables pre-load for read, which is why I claim that they are - or, properly, can be - memory based. The file names are DATA.30, OVER.30 and .Type30. File sets and data sets are different i...
- Thu Apr 01, 2004 3:10 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Import Table definition
- Replies: 3
- Views: 927
It actually makes a difference. The Oracle stage types can use any of the data types that Oracle knows about, whereas the ODBC path means that everything has to be translated into ODBC-compliant terminology. For a very simple example, Oracle's VARCHAR2 is known as VARCHAR in ODBC. Dates can be a nig...
- Thu Apr 01, 2004 3:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Is lookup stage an alternative to hash file stage
- Replies: 5
- Views: 4769
Well, you're part way there. In the PX environment you get the choice of three stages that do in-memory "joins" (the Join stage, the Lookup stage and the Merge stage). You have to select the correct tool. Read about them in the Parallel Job Developer's Guide . (If you think about it, what you were d...
- Thu Apr 01, 2004 1:17 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Import Table definition
- Replies: 3
- Views: 927
Definitely! Simply use the appropriate Stage type, for example ORAOCI8 for Oracle 8. When importing, choose Import > Table Definition > Plug-In Metadata Definitions - you will be presented with a list of plug-in (= optionally installed) stage types installed on your server. Choose the correct one an...
- Thu Apr 01, 2004 1:12 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Get Job Status from Command Line
- Replies: 3
- Views: 2057
Not from the UniVerse command line, unless you know the internal structure in the Repository where status is recorded (it's based on a concept of "resources" - active stages that run in separate processes are also "resources"). You can, however, use the dsjob command from the operating system comman...
- Thu Apr 01, 2004 1:07 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Is lookup stage an alternative to hash file stage
- Replies: 5
- Views: 4769
The PX engine does not know about hashed files. The only way you can use them is to encapsulate a server job in a shared container, and run that in the parallel environment. Probably more trouble than it's worth; the datasets used by the Lookup stage (and the other stages that can do reference looku...
- Thu Apr 01, 2004 1:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: SQL Tuning
- Replies: 6
- Views: 4380
Most databases have some way to force extra (parallel) tasks to be used in processing a query. The real skill is in being able to determine when extra tasks will be useful. If some other aspect of your query demands single-threading, you can request hundreds of extra tasks, but you won't get them. F...
- Wed Mar 31, 2004 8:41 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Putting value from Oracle select statement into job parametr
- Replies: 2
- Views: 1337
Welcome aboard! There are several techniques. The one that most closely adheres to the GUI model is to run a separate job that fetches the row in question into a text file. You run this from a job control routine which then reads the file and uses the values therein to set parameter value(s) in the ...
- Wed Mar 31, 2004 4:19 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Lookup & update of HashFile from same transformer
- Replies: 13
- Views: 3896
You could do it but for a fundamental rule in DataStage; no passive stage can open any of its outputs until all its inputs are closed. It has always been thus. The per-compiler detects this situation and reports a cyclic dependency if the input and output links come from the same active stage. That'...
- Wed Mar 31, 2004 4:15 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: UV Stage
- Replies: 3
- Views: 1852
Just reverse your logic, and SCD becomes straightforward. Hashed file stage can only be used for "=" lookup on the key - that's exactly what it's for. UV stage can access the same structure, but perform totally general queries; it's more flexible and therefore not quite as fast. In summary: pre-load...
- Wed Mar 31, 2004 4:08 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: CLEAR.FILE
- Replies: 8
- Views: 3090
- Wed Mar 31, 2004 4:05 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Differences between Job control routines and Job scheduler
- Replies: 3
- Views: 1286
Job Sequencers are GUIs that, when you "compile" them, write job control routines that you can inspect. Job control routines are inspected on the Job Properties window Job Control tab. In some situations a job sequencer can do everything you need. In other situations a job sequencer can be used to g...
- Wed Mar 31, 2004 3:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: &PH& jobnotify error 911
- Replies: 8
- Views: 2329
Segmentation violation is ultimately an operating system error, though caused by software attempting to access a memory address which either does not exist or to which they have no rights. Read the man page on signal() for more information. I decoded the 911 using DataStage's SYS.MESSAGE table, in w...
- Tue Mar 30, 2004 8:39 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Parameters to UNIX shell scripting from Routine
- Replies: 9
- Views: 2641
That's a test from the Test Grid for a DataStage Routine. If you want that (rather than a shell script) analyzed, you'll need to post the code. The routine has called DSLogInfo() with the first variable containing a lot of junk - perhaps the OREIGN comes from FOREIGN KEY. Anyway, post the Routine so...