Search found 53125 matches

by ray.wurlod
Wed Aug 06, 2003 12:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: question on using mkdbfile
Replies: 13
Views: 3587

To answer the original question, which I did not read closely enough, mkdbfile does not create a complete hashed file; it creates only one portion. To create a data portion and a dictionary portion, you need two mkdbfile commands, and none of this populates the file dictionary. For example (assuming...
by ray.wurlod
Wed Aug 06, 2003 12:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Buffering values in Stage Variables
Replies: 12
Views: 2653

No, because the output links are out of scope when evalating stage variables.
Will post some examples of what I'm on about probably next week (currently conducting non-DataStage training, so no access to DS).
by ray.wurlod
Tue Aug 05, 2003 4:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Buffering values in Stage Variables
Replies: 12
Views: 2653

Not always true, since you can refer to the current column value from the input link. The trick is to remember the order of execution in a Transformer stage: (1) main (stream) input link (2) reference input links (order can be specified) (3) stage variables (4) output links (order can be specified) ...
by ray.wurlod
Tue Aug 05, 2003 4:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Preload file to memory
Replies: 6
Views: 1388

With only 20 rows (probably only one or two groups), the hashed file is probably going to be resident in memory whether or not you use the pre-load to memory option. I don't believe it would make that much difference in this case.

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Tue Aug 05, 2003 4:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: question on using mkdbfile
Replies: 13
Views: 3587

The Hashed File Calculator (on the CD under unsupported options) will generate a mkdbfile command, yea even unto the -64bit option. [8D]

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Tue Aug 05, 2003 3:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: key expression in transformer
Replies: 7
Views: 1748

That's very odd, because they refer to the same thing. A hashed file is how a UniVerse table is implemented. The only real difference is that, if you create/access it via a UV stage, it has entries in the system tables, and it enforces data types. If you really must do this, you don't really have mu...
by ray.wurlod
Tue Aug 05, 2003 3:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: using sequence number in parallel jobs
Replies: 2
Views: 830

Why were you expecting NUMERIC(10), and what's the problem working with DECIMAL(38,10)? Once the number gets into DataStage it's actual data type is irrelevant. How were you planning to sustain generation of a sequential key over parallel streams? If you're going back to the sequence for every row p...
by ray.wurlod
Tue Aug 05, 2003 12:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Different format in a flat file???
Replies: 8
Views: 1767

I implemented just what Vladimir suggested some time ago on a 5.2 system, where the sequential file was multi-GB (too big, in the client's opinion, to consider pre-processing). They were totally happy with this solution, as it required only a single pass through the file. Ray Wurlod Education and Co...
by ray.wurlod
Tue Aug 05, 2003 12:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing data to a sequential file
Replies: 8
Views: 1888

Even Megabytes per minute rather than bytes per second, as this smooths out statistical wrinkles. Ultimately, though, the key performance indicator in ETL is finishing within the allocated time window (that is, elapsed time). There are a couple of ways to get the last line. One is to pre-process the...
by ray.wurlod
Mon Aug 04, 2003 8:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Parallel on Windows NT
Replies: 4
Views: 810

You can create PX jobs on a Windows platform at DS 6.0.
However, you can not compile them (or run them) there because the underlying Orchestrate technology had not been ported to this platform in time for this release.

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Mon Aug 04, 2003 4:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: integer to string
Replies: 3
Views: 15666

In a Transformer stage, do nothing! On the input link declare its data type as SmallInt/Integer. On the output link declare its data type as Char/VarChar. This works because the DataStage Engine is flexible about data types internally. Ray Wurlod Education and Consulting Services ABN 57 092 448 518
by ray.wurlod
Sun Aug 03, 2003 2:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: execute DS Basic from a shell script
Replies: 2
Views: 800

If you use the command with insufficient command line options, for example "dsjob" or "dsjob -run", it displays the required syntax.

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Sun Aug 03, 2003 2:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Best Practices Class
Replies: 5
Views: 1452

In fact I was never employed by Ascential; I was sold to IBM at the time of the big split. In Australia you will discover that DS306 is presented on demand; contact Lucy Luzza to get on the waiting list: (lucy.luzza@ascentialsoftware.com, or +61 3 8517 5400). Ascential Singapore may be better for yo...
by ray.wurlod
Fri Aug 01, 2003 5:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unix Server PATH for jobs?
Replies: 11
Views: 1965

DataStage itself does not use PATH. Every internal command is accessed with a fully qualified pathname. The bits that are in BASIC for example use an include record called FILENAMES.H (it's in the UNIVERSE.INCLUDE file) that pre-computes the various engine pathnames and loads them into variables tha...
by ray.wurlod
Fri Aug 01, 2003 5:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: New Installation - port -connection issues etc
Replies: 2
Views: 548

It is simply not possible to install DS 5.2 without a project. Therefore one can conclude that the installation was not complete. You should have a couple of hidden files in the root directory: /.uvhome (/.dshome at later versions) /.unishared The first of these contains the pathname of the UV accou...