Search found 53125 matches

by ray.wurlod
Sun Jan 23, 2011 11:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Optimize hashed file
Replies: 9
Views: 3790

When you do a lookup against a hashed file, it's random. (Parallel jobs read the entire reference data set into memory - server jobs do not.) The hashed file can only be loaded into memory if it's smaller than the read cache that you currently have configured (default 128KB from memory). The one rec...
by ray.wurlod
Sun Jan 23, 2011 2:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Questions regarding Hash files and hash file stage
Replies: 54
Views: 42070

GROUP.SIZE 1 = separation 4
GROUP.SIZE 2 = separation 8
Any other value in HFC will cause a warning message to be displayed.
The CREATE.TABLE statement generated by HFC will include a GROUP.SIZE 2 clause if required. GROUP.SIZE 1 is the default, so does not have to be included.
by ray.wurlod
Sun Jan 23, 2011 2:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Optimize hashed file
Replies: 9
Views: 3790

Think about the size of this hashed file on disk, and the amount of disk head movement required when pages in the hashed file are being accessed randomly.
by ray.wurlod
Sun Jan 23, 2011 2:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Searching for a row in data browser of hashfile takes time
Replies: 1
Views: 1134

Key searches in hashed file use the hashing algorithm to go directly to the page on which the record is stored. View Data has to scan through a buffer into which it has loaded the hashed file's contents.
by ray.wurlod
Sun Jan 23, 2011 2:22 pm
Forum: General
Topic: web console user creation
Replies: 9
Views: 3617

Just curious - under what ID did you run the DirectoryAdmin tool?
by ray.wurlod
Sun Jan 23, 2011 3:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Capture Log and store it into Db2 DB
Replies: 6
Views: 2937

If your repository is DB2 and you're using logging to the common repository, then your logs are already in DB2.

Otherwise I'd recommend using a server job, because in the local repository hashed files are used to store job logs and server jobs are specifically equipped to deal with hashed files.
by ray.wurlod
Sat Jan 22, 2011 7:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join/Lookup Logic
Replies: 3
Views: 2035

Can you do this join in the database, with B.column1 indexed? Is it table B that has the millions of records? If not, do the range lookup first, then the left outer join downstream of that.
by ray.wurlod
Sat Jan 22, 2011 5:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Extract and Load many tables - Short and fast
Replies: 8
Views: 3092

Execute Command ---> User Variables ---> Start Loop <------- End Loop | ^ | | +-----> Job -----+ In the Execute Command activity list the file using cat or type command. In the User Variables activity convert any @FM (line terminators) in the command output into some useful delimiter characters tha...
by ray.wurlod
Sat Jan 22, 2011 5:03 pm
Forum: General
Topic: web console user creation
Replies: 9
Views: 3617

There are such scripts, and XML files. Your official support provider will guide you through the process. (It would be dangerous - not least legally - for us to attempt to do so lacking the complete knowledge of your system that you will provide to your support provider using the MustGather guidelin...
by ray.wurlod
Sat Jan 22, 2011 4:59 pm
Forum: General
Topic: Banking Project??
Replies: 3
Views: 1704

As a general rule we (I, at least) do not provide answers to interview questions, on the grounds that it is the candidate's own knowledge that is being investigated in the interview. We are happy to help with questions of the nature of "have I got this right?" but do not supply answers &q...
by ray.wurlod
Fri Jan 21, 2011 10:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Running & Link Color
Replies: 3
Views: 2769

Job monitor app not running.
by ray.wurlod
Fri Jan 21, 2011 10:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Process meta data not available in database
Replies: 5
Views: 3625

How strange. When I did an exact search for "Process meta data not available in database" it got 17 hits (including this thread).
by ray.wurlod
Fri Jan 21, 2011 7:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: "Issue to convert "Interger to Decimal"
Replies: 1
Views: 976

Welcome aboard. What's "not working" about your job design? What are you expecting to get and what are you getting?
by ray.wurlod
Fri Jan 21, 2011 2:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change data from source file to target?
Replies: 7
Views: 3380

Or use pxEreplace() function, documented on DSXchange.
by ray.wurlod
Fri Jan 21, 2011 1:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Extract and Load many tables - Short and fast
Replies: 8
Views: 3092

You can put the loop in a sequence, perhaps driving the loop from a query against the source system's system tables to derive a list of table names to be transferred.