Search found 53125 matches

by ray.wurlod
Sun Jul 30, 2006 8:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Extract repeating structure from sequential file
Replies: 2
Views: 878

Welcome aboard. :D

What you are seeking to do is called a "horizontal pivot" and is performed by the Pivot stage. Read its manual (pivot.pdf) for a good description of how to use it.
by ray.wurlod
Sun Jul 30, 2006 8:16 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: Can not create PSDB
Replies: 11
Views: 8433

Thanks for suggestions. Will check PATH. The Test button on the ODBC configuration tool reports that connection successful. It's version 7.5.1 of ProfileStage; the setup utiility includes 10g as an option in the drop-down list for Oracle PSDB, and Windows 2003 is a supported platform. The same error...
by ray.wurlod
Sun Jul 30, 2006 8:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_PM_PLAYER_TIMING question
Replies: 4
Views: 1261

Your generator is running in sequential mode, only on partition 0. Its CPU figure is 0.11. The Peek stage, however, runs in parallel mode, and there is therefore a pair of entries for that stage from each partition (2(b) and 3(b) in your listing), each of which shows 0.11 for CPU seconds. This job o...
by ray.wurlod
Sun Jul 30, 2006 8:44 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Can not create PSDB
Replies: 11
Views: 8433

Can not create PSDB

Client: Windows 2003 Server sp1 Server: Windows 2003 Server sp1, Oracle 10gR1 Oracle properly set up, with database STATWH configured and accessible via SQL*PLUS both from client and server machines. ProfileStage client, message switch and analysis server already installed on Client machine. I now a...
by ray.wurlod
Fri Jul 28, 2006 2:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Explanation of APT_DUMP_SCORE output
Replies: 8
Views: 4010

ray, I would appreciate it very much if you could answer the fastname question as well. That WAS the answer to the fastname question. There are two partitions (nodes) on which op1 executed. Consider lemond.torrent.com. They can't be the node name from the configuration file, because node names must...
by ray.wurlod
Fri Jul 28, 2006 2:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File Stage server vs parallel
Replies: 4
Views: 1532

Welcome aboard. :D

You are correct to assert that the interface is different, remember that the parallel version must take into account the need to split the rows into multiple parallel streams.

Is there anything in particular about which you want to ask concerning the parallel CFF stage?
by ray.wurlod
Fri Jul 28, 2006 2:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Explanation of APT_DUMP_SCORE output
Replies: 8
Views: 4010

thomsonp, thank you very much for you response. I have a few more questions to you and ray. a)Line 1: Does that mean that the entire job has 1 data set stage? b)Line 2: ds0: It probably is referring to the first dataset, right? {op0[1p] (sequential generator) : First dataset operates on the second ...
by ray.wurlod
Fri Jul 28, 2006 2:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Explanation of APT_DUMP_SCORE output
Replies: 8
Views: 4010

splayer wrote:How do you know that the two processes have the same fastname? Shouldn't there be a fastname keyword first?


16) lemond.torrent.com[op1,p0]
17) lemond.torrent.com[op1,p1]

This is operator #1 on partitions #0 and #1. All counting begins from zero (since it's C underneath).
by ray.wurlod
Fri Jul 28, 2006 8:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Insert a dummy record if file is empty
Replies: 7
Views: 2480

The Sequential File stage may use a filter command. You enable this via a check box. The output of that filter command is then read by the stage. If your filter command tests for the size of the file, using test or wc command, then its result (zero or non-zero) can be used to generate the row. After...
by ray.wurlod
Fri Jul 28, 2006 4:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: inserting timestamp into database
Replies: 11
Views: 2337

It's certainly not a valid number - it has two "-" characters in it for a start. What is the data type of the target column? Are you using generated or user-defined SQL?
by ray.wurlod
Fri Jul 28, 2006 4:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message when changing lookup stage to a join stage
Replies: 6
Views: 1524

You've got a Sequential File stage downstream of the Join stage. For the Join stage you have had to partition the data based on key value. The message is essentially telling you that the Sequential File stage does not operate in parallel, so cannot preserve the partitioning specified for the Join st...
by ray.wurlod
Fri Jul 28, 2006 4:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to implement typ2 SCD in PX
Replies: 3
Views: 2238

You must make sure that data from target and source are identically partitioned so that all valid comparisons are correctly made. Loading dimesion (parent) tables first if the natural key does not already exist, insert a new row. If the natural key does exist in the target check for differences in r...
by ray.wurlod
Fri Jul 28, 2006 4:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Explanation of APT_DUMP_SCORE output
Replies: 8
Views: 4010

c) The three processes are shown in the score; op0 operates on one node, but op1 operates on two nodes. Hence three processes on two nodes. Even though the two nodes have the same fastname, they count as separate nodes. BTW some passive stages DO lead to operators; typically import or export operato...
by ray.wurlod
Fri Jul 28, 2006 4:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage career question. Please advise.
Replies: 8
Views: 2351

I have now had experience in many different business milieux (what iamnagus was calling Domains), but had to get started in one. Success there led to others. The business analysts and subject matter experts are other people - I use their output as my input.
by ray.wurlod
Fri Jul 28, 2006 4:31 am
Forum: IBM QualityStage
Topic: Regarding M and u probability?
Replies: 5
Views: 2263

These are discussed in some detail in the QualityStage Essentials class offered by IBM. Have you done this class?
The one is essentially a measure of the probability of a match, while the other is a measure of the probability that, if a match is found, it might have occurred by chance.