Search found 15603 matches

by ArndW
Fri May 26, 2006 10:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: What are the various parameters needed for ETL performance
Replies: 8
Views: 2960

The original question is like asking "What can I do to tune my vehicle" in a car forum and can't really be answered, at least directly. Reading and writing data takes a long time. Try to read and write and "land" data to disk as few times as possible. This approach (while not always correct) usually...
by ArndW
Fri May 26, 2006 7:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with Sample stage
Replies: 1
Views: 568

The sum of your 10, 25, and 40 do not add up to 100% of the records, so you will be getting less rows than 10%, 25% and 40% of the total. Random number generators are not truly random, the algorithms are designed so that with the same "seed" number they will always generate the same sequence of pseu...
by ArndW
Fri May 26, 2006 6:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: datastage shudular
Replies: 7
Views: 1890

DataStage does not have a scheduler. It uses the default Windows AT or UNIX cron for scheduling.
by ArndW
Fri May 26, 2006 6:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: efforts estimation in datastage
Replies: 10
Views: 2686

ray.wurlod wrote:The Hawk release includes some quite impressive estimation tools.


I just walked out of a presentation of Hawk and the estimation tool is for file sizes and disk requirements but not for design effort. It would have been nice to see something like that, though...
by ArndW
Fri May 26, 2006 6:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Jobs Error
Replies: 3
Views: 1879

This is not an error, but a warning. DataStage is stating that the partitions of the input stream are being changed to just 1 stream because you are writing to a sequential file. This is documented in the Parallel Job Developers Guide.
by ArndW
Fri May 26, 2006 6:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequencer is getting aborted continuously
Replies: 11
Views: 2672

It isn't worth fixing the DSU.ExecSH until you know if this is the only problem, please do what Ray suggested to see how much might be missing.
by ArndW
Fri May 26, 2006 3:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to save the Job
Replies: 8
Views: 2067

You have some internal corruption in your DataStage project that you need to fix before continuing with this job. Start off with the DS.TOOLS and see if the reindexing option shows any errors on any of the internal files.
by ArndW
Fri May 26, 2006 3:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: date conversion problem
Replies: 2
Views: 816

Moderator - please remove this duplicate
by ArndW
Fri May 26, 2006 3:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: protecting the selected category of jobs inside the project
Replies: 8
Views: 2475

Changing protection within a project for different cateogries is not part of the normal scope of DataStage. It is better to split this into 2 projects and do the protection at a project level.
by ArndW
Thu May 25, 2006 5:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling rejected Records
Replies: 7
Views: 1717

The source won't have any rejected records, but when writing to the target in PX you can (in most cases) put a link coming out of the target stage that will contain the rejects. This is documented in the Parallel Job Developer's Guide in the section for the particular database stage.
by ArndW
Thu May 25, 2006 5:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequencer is getting aborted continuously
Replies: 11
Views: 2672

That error message points to a corrupt project, as that routine is read-only and should always be present. Is this a new project, or has something catastrophic happened to it recently? Look in your Manager -> Routines -> Built-in -> Before/After. Is there a "ExecSH" located there? If you go to TCL o...
by ArndW
Thu May 25, 2006 5:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date conversion problem
Replies: 20
Views: 5551

Which stage are you using to write to Oracle?
by ArndW
Thu May 25, 2006 4:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data storage standards.
Replies: 1
Views: 566

There is no standard, but most character data fields do need to be stored in mixed case and rely on differentiation between upper and lower case. Names, Addresses and clear text become almost unreadable in uppercase; but some key/code/mnemonics columns should be in one case or the other to avoid ina...
by ArndW
Thu May 25, 2006 4:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Date conversion problem
Replies: 20
Views: 5551

Are you sure that your default date format is being used? Execute a SQL "SELECT sysdate from dual;" using your favorite tool and see if that format matches yours.
by ArndW
Wed May 24, 2006 7:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: NLS query
Replies: 2
Views: 4451

Katz, the display data mode has always been a bit troublesome and particularly so when working with multibyte data. You should write your data to a sequential file and view the data in the file. I have a suspicion that you settings are being interpreted correctly, but are being shown incorrectly in ...