Search found 53125 matches

by ray.wurlod
Thu Jan 18, 2007 7:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: FILE SET CREATION PROBLEM
Replies: 3
Views: 913

My guess (like Arnd's) is that you have partitioned on a column (or columns) that have a skewed distribution (or maybe only five distinct values). This is something you need to check. If you want even distribution of rows, choose Round Robin partitioning (or Modulus, if it's a single integer sequenc...
by ray.wurlod
Thu Jan 18, 2007 7:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file vs dataset in performance
Replies: 2
Views: 901

If the data are in a sequential file, you have to read the sequential file (even to get the data into a persistent Data Set). So there's no "either/or" about it.

Investigate "multiple readers per node" property of the Sequential File stage.
by ray.wurlod
Thu Jan 18, 2007 5:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed Lookups and Data Availability
Replies: 8
Views: 2210

Lock for update only sets a lock if the lookup fails (NOTFOUND is true). Yes, it does expect you to update the hashed file - isn't that the topic of this thread? When the job finishes any non-released locks will be released. (I suspect, but have not proven, that the lock is released when processing ...
by ray.wurlod
Thu Jan 18, 2007 5:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to find space used by ETL?
Replies: 5
Views: 1289

du supports the h option in Dilbert, as in "duh" and "induhvidual" :lol:
by ray.wurlod
Thu Jan 18, 2007 5:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sequence calling a sequence calling a sequnece
Replies: 4
Views: 1017

Modularity is what you are achieving, and typically it is a Good Thing.
by ray.wurlod
Thu Jan 18, 2007 5:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Invocation ID through dsjob
Replies: 6
Views: 5526

Not true in earlier versions, where the job status was actually output on stderr. I can't recall when this was "fixed", but it's somewhere in version 7.
by ray.wurlod
Thu Jan 18, 2007 3:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Analyzing parameters
Replies: 12
Views: 2428

Get some more knowledgable friends. The name of the file is DSParams, and the only job parameters stored there are those set up as environment variables in the Administrator client. Other parameters are properties of the job or shared container, and therefore are stored in the DS_JOBOBJECTS table in...
by ray.wurlod
Thu Jan 18, 2007 3:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Auto Archving of Logs
Replies: 7
Views: 1396

Are you still at RIL? I'm fairly certain there's already a routine there for doing just this task.
by ray.wurlod
Thu Jan 18, 2007 3:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reference lookup generated 100 rows
Replies: 7
Views: 1692

Please post those rows, so that others might check them. Also post the SQL statements from the reference input link and stream input link. Finally, advise what stage types you are using.
by ray.wurlod
Thu Jan 18, 2007 3:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed Lookups and Data Availability
Replies: 8
Views: 2210

Or, if you use the one hashed file, disable read cache and write cache, and enable lock for update when reading.
by ray.wurlod
Thu Jan 18, 2007 3:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: splitsingle row into multiple rows
Replies: 17
Views: 3587

Re: Hi

narsi1111 wrote:yes i don't have pivot stage

Wrong. You DO have the Pivot stage. You may have not installed it, but it's there on your DataStage CD and can be installed in seconds using the Package Installer.
by ray.wurlod
Thu Jan 18, 2007 3:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Start TIme and Job End Time
Replies: 3
Views: 1234

If you use DSGetJobInfo() from an after-job subroutine you can request the "interim status" - that is, the status with which the job will finish assuming it's not aborted by the after-job subroutine's ErrorCode argument.
by ray.wurlod
Thu Jan 18, 2007 3:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DW Certifications
Replies: 14
Views: 3742

IBM has no plans to offer a certification for server jobs.
by ray.wurlod
Thu Jan 18, 2007 3:42 pm
Forum: Data Quality Best Practices
Topic: how to use quality stage
Replies: 4
Views: 10684

Take the vendor's training class. This runs for four days. Rather more than be packed into responses here.
by ray.wurlod
Wed Jan 17, 2007 10:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: <transform> Error when checking composite operator: g+
Replies: 11
Views: 6013

I am the DBA who support DataStage 7.52.
... my background of Datastage is zero.


These statements are mutually antagonistic.