Search found 53125 matches

by ray.wurlod
Wed Jun 25, 2014 4:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Files, SDK Sequences and Q-Pointers
Replies: 4
Views: 3966

What stage are you talking about? If the stage is still supported in version 9.1 (and most are) then you won't need to re-compile. If you want to add new stage types then, obviously, you are changing the job design and would need to compile after the change has been wrought. None of this discussion ...
by ray.wurlod
Wed Jun 25, 2014 4:01 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance stats and no. of rows in source does not match
Replies: 7
Views: 3615

Hence my second question.
by ray.wurlod
Wed Jun 25, 2014 3:57 pm
Forum: General
Topic: Error creating a project
Replies: 6
Views: 2190

Although the GRANT command is executed in a project, it has universal scope. It can also be executed from the UV account.

Note also that, by default, local user and domain\user are treated differently by the GRANT command. The system can be configured so that they are treated identically.
by ray.wurlod
Wed Jun 25, 2014 1:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: IN logic in Datastage
Replies: 6
Views: 2079

You could probably use Transformer looping to process this. Initialize a stage variable to the number of comma-delimited elements in the parameter value. The loop exit condition compares @ITERATION system variable with this value. Use the Field() function to extract each value and then perform the t...
by ray.wurlod
Wed Jun 25, 2014 1:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: IN logic in Datastage
Replies: 6
Views: 2079

I think ssnegi has missed the vital point that the list will be dynamic. :(
by ray.wurlod
Wed Jun 25, 2014 1:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance stats and no. of rows in source does not match
Replies: 7
Views: 3615

Hashed files (and please note it's not "hash" file) destructively overwrite records if the key (as identified in metadata) is the same.

Do you have duplicate keys coming from source?

Are there any other constraints in your job design that might limit the number of rows to 20?
by ray.wurlod
Tue Jun 24, 2014 10:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Troubles reading UTF8 files with DataStage.
Replies: 2
Views: 3937

You can't, because it's not.

Done properly, DataStage merely stores what the metadata retrieval mechanism for the database reports.
by ray.wurlod
Tue Jun 24, 2014 7:39 pm
Forum: General
Topic: Oracle Database Parameter Help
Replies: 5
Views: 1754

As Arnd suggested, you can write a script (using dsjob calls) or a job to traverse all the logs of all the jobs in the project. You can also do this with a routine (creating a select list of job names). It would make sense only to traverse the most recent execution of each job from its log - use the...
by ray.wurlod
Tue Jun 24, 2014 5:58 pm
Forum: General
Topic: Upgrade from DS 7.5 to 9.1 - metadata
Replies: 1
Views: 1092

You will be exporting your projects anyway. When you import them into the new system DataStage metadata will be taken care of automatically.
by ray.wurlod
Mon Jun 23, 2014 10:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is it possible encrypt data while they are extracted?
Replies: 6
Views: 2318

1. The SQL might have an ENCRYPT function (or you could write one yourself). 2. You could export from source and pipe through an extraction utility before sending to DataStage. 3. You could perform the encryption in DataStage as the extracted data stream in (for example using External Filter stage t...
by ray.wurlod
Mon Jun 23, 2014 7:10 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: Business rules
Replies: 15
Views: 13161

I concur entirely with Stuart. IA has no inherent concept of meaning; it gives one frequency distributions of values, formats, etc., but it is not the tool even for identifying similar spelling (though sorting by value in the analysis results may help somewhat in making these visible). You (and/or a...
by ray.wurlod
Mon Jun 23, 2014 4:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Repartitioning
Replies: 3
Views: 1478

Repartitioning theoretically requires to move rows to other nodes (partitions). On MPP/cluster/grid environments this may mean moving rows over the network (TCP/IP), which degrades performance somewhat. However, on an SMP ("share everything") environment, one copy of the data are kept in s...
by ray.wurlod
Sun Jun 22, 2014 4:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error while compling the stage
Replies: 6
Views: 3003

Can you compile other jobs with Transformer stages? This error often suggests that you don't have a supported C++ compiler or that the license for the same has expired.
by ray.wurlod
Sun Jun 22, 2014 4:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: is a non-ref input link mandatory for Column Generator Stage
Replies: 1
Views: 1335

Basically a Column Generator stage adds columns to an input stream. It cannot generate rows out of thin air. For that you need a Row Generator stage.
by ray.wurlod
Fri Jun 20, 2014 2:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Eliminating Similar rows
Replies: 6
Views: 1696

Use a fork join design, with one side of the fork counting rows (grouped by keys). Filter the result so that only keys with a count of 1 are transferred to output.