Search found 336 matches

by Raftsman
Thu Dec 17, 2009 12:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logoc Question - Looping
Replies: 2
Views: 1501

After reviewing the task, I created a Temp file that contains all sequence numbers between 1 and 20. Using this, I do a range lookup comparing the values between the low and high, funnel the records back into the stream and I get my result.

It's not pretty but it works.

Thanks
by Raftsman
Thu Dec 17, 2009 7:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logoc Question - Looping
Replies: 2
Views: 1501

Logoc Question - Looping

I have a requirement to produce multiple records from one input. i.e. ColA ColB Low High EE AA 10 12 My requirement is to end up with the following EE AA 10 EE AA 11 EE AA 12 For each input I must create multiple records that fall between the low and high of the input record. I tried using a range l...
by Raftsman
Fri Nov 06, 2009 3:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD - Architecture
Replies: 6
Views: 2118

So what does AUTO do. Would it not take care of this. We do not have to partition and presort the lookup stage. I would of assumed the same.
by Raftsman
Fri Nov 06, 2009 2:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD - Architecture
Replies: 6
Views: 2118

So did I until I ran into serious issues with the stage. We have implemented this stage in all our EDW and now we are second guessing the way it works. I am just looking for a simple answer, does the stage do it lookup in memory or is it like a join. If it's like a join, then we have serious issues....
by Raftsman
Fri Nov 06, 2009 1:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Different versions of DataStage on the same box
Replies: 2
Views: 1604

Yes, but you will need to keep two directories of Datastage. One with 7.5 and the other with 8.0. You can toggle between them using the Multi-Client Module.
by Raftsman
Fri Nov 06, 2009 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD - Architecture
Replies: 6
Views: 2118

SCD - Architecture

What is the design architecture of the SCD? Is it the SCD stage a lookup with extra functionality or it is a join stage with extra functionality. We are not if we need to sort and repartition keys prior to entering the stage. Is the lookup done in memory? We are not sorting and repartitioning key an...
by Raftsman
Fri Nov 06, 2009 12:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS Version 8 on Windows Platform
Replies: 1
Views: 1063

We are running two versions on the Windows platform, 8.0.1 and 8.1. When we went from 7.5.2 to 8.0, it was a horrible transition. Once we moved to 8.0.1, all of our conversion issues went away. My recommendation is to go to version 8.1. It's the latest and we have seen improvement in functionality a...
by Raftsman
Wed Nov 04, 2009 2:00 pm
Forum: Enhancement Wish List
Topic: New Category - IBM Datastage Fixes
Replies: 1
Views: 3128

New Category - IBM Datastage Fixes

It would be nice to have a location where Datastage Licensed owners can post APAR for applied patches to their systems. In the last week we have applied three patches for version 8.0.1 and version 8.1 to fix various problems that other will surely have. Opening up PMR works well but it would be nice...
by Raftsman
Wed Oct 14, 2009 7:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pros and Cons of DS Windows vs Unix
Replies: 4
Views: 2047

Bring in the vendor, they can help elaborate on the pros and cons. I have worked in both OS's and the DS software works better on Unix but as far as functionality, I have seen little difference. Most of the issues are related to memory management.
by Raftsman
Fri Sep 11, 2009 6:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage 8.0.1 Installation Issue - Please HELP
Replies: 3
Views: 2818

Why are you installig this version. Datastage 8.1 is available and the latest software. 8.0.1 will require Fixpack 2
by Raftsman
Fri Sep 11, 2009 6:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aggregator showing different count for different runs
Replies: 3
Views: 2045

If you have AUTO partitioning selected, would it not sort and partition before aggregating. I used to sort and partition the data prior to the aggregate and then I experimented with a few different ways. With AUTO my totals were identical even with 13 million rows.
by Raftsman
Tue Sep 01, 2009 1:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Master Sequence
Replies: 3
Views: 1109

And if I want to start a child from where it left off, is there a way to run it from the Master (once the checkpoint is turned off).
by Raftsman
Tue Sep 01, 2009 11:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Master Sequence
Replies: 3
Views: 1109

Master Sequence

I have a Master sequence that calls other child sequences. I have restart ability set on the child sequences. The Master is schedule nightly. Is there a way (without manual interation) so that the Master runs from the start even if the child sequences abort the night before. I want to control the se...
by Raftsman
Fri Aug 28, 2009 1:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issues with Job running on multiple nodes
Replies: 7
Views: 1927

If your volume is small, only on node will be used. Increasing nodes doesn't necessarily mean better throughput. It may take longer for the job to setup with 4 nodes. Add both the startup and CPU time to determine which is the optimal setting. I have found that one node is more efficient most of the...
by Raftsman
Mon Aug 17, 2009 12:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Stages information
Replies: 1
Views: 1265

Look under Start ==> IBM Information Server and you will find the documentation. It will explain the SCD stage.