Search found 81 matches

by blewip
Tue May 27, 2014 1:55 am
Forum: General
Topic: Cluster vs SMP
Replies: 10
Views: 6308

I can imagine.

Everyone really hopes you are right!
by blewip
Thu May 22, 2014 8:45 am
Forum: General
Topic: Cluster vs SMP
Replies: 10
Views: 6308

Hi Eric Thanks for that, we are talking about just the engine tier. From what I can work out, an MPP Topology setup allows all the engine to be used at once. But if one goes down it says "A failure of single server will have a corresponding fractional impact on the total server resources that a...
by blewip
Thu May 22, 2014 2:28 am
Forum: General
Topic: Cluster vs SMP
Replies: 10
Views: 6308

Thanks for the replies. Just to clarify: With Grid the workload is shared over the available machines. If one goes down the work continues on the available machines. This has a cost though. With two boxes, there is the performance option, or the HA option. HA: Run on one box and the other box is sta...
by blewip
Wed May 21, 2014 4:13 am
Forum: General
Topic: Cluster vs SMP
Replies: 10
Views: 6308

Cluster vs SMP

The "Architect" here has decided that we will run a cluster configuration running the engines on 2 x 8 cpu linux boxes. He seems to think that this will give us high availability. I was wondering if this this is likely to be more performant than running the engine on a 16 cpu box. Also whi...
by blewip
Wed Dec 07, 2011 4:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: runLocally() did not reach EOF on its input data set 0
Replies: 9
Views: 6828

IBM bug

It's a bit late now I know, but I had this problem and found this https://www-304.ibm.com/support/docview.wss?uid=swg1JR38599 JR38599: Surrogate Key Stage generates spurious message: RUNLOCALLY() DID NOT REACH EOF ON ITS INPUTDATA SET 0. Problem conclusionThe surrogate-key stage was misinterpreting ...
by blewip
Tue Jul 05, 2011 6:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logic needed
Replies: 16
Views: 10829

Re: Logic needed

kittu.raja wrote: For example my input 3 columns are

Code: Select all

Col1   Col2    Col3
  1      a     1
  2      b     1/2
  3      c     1/2/3
  4      d     1/2/3/4
And which Column would be used for the key?
by blewip
Tue Jul 05, 2011 2:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logic needed
Replies: 16
Views: 10829

Run it sequentially If the data get partitioned it won't do what you want. False. If the data are partitioned properly it will do what is required. ... This is not false, this is what fixed the problem. The stated fix In "sequential file stage, the option 'Keep File partitions set to false'&qu...
by blewip
Mon Jul 04, 2011 10:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logic needed
Replies: 16
Views: 10829

Run it sequentially

If the data get partitioned it won't do what you want.
by blewip
Thu Jun 09, 2011 2:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding JOIN Stage
Replies: 5
Views: 3761

Re: Regarding JOIN Stage

blewip wrote:Both sides of the join need to be sorted on the key.
Thanks Soumya

So that's how you do a Sort
by blewip
Wed Jun 08, 2011 10:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding JOIN Stage
Replies: 5
Views: 3761

Re: Regarding JOIN Stage

It's not entirely clear from your example, however the 1,2,3,2 appear to be the key. Both sides of the join need to be sorted on the key.

In which case they should appear 1,2,2,3

Duplicates in the key will duplicate the output, there should be 4 output records of key 2.
by blewip
Wed Jun 08, 2011 10:36 am
Forum: General
Topic: IBM Information server client install replace ODBC drivers.
Replies: 4
Views: 3797

Yes there does appear to be IBM ODBC drivers (8.5).

However they appear to be in addition to the existing ODBC drivers
by blewip
Wed May 18, 2011 2:05 am
Forum: General
Topic: Pass parameter value file in Job sequence loop
Replies: 6
Views: 11637

Is the problem actually passing the details of which value file to use in the sequence? In the sequence parameters you can hard code it to any of the values. However the sequence doesn't seem to let you define a variable that will contain which value file to use? The only option I can think of is to...
by blewip
Tue May 17, 2011 7:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key Generator Stage---How It works ?
Replies: 4
Views: 6958

Re: Surrogate Key Generator Stage---How It works ?

I don't think there is a problem, the holes in the numbers will be inserted next time the table is loaded.

To resolve run sequentially
by blewip
Tue May 17, 2011 4:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key Generator Stage---How It works ?
Replies: 4
Views: 6958

Re: Surrogate Key Generator Stage---How It works ?

Depending which SK Stage you use and you get two different ones even with 8.5, the numbers are allocated to partitions in chunks. Therefore each partition goes through the numbers in the chunk and once finished asks for a new chunk. Therefore when comparing the numbers in each partition, it will pro...
by blewip
Wed May 11, 2011 9:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copying Surrogate state files - Will the values remain?
Replies: 10
Views: 5946

greggknight wrote:Also you don't need a peek stage to see the contents of a state file.
Just a generator and set the View stet file property to yes.
Sorry are you saying you can view the State file using the SK Generator Stage?

It's just that I can't see how.