Search found 15603 matches

by ArndW
Thu Jul 12, 2007 12:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding DATE.TAG function
Replies: 6
Views: 2331

Both return an SQL date type value.
by ArndW
Thu Jul 12, 2007 12:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to fined remove duplicate data?
Replies: 6
Views: 2026

Please post in the correct forum, this is not certainly not a FAQ. All solutions involve sorting the data by both columns first. You can also add a column that contains information on group changes so you can detect a new key. I would use a simple transform stage, using a stage variable to store the...
by ArndW
Thu Jul 12, 2007 12:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

balajisr wrote:Arnd, The jobs you sent ran fine at my end.

Thanks for testing that!

Is anyone else here on HP-UX with PX and would be willing to run my test case to see if it might be a local configuration issue and not restricted to the platform?
by ArndW
Wed Jul 11, 2007 11:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

Kumar, is 1 row and <100 bytes total size in the test case small enough? When I use just one Lookup FileSet the size is about 400Mb and that is working like a charm. I've just took a look at the environment variables to see if there is some setting there that might affect the behaviour on this platf...
by ArndW
Wed Jul 11, 2007 11:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Surrogate Key Assignment
Replies: 16
Views: 21218

There is no way to set the initial value to anything other than 1 using the default routine. But you can create your own copy of the Manager/Routines/sdk/KeyMgt/KeyMgtGetNextValue routine and modify it appropriately to start your sequence at some other number.
by ArndW
Wed Jul 11, 2007 11:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

That is great news - it means it isn't a general limitation but perhaps a problem with this version (7.5.1A) or on this platform (HP-UX). It would be nice if you or someone else could confirm this. I have a .dsx export file that I made for support that I could send to anyone who would like to test t...
by ArndW
Wed Jul 11, 2007 10:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

Thanks, balajisr - it would be great if you have found a way around this. Please note that I am talking about a lookup FileSet , I have used the same DataSet multiple times in a job before with no problems. I thought maybe the access to the descriptor might be the problem, so I tried copying the .fs...
by ArndW
Wed Jul 11, 2007 10:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup filesets and "Not enough Space" errors
Replies: 22
Views: 4534

Lookup filesets and "Not enough Space" errors

It seems that a given Lookup FileSet can only be used once in a job. When I add second copy of the same Lookup FileSet to a job it will always abort with a message Lookup2,0: Could not map table file "/path/to/file/lookuptable.20070712.mlbo12d": Not enough space This occurs even when I use a test lo...
by ArndW
Wed Jul 11, 2007 9:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Prallel join creating rows as many as nodes
Replies: 3
Views: 996

Are you doing any repartitioning? Does the job monitor show 800 rows output or have you actually checked the data to see if it is wrong. I've noticed some discrepancies in the monitor row counts when using several nodes, sometimes it showed total row counts per node.
by ArndW
Wed Jul 11, 2007 9:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: default job parameters
Replies: 11
Views: 2062

Is this a Job Sequence ? If so, in the Job Activity stage for that parameter click on "set to default".
by ArndW
Wed Jul 11, 2007 9:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: default job parameters
Replies: 11
Views: 2062

Well, that means that the parent job is passing a blank (or empty) value to the job and that is overriding the default. How is that parent job getting its value for that parameter?
by ArndW
Wed Jul 11, 2007 8:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: default job parameters
Replies: 11
Views: 2062

How are you calling the job where the default is being overridden? Are you specifiying that parameter when calling the job?
by ArndW
Wed Jul 11, 2007 7:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: default job parameters
Replies: 11
Views: 2062

A job will always use it's default parameters unless they are explicitly set at runtime. So in your case it means that the parent job is overriding the defaults, i.e. explicitly setting a value via either the shell "dsjob -run" or a sequencer job activity or by issuing a DSSetParameter() call prior ...
by ArndW
Wed Jul 11, 2007 7:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RIGHT/LEFT Justify
Replies: 8
Views: 4966

Numbers cannot be stored justified. If you want a string to be stored "right justified" then you need to explicitly pad the string with spaces on the left. Note that some datatypes such as VarChar2 will strip those leading spaces out of the string! Justification is never a data value issue, just a d...
by ArndW
Wed Jul 11, 2007 7:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job control process (pid 4372) has failed
Replies: 3
Views: 2642

It would seem your problem is that your BASIC routine is causing an abort somewhere between your first and second log message. What sort of code do you have between these two lines, anything more than simple assign, condition and loop statements - particularly CALLs to function and other routines? T...