Search found 134 matches

by fridge
Wed Jul 02, 2008 6:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Making ReadOnly Jobs NON-ReadOnly In V8
Replies: 5
Views: 7953

Making ReadOnly Jobs NON-ReadOnly In V8

Hi, not sure if this has been covered before but have an export of a 7.5 project that have imported into v8 Some of the jobs are ReadOnly and want to make them editable , however the two ways I have done this before are editing the DSX file or updating DS_JOBS set READONLY="NRO" kind of st...
by fridge
Thu Jun 05, 2008 6:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Yet another Pivot Question (bit different though)
Replies: 4
Views: 2731

Cool - that worked a treat - I knew I could do something clever but it was a long day :-)

I actually ended up writing an Awk program to do it - but this is a lot more suitable as I prefer to keep the logic visible as it were.

Many thanks ameyvidya

Ed
by fridge
Wed Jun 04, 2008 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Yet another Pivot Question (bit different though)
Replies: 4
Views: 2731

I guess I do -could set the max to some thing big (e.g. 50) but didnt want the faff of it - wanted a more generic solution
by fridge
Wed Jun 04, 2008 9:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Yet another Pivot Question (bit different though)
Replies: 4
Views: 2731

Yet another Pivot Question (bit different though)

hi, I Have an input file containing a single pipe-delimited column and I want to be able to convert the pipe delimited 'subcolumns' into 'real' columns then pivot on them - the catch is I dont know before hand how many of the subcolumns there are e.g. source Key DelimCol A 1|4|5 B 7|8 C 9 target A 1...
by fridge
Fri May 23, 2008 5:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conditional Lookups where condition references an input col
Replies: 7
Views: 1925

sussed it - it WAS just a case of hard coding the condition - just seems for some reason that the menu option borked

thanks for input guys
by fridge
Tue May 20, 2008 4:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conditional Lookups where condition references an input col
Replies: 7
Views: 1925

evening ray , yes there are input columns being fed into the lookup stage , this is a design rather than a runtime issue - just cant select input columns as an option from the dropdown Actually sorted the functional issue with what is commonly known in UK as 'fudge' but in my never-ending quest for ...
by fridge
Tue May 20, 2008 10:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conditional Lookups where condition references an input col
Replies: 7
Views: 1925

Conditional Lookups where condition references an input col

Hi, I am probably being dense (dont all shout at once) but have a simple job read Seqfile A do lookup (lookup based on single key value, lookup data fed into lookup stage from Sequential file B) and wanted to do the lookup ONLY if A.FIELD <> something - but when building the expression the input col...
by fridge
Mon May 19, 2008 9:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating hashed file takes too long
Replies: 11
Views: 4980

further to the above - if your hash file IS the culprit - u may well need to tune it as the default settings in terms of modulus , seperation , type (i.e. wholly numeric key , numeric variance to right etc) are often not best suited to your data. I good place to start is the hashfile calculator (sho...
by fridge
Mon Apr 14, 2008 5:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSjob Using Teradata Fastload
Replies: 15
Views: 12406

one (possibly useless) remark on using enterprise stage for TeraData - we found that it seems to do a count(*) before and after the actual load (which as already mentioned does a fastload into a staging table - then insert from subselect). If there are more than 2Billion records in the target table ...
by fridge
Tue Mar 18, 2008 9:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Environment Variable $APT_ORCHHOME
Replies: 0
Views: 1558

Environment Variable $APT_ORCHHOME

I have a simple sequence that runs and it uses the project default for $APT_ORCHHOME. The sequence failed but on the re-run of the sequence, the value returned in the log for $APT_ORCHHOME is now the default set at the Sequence Job properties level. It is very easy to remedy this but I do not unders...
by fridge
Sat Mar 01, 2008 4:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSJE_TIMEOUT
Replies: 6
Views: 4266

this is caused by a hardwired timeout limit of 60 seconds in which the job has to kick in - and this can be missed if lots of jobs kick in at the same time, the main problem is each job has to open universe files for logs, config , status etc - this can be tweaked via uvconfig - but only two cetain ...
by fridge
Sun Jan 27, 2008 12:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inner join is producing more rows than input
Replies: 5
Views: 1557

another way this can happen is if one of your keys contains nulls - ive seen this before and it produces oodles of output
by fridge
Fri Jan 11, 2008 8:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sparse look-up doubt
Replies: 4
Views: 2721

few issues here - a sparse lookup in PX means that each lookup will go to the database (a non-sparse lookup unloads the data into a dataset - which makes the lookups a lot quicker). So sparse lookups are generally slower also if you havent got a primary key or index on the table then the whole 290Mi...
by fridge
Thu Nov 01, 2007 9:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remote database connection using DB2 Enterprise stage
Replies: 1
Views: 1186

u need to add the optional parameter called client instance name (this should be the name of the 32bit client on your app server)

the name and user name parms then appear
by fridge
Tue Oct 30, 2007 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MultiLoad returned: 20 Error
Replies: 3
Views: 2650

im a bit rusty on this but believe the problem is that you are getting a Unique Constrain violation if you look at the last lin es 0025 .if &SYSUVCNT then; **** 00:38:04 UTY2402 Previous statement modified to: 0026 .if 1 then; 0027 .logoff 20; This I beleive means that it has found >0 records in...