Search found 15603 matches

by ArndW
Mon Mar 15, 2010 2:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: what is Sparse lookup and what is Normal look up
Replies: 3
Views: 5152

In addition, a sparse lookup, since it is executed for each row as it is read, is also used to read the current value from the source, unlike the normal lookup which has an image of the value from the time it was loaded at the start of the job run.
by ArndW
Mon Mar 15, 2010 2:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to find Special charcter in string.
Replies: 1
Views: 914

One option is to use the Convert() and UpCase() functions.

Code: Select all

IF Convert(Upcase(In.Name),"ABCDEFGHIJKLMNOPQRSTUVWXYZ-' ") THEN 'Invalid Name' ELSE In.Name
Note this allows spaces as well.
by ArndW
Mon Mar 15, 2010 1:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Stagevariables
Replies: 4
Views: 1386

This sounds too much like an interview question to warrant answering in DSXChange. Since DSXChange consists of loose a group of professionals the concensus is that we prefer that DataStage developers do not memorize interview questions and answers in order to secure a role, as that is to the general...
by ArndW
Fri Mar 12, 2010 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to read file through complex flat file stage
Replies: 11
Views: 6055

Stage -> Record Options -> Record Delimiter.
by ArndW
Fri Mar 12, 2010 10:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can I delete a dataset from a sequencer?
Replies: 6
Views: 1947

To add to Craig's post - execute the command "orchadmin rm {full-path-to-dataset-descriptor-file}"
by ArndW
Fri Mar 12, 2010 9:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Less row count with DSDB2PX Stage
Replies: 7
Views: 4039

I would wager (but just a small amount) that either #YIL# or #AY# are in some way different between your DataStage job and your manual SELECT.
Also, if you open the monitor window do you see the same number of records going into your transform stage as are coming out?
by ArndW
Fri Mar 12, 2010 7:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Less row count with DSDB2PX Stage
Replies: 7
Views: 4039

There is no limit in that sense in DataStage. What is your SELECT clause? Could rows be dropping from the Transform stage?
by ArndW
Fri Mar 12, 2010 6:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing transformations dynamically
Replies: 8
Views: 2619

DataStage will allow you to dynamically load and execute such rules, but you will be restricted to functions/rules that can be executed within the scope of a modify stage; unfortunately the transform stage is not part of the OSH mechanism directly but gets compiled from c source and is not dynamical...
by ArndW
Fri Mar 12, 2010 4:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I get lookups to find updated records immediately?
Replies: 2
Views: 950

Sparse lookups work correctly and are the way to solve this problem. Try running your job in just 1 node - the sparse lookup will read the new value as soon as it is written and committed to the database.
by ArndW
Fri Mar 12, 2010 3:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing environment variable through dsjob
Replies: 2
Views: 1585

the format is to use single quotes so that the '$' in the environment variable is not expanded, i.e.

Code: Select all

-param '$APT_CONFIG_FILE=/path/to/non/default/new.apt'
by ArndW
Fri Mar 12, 2010 3:24 am
Forum: General
Topic: Commiting records after successful completion of job
Replies: 10
Views: 5623

I think you have a point about overriding the defaults in the Oracle Enterprise stage - either set the value of the 2 environment variables higher than the number of expected rows/seconds of runtime or use another stage, such as the connector stage, which will allow you to specify the commit frequen...
by ArndW
Thu Mar 11, 2010 10:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: read all files from load directory
Replies: 11
Views: 2368

In the sequential file properties tab, click on 'options' and you'll see that you have a property call 'File Name Column', activate that and choose the column name that you would like to use.
by ArndW
Thu Mar 11, 2010 10:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: limit of files and subdirectories in AIX
Replies: 10
Views: 6020

I used UniVerse commands at previous sites, it takes just a couple of minutes of work but involves a bit of internal knowledge. I suggest doing the following - from UNIX, get a list of a RT_STATUSnnn and RT_CONFIGnnn file names and then create a text file in the format: RESIZE {filename} 2 1 1 RESIZ...
by ArndW
Thu Mar 11, 2010 10:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SIGSEGV error
Replies: 8
Views: 11187

There are several tools available, all AIX systems have 'vmstat' available and optional tools such as 'topas' might be installed as well. It might be best to ask your system administrator for some help, since the output of the tools can be a bit cryptic upon first use.
by ArndW
Thu Mar 11, 2010 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: read all files from load directory
Replies: 11
Views: 2368

Can you not try using a file pattern in the sequential file stage, which will also give you the file name as an additional column if you so desire.