Search found 53125 matches

by ray.wurlod
Fri Jun 01, 2007 2:08 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: add_to_heap() - Unable to allocate memory warning
Replies: 19
Views: 6285

The hashed file cache is for ALL cached hashed files, not for each.
by ray.wurlod
Fri Jun 01, 2007 2:04 pm
Forum: General
Topic: Problem while working with UV -admin -info
Replies: 9
Views: 2616

First try this and report the answer. Change directory to where DataStage is installed (the DSEngine directory). ls -al .uvconfig If there is truly no such file, and you have not corrupted the uvconfig file, then you need to regenerate the .uvconfig file using a uvregen command (or bin/uv -admin -re...
by ray.wurlod
Fri Jun 01, 2007 2:01 pm
Forum: General
Topic: companies that uses IBM websphere datastage
Replies: 3
Views: 1116

Welcome aboard. :D

If you are seeking employment, please post in the Talent forum. Otherwise, you will be best served to ask the vendor - no-one here is likely to have a comprehensive list.
by ray.wurlod
Fri Jun 01, 2007 5:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: add_to_heap() - Unable to allocate memory warning
Replies: 19
Views: 6285

It's not that at all. 999MB is the maximum that DataStage can malloc() for hashed file cache.
by ray.wurlod
Fri Jun 01, 2007 5:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Extracting data
Replies: 8
Views: 2355

Put parallelism into the DataStage job. That's why I asked about Enterprise Edition. However it's also possible in server jobs - you can have multiple connections to the database through the same stage, each selecting a subset of the rows (simple example, odds and evens on a two-way split, or day of...
by ray.wurlod
Fri Jun 01, 2007 5:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance statistics Not Shown
Replies: 4
Views: 3806

I disagree. First, none of my six machines had different environment variable settings. Second, APT_NO_JOBMON is a "double negative" - disabled means the job monitoring is enabled. The APT_MONITOR... environment variables affect only when monitoring happens, not whether monitoring happens. In any ca...
by ray.wurlod
Fri Jun 01, 2007 5:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash file Create, delete file and Clear file Options
Replies: 2
Views: 1524

Once the hashed file is created, unless you need to change its shape, you don't need to create it afresh every run; clear file is very fast and will suffice. Conversely, if you do create the hashed file, clear file is a waste of time.
by ray.wurlod
Fri Jun 01, 2007 5:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: add_to_heap() - Unable to allocate memory warning
Replies: 19
Views: 6285

999MB is the upper limit for hashed file cache. This is shared by all hashed files for which the caching option is set. Read cache and write cache are separate (each maxing out at 999MB).
by ray.wurlod
Fri Jun 01, 2007 5:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Extracting data
Replies: 8
Views: 2355

Not enough information. What kind of database? How are you extracting? How are you "introducing parallelism"? (We don't want to advise anything you've already tried.) Do you have Enterprise Edition? Remember that, as far as the database server is concerned, a running DataStage job is just another cl...
by ray.wurlod
Fri Jun 01, 2007 5:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DB2 for i series jobs hanging
Replies: 2
Views: 865

Get your DBA to trace inbound and outbound activity on the DB2 server. Also keep an eye on locks - though what kind of a lock persists for 10 hours is a question!
by ray.wurlod
Fri Jun 01, 2007 5:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Regarding ftp stage,want to ftp files from remote server
Replies: 5
Views: 1457

Create a script on the DataStage server. If the file names conform to a pattern you can use MGET.

Don't use the FTP stage; it tries to transfer a line at a time, and the concept of "line" in XML documents is rather vague.
by ray.wurlod
Fri Jun 01, 2007 4:57 am
Forum: IBM QualityStage
Topic: a problem with the Run
Replies: 4
Views: 2490

"Incomplete record read from file" suggests that at least one record in the file was short. Perhaps you have an extra newline at the end, because the job read and wrote the same number of records.
by ray.wurlod
Thu May 31, 2007 10:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance statistics Not Shown
Replies: 4
Views: 3806

I had this very issue in a training class this week. Six identically configured clients (allegedly) - four could get row counts, two could not. Connecting to the same server (though to different projects). As far as I could determine (hurriedly) there was nothing in the projects to cause the differe...
by ray.wurlod
Thu May 31, 2007 10:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2INSTANCE Warning
Replies: 3
Views: 1451

Just look at the help in the client. What's supposed to happen is what you expected. That it's not is a worry. A quick fix might be to include $DB2INSTANCE as a job parameter, with a default value of $UNSET so that, in the job, it is not set unless explicitly overridden. In this case the property in...
by ray.wurlod
Thu May 31, 2007 10:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: 50 warning!!!
Replies: 9
Views: 3687

Try changing the project default. Open Director, choose Options from the Tools menu.