DSXchange

Compared to what? Why don't you do the research and let us know? Without tying up resources, we could only supply a theoretical answer in any case.

There is no such tool. You need to identify the processes (from Cleanup Resources would do, or DS.TOOLS from a telnet session) and monitor their memory consumption (using Task Manager or Performance Monitor on the server machine).

So what else is happening at these times? Is someone quiescing a database (even the DataStage Repository) perhaps?

Nah. Inflation will set in, and they'll devalue the second.

Check every folder in the path.

Can you open the file with View Data?

Do you see the file when you choose Browse for File when setting the File property?

What's different, in terms of access rights, between the two user IDs?

No. DataStage must read the Data Set. But the data stream into QS from DS through the plug-in - there is no requirement to use intermediate files. So the effect is of reading the Data Set directly. Be careful with the metadata. For example, if the plug-in executes a STAN job, then the output format ...

In a server job the easiest approach is to build the entire record as a single field (using stage variables as needed). The Fmt() function is useful for right padding. Output metadata is a single VarChar column (since your row lengths are 30 and 32 characters respectively).

All that's fine. You just end up making more use of scratch disk, which will slow execution. If you have an external sort utility, or your own sort routine, you might invoke that instead. For example, the sort command in MKS Toolkit (a UNIX-on-Windows utility) is more efficient than the server Sort ...

My advice is that you shell out less than $1 per week to entitle you to read premium posts and to help us to fund this website. Revenue from premium memberships comes nowhere close to fully funding this site, which is why they run classes, sell sponsorships and are always willing to listen to other ...

Is the DB2 table on the same machine as the DataStage server? As a general rule, never perform lookups over networks; it is horribly slow, and makes horribly inefficient use of packets. Prefer instead to load only the required columns and rows into a hashed file (these will stream in in just a few s...

Can you please edit the post with the code so as to disable smilies? This part of the log is of concern. SortChild.1.JobControl (@UpdateMasterSort): Controller problem: Error calling DSRunJob(UpdateMasterSort.S00198AE0 ), code=-14 [Timed out while waiting for an event] Starting Job UpdateMasterSort....

And pretty straightforward now that IBM owns ClearCase! It's not 8.0. It may be 8.1, which means at least 12 months away. It may be pushed out even further, depending how difficult it is to do - they are also looking at integrating Information Server components (not just DataStage) with other source...

kcbland wrote:Each row is about 10 megabytes in content? Sheesh, that's a big row.

As one of the technical folks said in the early days of DataStage, in China or India 10MB is merely a transaction.

Can you enclose the column name in double quotes in the Derivation field?

I'd suggest that Department_Number is not a column in the H_SK_ProductBrand table. You may have misspelled it or miscased it. Set a file pointer to H_SK_ProductBrand (if you haven't already, using SETFILE) and list its dictionary using the LIST.DICT command. This will allow you determine what the co...