Write cache can not be used if the hashed file is larger than the amount of allocated cache (or that percentage of a shared cache specified by the DCMAXPCT and other percentage parameters).
You can tune the amount of cache, but not to more than 999MB.
Search found 53125 matches
- Tue Sep 21, 2004 1:37 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Lookup
- Replies: 14
- Views: 15560
- Tue Sep 21, 2004 1:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to get the distinct count
- Replies: 6
- Views: 2498
- Sun Sep 19, 2004 3:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Clean up resources option of DataStage Director not working
- Replies: 7
- Views: 9594
Hi We are also faced same kind of problem. What I did directly used UNIX and then killed the process using process id. From director you can able to see the job process id. Really if you got any idea please share with us. My idea is: Don't kill processes at UNIX level. There is a child, parent, gra...
- Sun Sep 19, 2004 1:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sort Stage
- Replies: 4
- Views: 1633
Even so, it's the same answer as the one Beeram gave. If you think about it, the only efficient way that grouping can be achieved is by sorting, then detecting change. The difference between "don't sort (previously sorted)" and "don't sort (previously grouped)" is, therefore, primarily about documen...
- Sat Sep 18, 2004 4:37 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Lookup
- Replies: 14
- Views: 15560
Can't answer that until we know whether or not you've enabled read cache. I have heard it argued, primarily for file dictionaries, that modulo 1 forces the contents of the hashed file all to be loaded into memory at first access (because the whole group needs to be scanned on first access), effectiv...
- Fri Sep 17, 2004 4:12 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Key generation in a multiple instance job
- Replies: 6
- Views: 1673
Whatever you do to guarantee unique IDs will involve single-threading, and therefore a "choke point", so you have to make it as quick as possible. You could modify the SDK routine and make it more efficient. You could rely on a sequence or a SERIAL data type in the target database. If you're using i...
- Fri Sep 17, 2004 4:07 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Dynmically Creating Job Parameter
- Replies: 7
- Views: 2265
You can do whatever you like with variables in the controlling job. When you attach the controlled job and set its parameter values using DSSetParam, these values remain constant for the entire run of the controlled job. You must pass the parameter values to the controlled job. If you're working for...
- Fri Sep 17, 2004 3:59 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Phantom error
- Replies: 10
- Views: 4404
- Fri Sep 17, 2004 3:51 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Lookup
- Replies: 14
- Views: 15560
When you use MINIMUM.MODULUS or static hashed file, the hit of allocating disk space is taken when the hashed file is created, rather than while it is being populated. The best way to speed population of a hashed file is to enable write cache, which means that the "writes to random groups" occurs in...
- Fri Sep 17, 2004 3:45 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Sequencer
- Replies: 2
- Views: 728
- Fri Sep 17, 2004 3:37 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Execute Stored Procedures in Sybase for PX
- Replies: 3
- Views: 2891
This "solution" will only work for 30 days. Then you will have to buy a licence for the ODBC driver, or for some other third party UNIX-based ODBC driver that you elect to purchase. The branded ODBC drivers that ship with DataStage are licensed only for use with DataStage stages, not for use with BC...
- Fri Sep 17, 2004 3:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: restartability in db2 enterprise stage
- Replies: 5
- Views: 2049
Best practice dictates that every record loaded is marked with some form of identification of the load run, perhaps a batch ID, perhaps a timestamp. If you do this, unwinding inserts becomes a simple constrained DELETE statement. If you've stage a before-image of the table you're loading, unwinding ...
- Thu Sep 16, 2004 4:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: DataStage for dummies
- Replies: 9
- Views: 5523
- Thu Sep 16, 2004 4:11 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Clear Log in director option hanging
- Replies: 13
- Views: 4530
- Thu Sep 16, 2004 4:05 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: how to read Hash file column name and type through Admin?
- Replies: 4
- Views: 1964
The underlying database is based on UniVerse, which is now owned by IBM. UniVerse manuals can be downloaded for no charge from IBM website.