DSXchange

On the subject of Dynamic Hash Files testing utilities, what about ANALYZE.FILE? I thought thats exactly what it was meant to be used for. Throw STATISTICS after the filename to be analyzed and you get even more gory details back. Plus theres stuff like FILE.STAT, HASH.HELP and HASH.TEST.DETAIL for ...

Sorry to add fuel to the fire, but I have to toss my $0.02 into this thread... Either way: both file types (static and dynamic) have overflow... and they are handled basically the same way by UV (only difference being that in a Type 30 file you overflow being placed in the OVER.30 file dynamically, ...

Ray, Sorry if I mistated something, but that is how the difference between static and dynamic was explained to me. In a dynamic hash the modulo number changes dynamically during load, which would result in a tuned hash file. If that isnt the case, what is the difference? Why have the different types...

I wish to clear up a couple of misconceptions raised by the previous poster. First, whether the hashed file is static or dynamic is immaterial as far as pre-loading to memory for read (lookup) is concerned. In both cases, the file will have a current modulus (number of groups, or buckets), and it is...

1. The creation parameters are usually fine as-is except when dealing with very large loads (500,000+ records or large records or both). It has to do with buckets being filled and split in a dynamic hash and the work involved to reorganize the hash table. With most loads, this condition still exists...

I am wondering what percentage of people use an external/non-DataStage/non-database sort utility? Would Ascential Marketing know the answer? How does the DataStage-users take a online survey of this type? -----Original Message----- From: Galemmo,Nicholas,GLENDALE,IS [mailto:nicholas.galemmo@us.nestl...

I have found doing it in a SQL query is faster (2-3 times faster, in my experience, using Oracle in a test with around 200,000 rows.). If I were you, I would also look into a sort utiltiy package, such as CoSort, if this is something you plan to do on a regular basis. Do an evaluation and compare ti...

Hi I have a table with 40 million records. I need to group some counts by 5 columns. Is it better to write a USER DEFINED SQL with a group by or use an Aggregator stage to do that. Which would be faster? Has anybody had experience with this? Thanks Gopal =============================================...

Simplest thing to do would be to trim your large text fields down to the maximum size of the Oracle column so that the errors will not be generated. You can do this in the final transform before the OCI stage using the square brackets operator. For example, if the column in the Oracle table has a ma...

I have a job that pulls from Universe, does a few transformations and then using an OCI Stage updates or inserts into Oracle. This job tends to get a lot of warning messages d/t large text fields being truncated before inserting into Oracle. Ive tried to run the job with no limits to the warning mes...

parameter array size is the number of rows given to the driver in each pass. i.e. basically if the array size is 100 then datastage would give the driver 100 rows at a time... you may be blowing the about of free space you have on the machine for doing that... -----Original Message----- From: Doris ...

Hello, I have a large 6 million record history text file that I am trying to write to a SQL Server database through ODBC. It is a straight read/write job and one time load. When I reduce the record size for testing it runs fine..but when I try and load the entire file I keep getting an error that se...

The Execute stage in a 5.1 Job Sequence is very restrictive so we use the routine stage instead. This lets us centralise the code that runs script and handles errors and messages. All scripts are stored under the DataStage project directory in subdirectories so they can be included in the Version Co...

Youll be able to find them archive at www.tools4datastage.com. Regu. -----Original Message----- From: Denzil Sander [mailto:DenzilS@mxgroup.co.za] Sent: 04 April 2002 08:36 To: Datastage (datastage-users@oliver.com) Subject: Tuning techniques for hash files Hi all Is there a archive of all our mails...

Hi all

Is there a archive of all our mails/requests so that I can go look up tuning techniques/hints for hash files?

Thanks

Denzil