Hashed files greater than 2Gb

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
tiagogen
Participant
Posts: 22
Joined: Sun May 14, 2006 2:03 pm
Location: Valinhos

Hashed files greater than 2Gb

Post by tiagogen »

Anyone knows if there's a problem if my hashed file is greater than 2GB?

I hear something about it... Is it true? Or i can create hashed of any length...
Tiago
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

No. There is a limitation in DS for hashed files. That limit is 2.2 GB.
That is because the Hashed file is created by a 32 bit pointer. You can change that to a 64 bit pointer to remove the 2.2 GB barrier.
Look at this post for a start.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
Bryceson
Charter Member
Charter Member
Posts: 88
Joined: Wed Aug 03, 2005 1:11 pm
Location: Madison, WI

Post by Bryceson »

By default DataStage Hashed File are 32BIT and House data up 2.2GB. If your data is more than 2.2GB you will need to create a 64BIT Hash.

Bryceson
tiagogen
Participant
Posts: 22
Joined: Sun May 14, 2006 2:03 pm
Location: Valinhos

Post by tiagogen »

Thanks!
Tiago
kris007
Charter Member
Charter Member
Posts: 1102
Joined: Tue Jan 24, 2006 5:38 pm
Location: Riverside, RI

Post by kris007 »

You can also check this post too.

viewtopic.php?t=92644

Kris.
Post Reply