Max File Size

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
vikki_routhu
Participant
Posts: 1
Joined: Mon Jul 18, 2005 3:49 pm

Max File Size

Post by vikki_routhu »

:?: Can we load a 3 gig file using any of the stages? Please advice if any efficient way to load data in to target DB2 8.x tables.. like partitioning the file.

Thanks
Vikram
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi And Welcome Aboard :),
You can load 3GB files, though most chances activating a bulk load utility if possible via command line might be the fastest way (especially if your row consists of many columns).

sequential file stage can read over 2GB files (as long as your FS is configured to be able to handle such large files).

what exactly do you need to acomplish? (knowing that might get a better answer)

IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No DataStage stage imposes any limit on the volume of data processed (except where some resource, such as memory or disk space or ulimit) is exhausted .

So any restriction will come from your target. This might be a maximum table space size imposed by a DBA, or a maximum file size imposed by an operating system configuration.

Without knowing exactly what you're trying to achieve it's not possible to provide more exact information.

The main point is that DataStage won't be the problem.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply