Sybase IQ plug-in - loading data

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
poates
Participant
Posts: 1
Joined: Fri Feb 13, 2004 6:56 pm

Sybase IQ plug-in - loading data

Post by poates »

We have also found the creation of the data load file very slow using the DataStage IQ plug-in and have resorted to creating the file using a sequential file stage. We let DS create the LOAD SQL.
This works in most cases except for timestamp/datetime columns. For these, DS LOAD SQL does not allow for delimiters (by default |).

So how does one create such a seq file or should I just create my own LOAD SQL, run the load manually and forget using DataStage for loading :?
ray.wurlod
Participant
Posts: 54595
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard! :D

I do prefer to create my own control files, because I can then tune every little thing that I can to optimise the load. I do sometimes use the bulk load stage to generate a prototype; other times I don't.

If I want to run the bulk loader under DataStage control, I use either ExecSH as an after-job subroutine, or DSExecute from within a custom after-job subroutine.

Bulk loaders generally work best with fixed-width format data; this may be why there's no option to have delimited fields in the data file. If you think this is a deficiency, you can lodge an enhancement request here (there's a dedicated forum for enhancement requests to the products), or on Ascential Developer Net, or through your support provider.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply