Clarification about data types

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vivekgadwal
Premium Member
Premium Member
Posts: 457
Joined: Tue Sep 25, 2007 4:05 pm

Clarification about data types

Post by vivekgadwal »

Background: We have XML data stored in database under the data type of XML. I have looked it up in IBM's site and the serialized XML data type can hold 2,147,483,647 bytes. While reading this field, we are reading it as "LongVarBinary". Then we apply RawToString() function and store it in a "LongVarChar" field before sending this to XML Parser. This parser will break the XML down into different fields for further processing.

Questions: I am not sure how much a LongVarChar data type without any length specified can hold in it within DataStage. In DB2, that length is provided as 32,767 bytes. We have recently encountered an XML which got very close to this limit.
1) I am wondering if the 32,767 bytes is indeed the limit of unbounded LongVarChar data type.
2) Also, is there any other way to handle even bigger XML documents coming through from DB2?

Thanks!
Vivek Gadwal

Experience is what you get when you didn't get what you wanted
Post Reply