Page 1 of 1

XML data getting truncated while loading into CLOB column

Posted: Wed Jul 19, 2017 6:16 am
by nyk1989
Hello,

I have a job design like below -

MQ Connector -> Transformer -> DTS
Here in DS, I have given the column datatype as LongVarchar with no length provided.

I am reading a XML file coming from MQ and loading into a Oracle table with column datatype as CLOB.

The job completes successfully and I see the XML message getting added into the table.

But when I retrieve the data from the CLOB column, I see only partial XML message.
Here for retrieving, in the DS job, the column datatype is LongVarchar without any length and the Array size is 1.

Can someone suggest how this data is getting truncated?

Posted: Thu Jul 20, 2017 2:20 pm
by chulett
Have you verified where this data is being 'truncated'? Meaning, if you check the COLB outside of DataStage, say with Toad or something similar, is it whole in the database. Also a bit curious why it's not being stored as an XMLTYPE...

Posted: Thu Jul 20, 2017 4:21 pm
by eostic
Do some searches in the forum here.....you might be running into defailt size limits for what can go out on a link......there are several APT vars to consider.....they are something like APT_DEFAULT_TRANSPORT_BLOCKSIZE and used to be too small for large MQ msgs. make it bigger.....

Ernie

Posted: Fri Jul 28, 2017 4:33 am
by nyk1989
I checked the data in Toad and found that the xml data is truncated. So, it's not loading completely into database but it doesn't throw any size error or anything else. In my ETL the APT_DEFAULT_TRANSPORT_BLOCK_SIZE is set to 9999999. Still this issue happens.

Posted: Wed Aug 02, 2017 1:35 am
by nyk1989
I tried loading the CLOB column with array size as 1 and I see that the entire xml is getting loaded into the field.

This works properly if I use an Oracle Connector to load the data whereas if I use DTS stage - the job aborts.

Error I get is - player terminated unexpectedly.