How to increase the Buffer size as my TD Connector is taking the default value as 64Kb even i increased it in the properties.
Is there any calculation to follow for Rowcount, Array size and buffer size?
Buffer size
Moderators: chulett, rschirm, roy
-
Aruna Gutti
- Premium Member
- Posts: 145
- Joined: Fri Sep 21, 2007 9:35 am
- Location: Boston
This is from IBM technote on maximum buffer. Hope this helps in your case.
Problem(Abstract)When using the Load operator in TPT, the max buffer size allowed is 64260 kb as referenced in the Teradata Parallel Transporter Guide (on page 137). What this means is even if for example, 1000000 kb is specified in the Max Buffer Size field in the Teradata Connector (with Bulk access "Load"), it will disregard the specified max buffer size and will use up to 64260 kb only.
Diagnosing the problemThe following error is seen in the job log;
Teradata_Connector_1,0: The estimated row length of 31115 bytes
multiplied by the array size of 2000 is 62230000 which exceeds the
maximum buffer size of 64260.
Resolving the problem: To be able to write more than 64260 kb, change the write method to "Immediate" and specify the max buffer size value (for example, 1000000 kb).
Aruna.
Problem(Abstract)When using the Load operator in TPT, the max buffer size allowed is 64260 kb as referenced in the Teradata Parallel Transporter Guide (on page 137). What this means is even if for example, 1000000 kb is specified in the Max Buffer Size field in the Teradata Connector (with Bulk access "Load"), it will disregard the specified max buffer size and will use up to 64260 kb only.
Diagnosing the problemThe following error is seen in the job log;
Teradata_Connector_1,0: The estimated row length of 31115 bytes
multiplied by the array size of 2000 is 62230000 which exceeds the
maximum buffer size of 64260.
Resolving the problem: To be able to write more than 64260 kb, change the write method to "Immediate" and specify the max buffer size value (for example, 1000000 kb).
Aruna.