Teradata Connector Stage causing skew in Data Load
Posted: Wed Jan 28, 2015 2:20 am
Not sure if the below is a DS issue or Teradata issue. Neverthless , I am posting it here
We are using Teradata connector in Bulk/Load mode (this is nothing but fastload in Teradata parlance)to load data into empty teradata table with three columns. The source is a sequential file stage.
Out of three columns in the table, 2 columns have nulls for all rows and one column has values for all rows. This column which has values, is the primary index of the table and the values are unique. The table itself is a multiset table i.e, it allows duplicates
When the job runs, it aborts after processing 7 million rows out of 60 million total rows in source. The error we are getting is
Teradata_Connector,0: RDBMS code 2644: No more room in database .
When we got in touch with the DB team they told there is a high amount of "skew factor" causing the space to be filled and we have to solve this first rather than increasing space.
Any suggestions?
We are using Teradata connector in Bulk/Load mode (this is nothing but fastload in Teradata parlance)to load data into empty teradata table with three columns. The source is a sequential file stage.
Out of three columns in the table, 2 columns have nulls for all rows and one column has values for all rows. This column which has values, is the primary index of the table and the values are unique. The table itself is a multiset table i.e, it allows duplicates
When the job runs, it aborts after processing 7 million rows out of 60 million total rows in source. The error we are getting is
Teradata_Connector,0: RDBMS code 2644: No more room in database .
When we got in touch with the DB team they told there is a high amount of "skew factor" causing the space to be filled and we have to solve this first rather than increasing space.
Any suggestions?