Hello every one, does any one ingest data to Hadoop platform (Hive, Impala) or Apache Kudu? How do you resolve the performance issue? We use Datastage JDBC connector with Cloudera Impala JDBC driver, it works well for extraction, but not loading - the insert performance is terrible: 20,000 records takes almost 8 minutes. Has any one there trying ingesting data to Hadoop platform/Apache Kudu? What's your experience?
Thanks,
Datastage JDBC Connector Ingest Data to Apache Kudu
Moderators: chulett, rschirm, roy
Hi. I don't have any experience with Kudo, but in past threads here and elsewhere over the years, I've heard many people talk about loading to their hive and hive related tables using direct writes to the hdfs files that they are abstracting....much faster.....usually using the File Connector.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>