Shulou(Shulou.com)05/31 Report--

This article mainly introduces how to integrate hive and hbase, with a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

I. brief introduction

Hive is a data warehouse tool based on Hadoop, which can map structured data files to a database table, provide complete sql query functions, and transform sql statements into MapReduce tasks to run. Its advantage is that the learning cost is low, simple MapReduce statistics can be quickly realized through SQL-like statements, and there is no need to develop special MapReduce applications, so it is very suitable for statistical analysis of data warehouse.

The realization of the integration function of Hive and HBase is to use their own external API interface to communicate with each other, which mainly depends on the hive_hbase-handler.jar tool class.

Second, installation steps:

1. Both Hadoop and Hbase have been installed successfully

Hadoop cluster configuration: http://www.linuxidc.com/Linux/2012-02/53632.htm

Hbase installation configuration: http://www.linuxidc.com/Linux/2012-02/54225.htm

2. Copy hbase-0.90.3-cdh4u1.jar and zookeeper-3.3.3-cdh4u1.jar to hive/lib.

Note: how other versions of these two files already exist under hive/lib (such as zookeeper-3.3.2.jar). It is recommended to use the relevant version under hbase after deletion.

two。 Modify the hive-site.xml file under hive/conf and add the following at the bottom:

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.