Shulou(Shulou.com)06/01 Report--

Editor to share with you how to install data storage Hive in the Linux system, I believe most people do not know much about it, so share this article for your reference. I hope you will learn a lot after reading this article. Let's learn about it together.

Hive is a data warehouse tool based on Hadoop, which is used to extract, transform and load data. It is a mechanism that can store, query and analyze large-scale data stored in Hadoop.

About Hive: Facebook developed Hive to solve the analysis of massive log data, which was later open source to the Apache Software Foundation.

Hive is a kind of data warehouse software that uses SQL-like statements to assist in reading, writing and managing large data sets stored on distributed storage systems.

Hive's data is stored on HDFS. Libraries and tables in Hive can be thought of as a mapping of data on HDFS. So Hive must be running on a Hadoop cluster.

Detailed steps for installing Hive on Linux system: 1) decompress the Hive file:

Tar-zxf / opt/soft/apache-hive-2.1.1-bin.tar.gz-C / opt/

2) modify the name: mv apache-hive-2.1.1-bin/ hive

3) add environment variables: vim / etc/profile.d/hadoop-ect.sh

Export HIVE_HOME=/opt/hive

Export PATH=HIVE_HOME/bin

Make the environment variable effective

Source / etc/profile.d/hadoop-etc.sh

4) enter cd/opt/hive/conf/ to modify the file

Cp hive-env.sh.template hive-env.sh

Cp hive-default.xml.template hive-site.xml

5) modify the hive-env.sh of $HIVE_HOME/conf by adding the following three lines

Export JAVA_HOME=/opt/jdk

Export HADOOP_HOME=/opt/hadoop

Export HIVE_HOME=/opt/hive

6) modify $HIVE_HOME/conf/hive-site.xml

Javax.jdo.option.ConnectionURL

Jdbc:mysql://lky01:3306/hive?createDatabaseIfNotExist=true

Javax.jdo.option.ConnectionDriverName

Com.mysql.jdbc.Driver

Javax.jdo.option.ConnectionUserName

Root

Javax.jdo.option.ConnectionPassword

Root

Hive.querylog.location

/ opt/hive/tmp

Hive.exec.local.scratchdir

/ opt/hive/tmp

Hive.downloaded.resources.dir

/ opt/hive/tmp

7) copy the mysql driver to the / opt/hive/lib/ directory

Cp / opt/soft/mysql-connector-java-5.1.39.jar / opt/hive/lib/

8) initialize the hive metadata warehouse

Execute the directory $HIVE_HOME/bin

. / schematool-initSchema-dbType mysql-userName root-passWord 123456

9) start hive

Hive] bin/hive-hiveconf hive.cli.print.current.db=true

The above is all the contents of the article "how to install data Storage Hive in Linux system". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.