Shulou(Shulou.com)06/01 Report--

This article mainly shows you "Linux system how to install Sqoop", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "Linux system how to install Sqoop" this article.

Introduction to Sqoop: Sqoop: SQL-to-Hadoop purpose: transfer data from relational databases to HDFS (Hive, Hbase) (key scenarios); data from Hadoop to relational databases. Sqoop is developed in the java language, and the underlying layer uses mapreduce.

Linux system installation Sqoop specific steps: installation convention

The installation directory is / opt/

1) decompression

Tar-zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz-C / opt/

2) rename:

Mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha sqoop

3) configure SQOOP_HOME to the environment variable

Vim / etc/profile.d/hadoop-etc.sh

Export SQOOP_HOME=/opt/sqoop

Export PATH=SQOOP_HOME/bin

4) make the configuration effective: source / etc/profile.d/hadoop-etc.sh

5) copy and rename the configuration file $SQOOP_HOME/conf/ sqoop-env-template.sh

Cp sqoop-env-template.sh sqoop-env.sh

6) configure $SQOOP_HOME/conf/sqoop-env.sh

Export HADOOP_COMMON_HOME=/opt/hadoop

Export HBASE_HOME=/opt/hbase

Export HIVE_HOME=/opt/hive

Export ZOOCFGDIR=/opt/zookeeper/conf

Note: because SQOOP wants to connect to rdbms, you need to add the driver jar package of this data to the classpath of sqoop, so upload the jar package of mysql to $SQOOP_HONE/lib

7) SQOOP installation verification

Execute the command sqoop list-databases-connect jdbc:mysql://ip:3306/test-username root-password 123456 to display the names of all libraries in the mysql database.

The above is all the contents of the article "how to install Sqoop in Linux system". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.