Shulou(Shulou.com)06/01 Report--

This article is about how to install, configure, and use Sqoop. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

12. Sqoop

This topic describes the installation, configuration, and basic use of Sqoop.

Sqoop basic Information

Official website: http://sqoop.apache.org/ official document: http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html

12.1. Installation

Wget http://mirror.bit.edu.cn/apache/sqoop/1.4.6/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gztar-zxf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gzrm-rf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gzmv sqoop-1.4.6.bin__hadoop-2.0.4-alpha. / frameworks/sqoop12.2. Configuration

Vi / .profile

Export SQOOP_HOME=/opt/workspaces/frameworks/sqoopsource / .profile

Vi. / frameworks/sqoop/conf/sqoop-env.sh

Export HADOOP_COMMON_HOME=/opt/workspaces/frameworks/hadoopexport HADOOP_MAPRED_HOME=/opt/workspaces/frameworks/hadoopexport HIVE_HOME=/opt/workspaces/frameworks/hive

Download the mysql driver

Wget-P. / frameworks/sqoop/lib http://central.maven.org/maven2/mysql/mysql-connector-java/5.1.36/mysql-connector-java-5.1.36.jar12.3. Test. / frameworks/sqoop/bin/sqoop version12.4. Use

Import data from MySQL database

. / frameworks/sqoop/bin/sqoop import-- connect jdbc:mysql://:/hive\-- username hive--password hive\-- table ROLES\-- where 1imports\-- hive-import-- hive-table hive_role# how to enable incremental import requires the following parameters-- incremental lastmodified-- check-column-- last-value''.

The increment field must be timestamp or date/datetime. Thank you for reading! This is the end of this article on "how to install, configure and use Sqoop". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.