Shulou(Shulou.com)06/01 Report--

This article mainly introduces how to install Sqoop2 configuration, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

First, install hadoop

Slightly

Second, install sqoop2

1. Select the corresponding sqoop2

[hadoop@hftclclw0001 ~] $pwd/home/hadoop [hadoop@hftclclw0001 ~] $wget http://apache.mirrors.tds.net/sqoop/1.99.6/sqoop-1.99.6-bin-hadoop200.tar.gz[hadoop@hftclclw0001 ~] $tar-zxvf sqoop-1.99.6-bin-hadoop200.tar.gz [hadoop@hftclclw0001 ~] $cd sqoop-1.99.6-bin-hadoop200/server/conf/ [hadoop@hftclclw0001 conf] $pwd/home/hadoop/sqoop-1 .99.6-bin-hadoop200/server/conf [hadoop@hftclclw0001 conf] $ls-altotal 220drwx-2 hadoop root 4096 Oct 19 08:15 .drwx-10 hadoop root 4096 Oct 19 08:15.-rw- 1 hadoop root 10636 Apr 29 2013 catalina.policy-rw- 1 hadoop root 4590 Apr 29 02:41 catalina.properties-rw- 1 hadoop root 1395 Apr 29 2013 context.xml-rw- 1 hadoop root 3290 Apr 29 2013 logging.properties-rw- 1 hadoop root 6528 Apr 29 02:41 server.xml-rw- 1 hadoop root 1586 Apr 29 02:41 sqoop_bootstrap.properties-rw- 1 hadoop root 7483 Apr 29 02:41 sqoop.properties-rw- 1 hadoop root 1530 Apr 29 2013 tomcat-users.xml- Rw- 1 hadoop root 163769 Apr 29 2013 web.xml modified catalina.properties. Rely on hadoop's jar package. Of course, if you still need hive or hbase The corresponding jar package should also be added [hadoop@hftclclw0001 conf] $vi catalina.propertiescommon.loader=$ {catalina.base} / lib,$ {catalina.base} / lib/*.jar,$ {catalina.home} / lib,$ {catalina.home} / lib/*.jar,$ {catalina.home} /.. / lib/*.jar,/home/hadoop/hadoop-2.2.0/share/hadoop/common/*.jar,/home/hadoop/hadoop-2.2.0/share/hadoop/common/lib/*.jar / home/hadoop/hadoop-2.2.0/share/hadoop/yarn/*.jar,/home/hadoop/hadoop-2.2.0/share/hadoop/hdfs/*.jar / home/hadoop/hadoop-2.2.0/share/hadoop/mapreduce/*.jar [hadoop@hftclclw0001 conf] $vi sqoop.propertiesorg.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.2.0/etc/hadoop add mysql driver mysql-connector-java-5.1.25-bin.jar Note version [root@hftclclw0001 lib] # pwd/home/hadoop/sqoop-1.99.6-bin-hadoop200/server/lib [root@hftclclw0001 lib] # ls-altotal 6284drwx-2 hadoop root 4096 Oct 19 08:33 .drwx-10 hadoop root 4096 Oct 19 08:15.-rw- 1 hadoop root 15241 Apr 29 2013 annotations-api.jar-rw- 1 hadoop root 54567 Apr 29 2013 catalina-ant.jar-rw- 1 hadoop root 132134 Apr 29 2013 catalina-ha.jar-rw- 1 hadoop root 1244212 Apr 29 2013 catalina.jar-rw- 1 hadoop root 237615 Apr 29 2013 catalina-tribes.jar-rw- 1 hadoop root 1801636 Apr 29 2013 ecj-4.2.2.jar-rw- 1 hadoop root 33315 Apr 29 2013 el-api.jar-rw- 1 hadoop root 112556 Apr 29 2013 jasper-el.jar-rw- 1 hadoop root 527739 Apr 29 2013 Jasper.jar-rw- 1 hadoop root 76691 Apr 29 2013 jsp-api.jar-rw- 1 hadoop root 848401 Oct 19 08:33 mysql-connector-java-5.1.25-bin.jar-rw- 1 hadoop root 88575 Apr 29 2013 servlet-api.jar-rw- 1 hadoop root 8821 Apr 29 02:41 sqoop-tomcat-1.99.6.jar-rw -1 hadoop root 776946 Apr 29 2013 tomcat-coyote.jar-rw- 1 hadoop root 253635 Apr 29 2013 tomcat-dbcp.jar-rw- 1 hadoop root 70014 Apr 29 2013 tomcat-i18n-es.jar-rw- 1 hadoop root 51903 Apr 29 2013 tomcat-i18n-fr.jar-rw- 1 hadoop root 54511 Apr 29 2013 tomcat-i18n-ja.jar

two。 Start

[root@hftclclw0001 bin] # pwd/home/hadoop/sqoop-1.99.6-bin-hadoop200/bin [root@hftclclw0001 bin] #. / sqoop2-server startSqoop home directory: / home/hadoop/sqoop-1.99.6-bin-hadoop200Setting SQOOP_HTTP_PORT: 12000Setting SQOOP_ADMIN_PORT: 12001Using CATALINA_OPTS: Adding to CATALINA_OPTS:-Dsqoop.http.port=12000-Dsqoop.admin.port=12001Using CATALINA_BASE: / home/hadoop/sqoop-1 .99.6-bin-hadoop200/serverUsing CATALINA_HOME: / home/hadoop/sqoop-1.99.6-bin-hadoop200/serverUsing CATALINA_TMPDIR: / home/hadoop/sqoop-1.99.6-bin-hadoop200/server/tempUsing JRE_HOME: / usrUsing CLASSPATH: / home/hadoop/sqoop-1.99.6-bin-hadoop200/server/bin/bootstrap.jar

3. UI visit {ip}: 12000

Http://hftclclw0001:12000/

4. Client access

[hadoop@hftclclw0001 sqoop-1.99.6-bin-hadoop200] $. / bin/sqoop2-shell Sqoop home directory: / home/hadoop/sqoop-1.99.6-bin-hadoop200Oct 19, 2015 8:39:47 AM java.util.prefs.FileSystemPreferences$1 runINFO: Created user preferences directory.Sqoop Shell: Type 'help' or'\ h' for help.sqoop:000 > sqoop:000 > Thank you for reading this article carefully. I hope the article "how to install and configure Sqoop2" shared by the editor will be helpful to you. At the same time, I also hope that you will support and pay attention to the industry information channel, and more related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.