Shulou(Shulou.com)06/01 Report--

This article is about how Hue3.9 builds and integrates HDFS and Hive. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Operating environment:

CentOS 6.5

Hadoop-2.6.0-cdh6.7.0

Hadoop-2.6.0-cdh6.7.0

Hive-1.1.0-cdh6.7.0

Hue-3.9.0-cdh6.7.0

Sqoop-1.4.6-cdh6.7.0

Hue:

Official website address: http://gethue.com/

Official website installation instructions: http://cloudera.github.io/hue/latest/admin-manual/manual.html#centosrhel

Official website github address: http://github.com/cloudera/hue

Hue is an open source Apache Hadoop UI system, first evolved from Cloudera Desktop, contributed by Cloudera to the open source community, it is based on the Python Web framework Django. By using Hue, we can interact with the Hadoop cluster on the Web console on the browser side to analyze and process data, such as manipulating data on HDFS and running MapReduce Job,Hive.

Wait

Support features:

Database query Editor, supporting Hive, Impala, MySql, PostGres, Sqlite and Oracle

Dynamic query dashboard with support for Solr

Support for Spark editor and dashboard

Browsers view status and support YARN, HDFS, Hive table Metastore, HBase, ZooKeeper

Support for Pig Editor, Sqoop2, Oozie workflows editors and dashboards

Import data into hdfs

1.CentOS6.5 dependent environment:

Yum install-y ant asciidoc cyrus-sasl-devel cyrus-sasl-gssapi cyrus-sasl-plain gcc gcc-c++ krb5-devel libffi-devel libxml2-devel libxslt-devel make mysql mysql-devel openldap-devel python-devel sqlite-develgmp-devel

two。 Download the CDH5.7.0 platform Hue:

Wget http://archive-primary.cloudera.com/cdh6/cdh/5/http://archive-primary.cloudera.com/cdh6/cdh/5/hue-3.9.0-cdh6.7.0.tar.gz

3. Environment variable configuration:

Vim / .bash_profileexport HUE_HOME=/home/hadoop/app/hue-3.9.0export PATH=$HUE_HOME/bin:$PATHsource ~ / .bash_profile

4. Compile source code (Hue3.9)

Tar-xzvf hue-3.9.0-cdh6.7.0.tar.gz-C ~ / app/-- check the cd hue-3.9.0make apps of users and user groups after decompression

The compilation process requires a lot of modules and packages, so it may take a long time to compile depending on your network speed.

Finally, the appearance of xxx post-processed indicates that the compilation is successful.

1190 static files copied to'/ home/hadoop/app/hue-3.9.0/build/static', 1190 post-processed.make [1]: Leaving directory `/ home/hadoop/app/hue-3.9.0/apps'

5.Hue configuration global file ($HUE_HOME/desktop/conf/hue.ini)

[desktop] secret_key=jFE93j;2 [290-eiw.KEiwN2s3 ['ditterpact. Q [eIW ^ y # e=+Iei*@Mn

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.