Shulou(Shulou.com)06/03 Report--

Big data platform, involving many software products, if you have just joined the hadoop, directly download software packages, manual configuration files, is not so intuitive and easy.

Ambari provides an option to graphically install and manage hadoop clusters

Ambari company does not introduce, Ambari software is very intuitive, but the actual installation experience is not good. On the contrary, it is better to install and control it yourself. After a mistake / failure, "retry" seems to be the only way.

Now we are working on the installation. During the installation process, I will introduce the pit I encountered and how to climb out again.

1. First of all, visit the official page.

Https://docs.hortonworks.com/index.html

two。 Select the version you want

3. Click installation

4. Select Install Ambari

5. Then go to the document page

Official installation steps, note, select the installation documentation for the version you need to install

Https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/download_the_ambari_repo_lnx6.html

6. According to the above steps, you can go to the configuration yum source. Because the source is overseas and the speed is too slow, I will download the software package to the local first.

Wget-nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.4.2.0/ambari.repo-O / etc/yum.repos.d/ambari.repo yum repolistyum install-- downloadonly ambari-server-- downloaddir=/tmp/yum install-- downloadonly HDP-2.5.0.0-- downloaddir=/tmp/yum install-- downloadonly HDP-2.5.*-- downloaddir=/tmp/Update on 2018-5-13yum source has a problem Wget download address: wget http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6/HDP-UTILS-1.1.0.21-centos6.tar.gzwget http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0/HDP-2.5.0.0-centos6-rpm.tar.gz[root@db_monitor]# ll-rw-r--r- -1 root root 5996696005 Aug 27 2016 HDP-2.5.0.0-centos6-tars-tarball.tar.gz-rw-r--r-- 1 root root 833424206 Oct 26 23:09 HDP-UTILS-1.1.0.21-centos6.tar.gz

7. After downloading it locally, create a HTTP service on a server for later installation

Yum install httpd-y # service httpd restart# chkconfig httpd on

Put the downloaded HDP package into the / var/www/html/ directory

It can be accessed through the web page.

The preparation is complete, and the installation is started.

8. Configure the node's ssh secret-free login, so that other nodes can only be accessed on the server where ambari is installed.

$ssh-keygen-t rsa-f / .ssh/id_rsa

You can enter three times.

Copy the key to all nodes (only ambari does not need a password to access other server, reverse access requires a password)

Ssh-copy-id server2ssh-copy-id server3ssh-copy-id server4

9. To configure ambaris, turn off selinux first (I use ansible, which can be disabled by modifying the configuration file)

Ansible all-m selinux-a 'state=disabled'

10. Turn off the firewall

Ansible all-m service-a 'name=iptables state=stopped enabled=off'

11. Install JDK,ambari installation process, you can install automatically, but the speed is relatively slow. It is recommended to install it yourself. Need to be installed on all nodes

Download JDK (private network address)

Wget http://10.21.xx.xx/deploy/jdk1.7.0_79.tar.gz

Install JDK, all nodes must be installed

# tar-xzvf jdk1.7.0_79.tar.gz-C / usr/local

Add the following information to .bash _ profile

Export JAVA_HOME=/usr/local/jdk1.8.0_144 export JRE_HOME=/usr/local/jdk1.8.0_144/jreexport CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib:$CLASSPATHexport PATH=$JAVA_HOME/bin:$PATHsource / etc/profile

twelve。 It is only now that the official ambaris installation begins.

(note: if you choose to install jdk on your own and need to use kerberos authentication later, JCE is still required. Otherwise, you won't be able to connect to KDC properly. I found this only when I encountered a problem later. And oracle official website, can only download version 1.8 of JCE. 1.7 and below, you need a metalink account to download. Therefore, if the network speed is available, it is recommended that you directly select 1 and 2 to install JDK)

[root@ip-10-21-23-29 ambari] # ambari-server setupUsing python / usr/bin/pythonSetup ambari-serverChecking SELinux...SELinux status is' disabled'Customize user account for ambari-server daemon [YBO] (n)? Adjusting ambari-server permissions and ownership...Checking firewall status...Checking JDK... [1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8 [2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.