Shulou(Shulou.com)06/03 Report--

Recently, to build a set of big data platform for the third party, in the middle of the virtual machine version, after passing the test, carried out the physical machine version of the production environment, there are not many articles about ambari online, but fortunately, the quality of ambari official documents is slightly higher, and the community is more active, so they sort out the series of documents and throw out the buried pits to help friends build their own hadoop platform more quickly.

There are three parts:

1. Why choose ambari to build it?

When it comes to ambari, the main competitor cloudrea manager, we are more familiar with, as for their respective strengths and weaknesses, advantages of the fittest, we decide to choose.

Cloudera Manager is different. It's a web interface formanaging a Cloudera Cluster. It lets you install and update software on thecluster, monitor resource usage, restart services, deploy (copy to all servers) configuration files etc. Cloudera Manager is for admins.

The analog to Cloudera Manager, from the open sourcecommunity, would be Apache "Ambari," which provides similarfunctionality. The Hortonworks Data Platform (HDP) can be deployed and managedusing Ambari.

Both Cloudera Manager and Ambari run through a webinterface.

two。 The overview steps of the entire construction process

#

The first step is client configuration:

Check centos version, selinux, firewalld, hosts record, jdk1.8

Check whether the time zone and time are unified

Yum install ntp

Cp / usr/share/zoneinfo/Asia/Shanghai / etc/localtime

Configure root ssh private key login

Configure jdk1.8.025

Configure the hosts file

#

Step 2: build a local warehouse

LocalRepository-11-32

#

Step 3: configure ambari-server ambari-11-10

Generate ssh secret key

Configure the ssh keyless login client

Install ambari-server

Configure ambari-server

Start ambari-server

#

Step 4: web logs in to ambari and installs components

Configure ambari-server option

Select and start the appropriate component

#

Step 5: check and test the service

Web checks whether the component service starts properly

The shell end checks whether the service is healthy.

Hdfs fsck /-files-blocks-locations

Java api/ python checks whether the service is normal.

#

Step 6: document writing

Screenshot

With text description

Summary

#

3. Example screenshot and test

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.