Shulou(Shulou.com)06/01 Report--

This article will explain in detail how to install and configure HDP-2.6.5 and ambari-2.6.2. The editor thinks it is very practical, so I share it with you for reference. I hope you can get something after reading this article.

Installation file list * ambari-2.6.2.2-centos7.tar.gz* HDP-2.6.5.0-centos7-rpm.tar.gz* HDP-GPL-2.6.5.0-centos7-gpl.tar.gz* HDP-UTILS-1.1.0.22-centos7.tar.gz* jdk-8u162-linux-x64.tar.gz* apache-tomcat-8.5.27.tar.gz* mysql-connector-java-5.1.46.tar.gz Download the deployment environment System: CentOS 7.xJDK: JDK-1.8.xxxTomcat: Tomcat-8.5.27 from https://hortonworks.com (or use Nginx, Httpd) MariaDB: MariaDB-5.5.60 cluster role Ambari-Server: 10.0.2.20Ambari-Agent01: 10.0.2.21Ambari-Agent02: 10.0.2.22cat > > / etc/hosts/etc/ntp.conf/etc/profile/etc/yum.repos.d/ambari.repo/etc/ambari-server/conf/ambari.properties# configure ambari startup port The default is 8080 to conflict with the default port of yum source tomcat service [root@Ambari-Server ambari-server] $echo "client.api.port=9999" > > / etc/ambari-server/conf/ambari.properties [root@Ambari-Server ~] $mysql-uroot-p123456-e "show tables from ambari. "# start Ambari-server because systemctl has no startup information output Start [root@Ambari-Server ambari-server] $/ etc/init.d/ambari-server startUsing python / usr/bin/pythonStarting ambari-serverAmbari Server running with administrator privileges.Organizing resource files at / var/lib/ambari-server/resources...Ambari database consistency check started...Server PID at: / var/run/ambari-server/ambari-server.pidServer out at: / var/log/ambari-server/ambari-server.outServer log at: / var/log/ambari-server/ without using systemctl Ambari-server.logWaiting for server start.Server started listening on 9999DB configs consistency check: no errors and warnings were found.Ambari Server 'start' completed successfully. The installation configuration Ambari-agent#agent may not be installed, but can be installed through the page configuration. When registering the agent host through the page installation, the HTTPS connection error through SSL will be reported. Specific errors will be explained below [root@Ambari-Server ~] $for n in 20 21 22 * * do ssh 10.0.2.According to n "yum install ambari-agent-y" Done [root@Ambari-Server conf] $sed-I "s#hostname=localhost#hostname=Ambari-Server#" / etc/ambari-agent/conf/ambari-agent.ini# forces the security protocol to be specified in order to prevent error reporting: ERROR 2018-12-14 14 sed 41s#hostname=localhost#hostname=Ambari-Server# 11462 NetUtil.py:96-EOF occurred in violation of protocol (_ ssl.c:618) ERROR 2018-12-14 1414 sed 411462 NetUtil.py:97-SSLError: Failed to connect. Please check openssl library versions. [root@Ambari-Server conf] $sed-I'/\ [security\] / a\ force_https_protocol=PROTOCOL_TLSv1_2' / etc/ambari-agent/conf/ambari-agent.ini# synchronization configuration file to all nodes [root@Ambari-Server conf] $for n in 21 22 mitdo scp / etc/ambari-agent/conf/ambari-agent.ini 10.0.2.$n:/etc/ambari-agent/conf/ Done# starts all node agents [root @ Ambari-Server conf] $for n in 20 21 22 X do ssh 10.0.2.roomn "/ etc/init.d/ambari-agent start"; done page configures Ambari**** default login permission: admin admin# configures cluster name

Configure the installed HDP version and the local HDP yum source

This step will report a SSL HTTPS connection error. This problem has been resolved in the installation steps of ambari-agent; the warnings in the following figure are handled according to the actual situation or can be ignored

Select the application to be used for installation according to the situation

Select the application installation deployment layout. The red box is an overview of the layout and distribution of the test environment. Ambari itself is equivalent to running all applications on the ambari-server server.

Installation Distribution of Cluster salve and client

Configuration of each application in the cluster

Review

Install, start, and test

The default configuration does not need to be modified until the installation is completed and the configuration is enabled. RM-HA (ResourceManager-High-Available) is not enabled. To ensure high availability of clusters, the YARN cluster service is usually enabled in the service drop-down menu.

Select Enable ResourceManager HA in the service actions drop-down button group

After the next step, select the resourcemanager deployment node

The default configuration, which does not need to be modified, goes directly to the next step until the installation and configuration are completed automatically.

Enable NameNode-HA to configure on the page, it is very simple, according to the page prompts to operate. If ambari-metrics is installed, ambari-metrics cannot be started after installation and configuration. Error reports in the log are as follows: from metric_collector import MetricsCollector File "/ usr/lib/python2.6/site-packages/resource_monitoring/core/metric_collector.py", line 23, in from host_info import HostInfo File "/ usr/lib/python2.6/site-packages/resource_monitoring/core/host_info.py", line 22 In import psutil File "/ usr/lib/python2.6/site-packages/resource_monitoring/psutil/build/lib.linux-x86_64-2.6/psutil/__init__.py", line 89, in import psutil._pslinux as _ psplatform File "/ usr/lib/python2.6/site-packages/resource_monitoring/psutil/build/lib.linux-x86_64-2.6/psutil/_pslinux.py", line 20 In from psutil import _ commonImportError: cannot import name _ common first write solution: cd / usr/lib/python2.6/site-packages/resource_monitoring/psutilpython setup.py build # if gcc compilation error is reported Please install and upgrade gcc\ gcc-c++python setup.py install the reason for the problem: the Ambari installation process will install a directory / usr/lib/python2.6, because the system is CentOS 7.3, the default is python 2.7.5, there should be no python2.6 dependency. View the system python command. The command in the red box below is the ll / usr/bin/ generated by ambari | grep python

View commands: [root@ambari-server psutil] $cat / usr/bin/python-wrap #! / usr/bin/env bash# Copyright (c) 2011-2017, Hortonworks Inc. All rights reserved.# Except as expressly permitted in a written agreement between you# or your company and Hortonworks, Inc, any use, reproduction,# modification, redistribution, sharing Lending or other exploitation# of all or any part of the contents of this file is strictly prohibited.PY_PACKAGES_DIR=site-packagesOS_DIST= `cat / etc/issue 2 > / dev/ null`if [[$OS_DIST= = * Ubuntu*]] | | [$OS_DIST= = * Debian*]] Then PY_PACKAGES_DIR=dist-packagesfiexport PYTHONPATH=/usr/lib/python2.6/$PY_PACKAGES_DIR:$PYTHONPATH# reset settingsunset PYTHON# checking for preferable python versionsif [- a / usr/bin/python2.7] & & [- z "$PYTHON"]; then PYTHON=/usr/bin/python2.7fiif [- a / usr/bin/python2.6] & & [- z "$PYTHON"] Then PYTHON=/usr/bin/python2.6fi# if no preferable python versions found, try to use system oneif [[- z "$PYTHON"]; then PYTHON=/usr/bin/pythonfi# execute script$PYTHON "$@" can tell from this command script whether ambari is using or python2.7 is just resetting the PYTHONPATH dependent library, which has the module of psutil in the dependent library, but only the installation directory. There will be a command in the error log of starting ambari-metrics (I didn't record it here), which roughly means "the psutil build directory was not found in the command execution", so follow the general python package installation command: python setup.py buildpython setup.py install so far, problem solved, start ambari-collecator, it's ready to get up. This is the end of this article on "how to install and configure HDP-2.6.5 and ambari-2.6.2". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.