Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Big data builds the HDP environment, taking three nodes as an example (above-- deploying master nodes and services)

2025-01-17 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >

Share

Shulou(Shulou.com)06/03 Report--

(1) Experimental environment

L experimental medium

 CentOS-7-x86_64-Everything-1708.iso

 jdk-8u144-linux-x64.tar.gz

 ambari-2.6.0.0-centos7.tar.gz

 HDP-2.6.3.0-centos7-rpm.tar.gz

 HDP-UTILS-1.1.0.21-centos7.tar.gz

Here we take Vmware as an example to install a virtual machine

L prepare three CentOS virtual machines, three nodes: one Cloudera Manager node, two Agent nodes

The installation is as follows:

N HDP21:Server GUI 、 Development Tools 、 MariaDB

N HDP22 、 HDP23:Server GUI 、 Development Tools

II) install and configure CentOS (per machine)

Note that the following two options are selected

L Server With GUI

L Development Tools

L MariaDB Server (that is, MySQL database): note that it is only installed on hdp21

L turn off the firewall

Systemctl stop firewalld.service

Systemctl disable firewalld.service

L configure hostname: edit / etc/hosts file

L configure password-free login

L configure ntp service

Create directory: mkdir / root/cdroom/

* Mount CD: mount / dev/cdrom / root/cdroom/

Delete all original repo files

Create the source file of yum: vi / etc/yum.repos.d/my.repo

[centos-yum]

Baseurl= file:///root/cdroom

Enabled=1

Gpgcheck=0

Open the NTP service

Yum install ntp

Systemctl is-enabled ntpd

Systemctl enable ntpd

Systemctl start ntpd

 installs the Apache Http service (only needs to be installed on hdp21)

Yum install httpd

 starts the Apache Http service

Systemctl start httpd.service

Systemctl enable httpd.service

 validates the Http service and uses a browser to visit the following web pages:

192.168.164.21

(3) install JDK (per machine)

Be careful, this step is not the same as before!

L uninstall the original Java environment of the system

Step 1: view the installation packages for all current Java environments using the following command

Rpm-qa | grep java

Step 2: remove all Java installation packages using the following command

Rpm-e-- nodeps package name

L install the new JDK environment

Upload jdk-8u161-linux-x64.rpm to the / root/toolsm directory

Install JDK:rpm-ivh jdk-8u161-linux-x64.rpm

Z. execute the following command to set the environment variable:

Echo "JAVA_HOME=/usr/java/latest/" > > / etc/environment

L verify the JDK environment

!

(IV) configure MariaDB (on HDP21)

L start MariaDB

Systemctl start mariadb

Systemctl enable mariadb (Boot self-boot)

L configure MariaDB

Mysql_secure_installation

# the first step is to set the password, which will prompt you to enter the password first

Enter current password for root (enter for none):

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Internet Technology

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report