Shulou(Shulou.com)06/01 Report--

This article mainly explains the "cloudera offline installation and deployment documentation steps", the content of the article is simple and clear, easy to learn and understand, the following please follow the editor's ideas slowly in depth, together to study and learn the "cloudera offline installation and deployment documentation steps" bar!

Three centos servers

192.168.12.101 n1

192.168.12.102 n2

192.168.13.30 n3

Setting the server ip to static Ip,ip will not change because the machine restarts ip

[root@n1 ~] # cd / etc/sysconfig/network-scripts/

[root@n1 network-scripts] # cat ifcfg-eth0

DEVICE=eth0

HWADDR=74:D4:35:DD:F4:3B

TYPE=Ethernet

UUID=37e135e0-0fdf-4e7e-a20e-afa8a808fbde

ONBOOT=yes

NM_CONTROLLED=yes

BOOTPROTO=static

IPADDR=192.168.12.101

NETMASK=255.255.255.0

GATEWAY=192.168.12.1

1. Modify the network hostname

Vi / etc/sysconfig/network

Vi / etc/hosts

192.168.12.101 n1

192.168.12.102 n2

192.168.13.30 n3

2. Generate ssh login without key

Ssh-keygen-t rsa

Cat ~ / .ssh/id_rsa.pub > > ~ / .ssh/authorized_keys

Scp-r ~ / .ssh/authorized_keys root@n2:~/.ssh/

3. Uninstall jdk that comes with the system

It's best to uninstall openjdk first and install sun's jdk.

Check rpm-qa first | grep java

Rpm-e-- nodeps java-1.7.0-openjdk-1.7.0.45-2.4.3.3.el6.x86_64

Rpm-e-nodeps tzdata-java-2013g-1.el6.noarch

Rpm-e-- nodeps java-1.6.0-openjdk-1.6.0.0-1.66.1.13.0.el6.x86_64

4. Install jdk

/ / install jdk

Rpm-ivh oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

Configure jdk environment variables

JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera

JRE_HOME=/usr/java/jdk1.7.0_67-cloudera/jre

PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin

CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib

Export JAVA_HOME JRE_HOME PATH CLASSPATH

5. Install mysql database and modify mysql character encoding

Yum install mysql-server

/ / set boot to start

Chkconfig mysqld on

/ / start mysql

Service mysqld start

/ / enter mysql

Mysqladmin-u root password 'xxxx'

# activity monitor createdatabase amon DEFAULTCHARSET utf8 COLLATE utf8_general_ci

Set root to authorize access to all of the above databases:

# authorized root users have access to all databases on the master node

Grant all privileges on *. * to 'root'@'n1' identified by' xxxx' with grant option; flush privileges

Set the character set of mysql

Edit / etc/my.cnf file

View plaincopy

[client]

Default-character-set=utf8

[mysqld]

Character_set_server=utf8

6. The server completes adding users.

Useradd-system-home=/opt/cm-5.4.1/run/cloudera-scm-server/--no-create-home-shell=/bin/false-comment "Cloudera SCM User" cloudera-scm

Execute sql script to create cm database automatically. If the database already exists, delete the database first.

/ opt/cm-5.4.1/share/cmf/schema/scm_prepare_database.sh mysql cm- hlocalhost-uroot-proot-- scm-host localhost scm scm scm

7. Install CHD offline and put the downloaded package under this folder

/ opt/cloudera/parcel-repo/

Download path

Http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_vd.html#cmvd_topic_1

8. Modify agent configuration

/ opt/cm-5.4.1/etc/cloudera-scm-agent/config.ini

Server_host=n1 / / is the host name on the server side

Copy agent to another host

Scp-r / opt/cm-5.4.1 root@n2:/opt/

9. Installation of ancillary services

/ / install ntp service

Yum install ntp

Chkconfig ntpd on

Service ntpd start

/ / synchronize server host time

Ntpdate-u N1

If the online installation of the software package fails, modify the configuration file of the DNS of the corresponding network card

# vi / etc/resolv.conf

Modify the following

Nameserver 114.114.114.114 #

/ / turn off the firewall

Service iptables stop (temporary shutdown)

Chkconfig iptables off (takes effect after restart)

10. Start the service

/ opt/cm-5.4.1/etc/init.d/cloudera-scm-server start

/ opt/cm-5.4.1/etc/init.d/cloudera-scm-agent start

Thank you for reading, the above is the content of the "cloudera offline installation and deployment document steps". After the study of this article, I believe you have a deeper understanding of the steps of cloudera offline installation and deployment documentation, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.