Shulou(Shulou.com)06/03 Report--

This article is basically consistent with the official document, and will be marked where the details are different.

My environment:

Server1 192.168.1.201 4 core 8G 120g (solid state)

Server2 192.168.1.202 4 Core 8G 120G+500G (solid State)

Server3 192.168.1.203 4 Core 8G 120G+500G (solid State)

Server4 192.168.1.204 4-core 8G 120G+500G (solid state)

The above models use cobbler to install centos7.5 minimal in batch.

Modify the hosts file, turn off the firewall (batch off by default), turn off selinux (batch off by default)

Four hosts set secret-free login to each other.

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4::1 localhost localhost.localdomain localhost6 localhost6.localdomain192.168.1.201 server1192.168.1.202 server2192.168.1.203 server3192.168.1.204 server4

Ansible can be used for batch operations

0, all node operations, replace Ali source, epel

Wget-O / etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repowget-O / etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo

# yum clean all

# yum makecache fast

1, all node operations, add Cloudera source and keys

# wget https://archive.cloudera.com/cm6/6.0.1/redhat7/yum/cloudera-manager.repo-P / etc/yum.repos.d/# rpm-- import https://archive.cloudera.com/cm6/6.0.0/redhat7/yum/RPM-GPG-KEY-cloudera

2 yum server1, configure the jdk environment (here it is recommended to follow the official document yum installation, not recommended manual installation, the following Auto-TLS will have problems)

# yum install oracle-j2sdk1.8

3Query server1, install Clouder Manager Server (only cloudera-manager-server is recommended here)

# yum install cloudera-manager-server

4Jr server1 perfect enable Auto_Tls (enable https support, this is an optional operation, I encountered a problem later, in order to troubleshoot the problem, so I did not do this step)

5Force server1, install the database (Mariadb,Mysql is OK, according to personal preference, here Mysql is an example)

# wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm# rpm-ivh mysql-community-release-el7-5.noarch.rpm# yum update# yum install mysql-server modify the configuration file of the database # vim / etc/ my.cnf [mysqld] datadir=/var/lib/mysqlsocket=/var/lib/mysql/mysql.socktransaction-isolation = READ-COMMITTED# Disabling symbolic-links is recommended to prevent assorted security risks # to do so, uncomment this line:symbolic-links = 0key_buffer_size = 32Mmax_allowed_packet = 32Mthread_stack = 256Kthread_cache_size = 64query_cache_limit = 8Mquery_cache_size = 64Mquery_cache_type = maximum number of connections is set according to memory size 8G is about 600g max_connections = 550#expire_logs_days = 10#max_binlog_size = 100M#log_bin should be on a disk with enough free space.#Replace'/ var/lib/mysql/mysql_binary_log' with an appropriate path for your#system and chown the specified folder to the mysql user.log_bin=/var/lib/mysql/mysql_binary_log#In later versions of MySQL, if you enable the binary log and do not set#a server_id, MySQL will not start. The server_id must be unique within#the replicating group.server_id=1binlog_format = mixedread_buffer_size = 2Mread_rnd_buffer_size = 16Msort_buffer_size = 8Mjoin_buffer_size = 8M# InnoDB settingsinnodb_file_per_table = 1innodb_flush_log_at_trx_commit = 2innodb_log_buffer_size = 64Minnodb_buffer_pool_size = 4Ginnodb_thread_concurrency = 8innodb_flush_method = O_DIRECTinnodb_log_file_size = 512m [mysqld_safe] log-error=/var/log/ Mysqld.logpid-file=/var/run/mysqld/mysqld.pidsql_mode=STRICT_ALL_TABLES# systemctl enable mysqld# systemctl start mysqld

The database is set to start itself. After opening the database, initialize it and follow the prompts.

# / usr/bin/mysql_secure_installation

6Gen server1, follow the JDBC driver (see the official website)

Wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.46.tar.gztar zxvf mysql-connector-java-5.1.46.tar.gzmkdir-p / usr/share/java/cd mysql-connector-java-5.1.46cp mysql-connector-java-5.1.46-bin.jar / usr/share/java/mysql-connector-java.jar

7 scm server1, create the database (refer to the official website, earlier I observed that only one useful, but in order to follow up, I set up all of them. )

Mysql > CREATE DATABASEDEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;mysql > GRANT ALL ON.* TO'@'% 'IDENTIFIED BY''

8PowerServer1, verify the database link

# / opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm (mysql is the database type, scm database name, scm user name, and then enter the password, the success will be prompted as follows)

9, all nodes, critical step (rename this file)

# mv / usr/bin/host / usr/bin/host.bk

10 minute server1, start the clouder-scm-server service (it may take a long time, something to be written into the database)

# systemctl start cloudera-scm-server

View the log:

# tail-f / var/log/cloudera-scm-server/cloudera-scm-server.log

It is best to start with this line first, which means that the startup is normal.

INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server.

Browser login (automatically select Chinese and English according to browser language)

Http://192.168.1.201:7180

User name: admin

Password: admin

Download address of rpm package of cm6.0.1. If you need to install it manually, you can download it.

Https://archive.cloudera.com/cm6/6.0.1/redhat7/yum/RPMS/x86_64/

Time synchronization between the four nodes I use chrony, you can refer to

The writing is not good. If you have any questions, please correct them.

VX:85862870

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.