Shulou(Shulou.com)06/02 Report--

Big data developed Volume 5

​-Elasticsearch distributed installation steps

Consider the need to install elasticsearch-head as a web presentation, so the first installation of nodejs is mainly using npm.

Wget https://npm.taobao.org/mirrors/node/v11.0.0/node-v11.0.0.tar.gz

Tar-zxvf node-v11.0.0.tar.gz

Cd node-v11.0.0

Yum install gcc gcc-c++

. / configure

Make

Make install

Node-v

Start installing elasticsearch

1. Install 3 virtual machines

2. Install jdk

Decompress tar-zxvf elasticsearch7.2.2

Switch user su cm (elasticsearch cannot be started under root user)

After startup, the host cannot access the processing scheme (startup command: sh elasticsearch in the bin directory)

A) modify config/elasticsearch.yml

Cluster.name: es-app # cluster name, which can be modified by yourself

Node.name: es-1 # node name, modify it by yourself

Network.host: 192.168.235.133 # host address, here write native IP

Http.port: 9200 # port

Http.cors.enabled: true # setting cross-domain

Http.cors.allow-origin: "*" # set access

B) start again to see why it cannot be started

[1]: max file descriptors [4096] for elasticsearch process is too low, increase to at least [65536]

[2]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]

​ i. Problem 1 the maximum number of files in the system is too low

Modify the append at the end of vi / etc/security/limits.conf file

Cm soft nofile 65536

Cm hard nofile 131072

Cm soft nproc 4096

Cm hard nproc 4096

​ ii. Problem 2 Virtual memory is too low

Modify the append at the end of vi / etc/sysctl.conf file

​ vm.max_map_count=655360

Switch to root permission

​ sysctl-p

​ iii. Java.nio.file.AccessDeniedException: … / elasticsearch-6.2.2/config/jvm.options

Chown user name elasticsearch-6.2.2 installation directory path-R

You can first install elasticsearch-head to monitor the elasticsearch cluster environment

A) tar-zxvf elasticsearch-head-master

B) npm install

C) npm run start

Configure the slave node server

Cluster.name: es-app # cluster name, which can be modified by yourself

Node.name: es-2 # node name, modify it by yourself

Network.host: 192.168.235.132 # host address, write native IP here

Http.port: 9200 # port

Discovery.zen.ping.unicast.hosts: ["192.168.235.133"] # set up the command of the cluster

Similarly configure the third node

Start installing LogStash

The nodejs file is written by c and needs to be yum install gcc gcc-c++ first.

Then compile the nodejs file directly with make

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.