Shulou(Shulou.com)05/31 Report--

This article mainly introduces how to configure Apache Storm cluster, which is very detailed and has certain reference value. Friends who are interested must finish it!

We use the following three machines to build a Storm cluster. This document is valid if we have installed zookeeper cluster and JDK.

192.168.1.96

192.168.1.45

192.168.1.34

The following operations are all done on the 96 machine without explanation.

Installation configuration

First download and decompress

Wget http://mirrors.noc.im/apache/storm/apache-storm-1.0.0/apache-storm-1.0.0.tar.gz tar xzvf apache-storm-1.0.0.tar.gz cd apache-storm-1.0.0

Secondly, edit the conf/storm.yaml file

1) storm.zookeeper.servers: the zk cluster address used by the storm cluster. If zk does not use the default port of 2181, then we need to add the configuration item of storm.zookeeper.port. 2) storm.local.dir is used to store a small amount of data, so we need to create a directory in advance. 3) nimbus.seeds let the worker node know which is nimbus in order to download topology's jar and conf. 4) supervisor.slots.ports for each Supervisor worker node You need to configure the number of worker that the worker node can run. Each worker occupies a separate port for receiving messages, and this configuration option is used to define which ports can be used by the worker. By default, four workers can be run on each node, on ports 6700, 6701, 6702 and 6703, respectively. 5) the cluster1 here corresponds to 96 ip 2 and 45 workers cluster3 to 34 machines. At the beginning, I wrote ip directly here, but when storm ui got up, I found that it was all localhost and there were two in nimbus, as shown in the figure below.

6) how to match ip with cluster1, cluster2 and cluster3? we need to configure the hosts and hostname of the machine. Take 96 as an example:

Synchronize storm to other machines

Scp-r apache-storm-1.0.0/ 192.168.1.45:/data/strawbird/apache-storm-1.0.0scp-r apache-storm-1.0.0/ 192.168.1.34:/data/strawbird/apache-storm-1.0.0

Start

Start Nimbus on the machine 96, start the Supervisor service bin/storm nimbus & bin/storm supervisor on the slave node 45 and 34 & start storm ui on the master node, and visit URL after testing that storm ui is started on the supervisor node: http://xxx.xxx.xxx:8080 does not display bin/storm ui correctly. After getting up, we can see the following screenshot, which is normal.

These are all the contents of the article "how to configure Apache Storm clusters". Thank you for reading! Hope to share the content to help you, more related knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.