Shulou(Shulou.com)06/01 Report--

This article mainly explains the "method of installation and deployment of Storm". The content of the article is simple and clear, and it is easy to learn and understand. Please follow the editor's way of thinking to study and learn "the method of installation and deployment of Storm".

1. Installation of storm

When building a Storm cluster, it is divided into the following steps:

1. Set up zookeeper cluster

2. Install the dependent library of storm

3. Download and decompress Storm

4. Modify the configuration file

5. Start Storm

Step 1: build a zookeeper cluster

Zookeeper as the management coordinator of storm, zookeeper is essential.

Copy the installation package and extract tar-xvf zookeeper-3.3.6.deploy.tar.gz

Modify the zoo.cfg file in conf in the zookeeper directory

DataDir=/home/shaka/zookeeper/zookeeper-3.3.6/data

# the port at which the clients will connect

ClientPort=2181

# set logs

DataLogDir=/home/shaka/zookeeper/zookeeper-3.3.6/logs

# set server

Server.1= [IP]: 4887 IP 5887 / / is the native IP address

Modify the configuration file in the red section. Port 2181 can be kept by default. There is no special need to modify it.

After modifying the configuration file, start zkServer.sh start in the bin/ directory to check the zookeeper status, and stop the zkServer.sh status in the bin/ directory: zkServer.sh stop restart: zkServer.sh stop startup client: zkCli.sh-server 127.0.0.1 zkServer.sh status 2181 shows the root directory, file: ls / use the ls command to view the contents contained in the current ZooKeeper

Display the root directory, file: ls2 / view the current node data and see the number of updates and other data

Create the file and set the initial content: create / zk "test" create a new znode node "zk" and the string associated with it to get the file contents: get / zk confirm whether the znode contains the string we created

Modify the contents of the file: set / zk "zkbak" sets the string associated with zk

Delete file: delete / zk delete the znode you just created

Exit client: quit

Help command: help step 2: install the Storm dependency library to create the dependences directory under / home/user/, install the dependent library file copy zeromq,jzmq to this directory and extract the two files tar-xvf zeromq-4.0.4.tar.gz

Tar-xvf jzmq.deploy.tar.gz

Install zeromq

Cd zeromq-4.0.4./configure

Make (use ROOT users to execute make commands)

Make install (use the ROOT user to execute the make command) install jzmqcd jzmq

. / configure

Make (use ROOT users to execute make commands) make install (use ROOT users to execute make commands) step 3: install Storm to download the extracted files:

Tar-xvf apache-storm-0.9.2-incubating.deploy.tar.gz

Configure the environment variable vim ~ / .bash_profile to append the export STORM_HOME=/home/user/storm/apache-storm-0.9.2-incubatingexport PATH=$PATH:$STORM_HOME/bin overloaded environment variable. ~ / .bash_profile modify configuration file / home/user/storm/conf/storm.yaml# These MUST be filled in for a storm configuration

Storm.zookeeper.servers:

-"10.2.73.11"

Nimbus.host: "10.2.73.11" (the address is the same as that configured in zookeeper)

Storm.local.dir: "/ home/shaka/apache-storm-0.9.2-incubating/File_Storm"

1) if the Zookeeper cluster does not use the default port, then the storm.zookeeper.port option is also required.

2) nimbus.host: address of Nimbus machines in Storm cluster. Each Supervisor worker node needs to know which machine is Nimbus in order to download jars, confs and other files of Topologies, such as:

Nimbus.host: "111.222.333.444"

3) storm.local.dir: Nimbus and Supervisor processes are used to store a small amount of state, such as the local disk directory of jars, confs, etc., which needs to be created in advance and given sufficient access permissions. Then configure the directory in storm.yaml, such as:

Storm.local.dir: ". / workdir" starts Storm

Start Storm (start Zookeeper before that)

Storm nimbus &

Storm supervisor &

Storm ui &

After startup, you can use http://{nimbus host}: 8080 on windows's browser.

At this point, the installation of storm is complete.

A single node mode storm has been set up!

If the startup encounters an error:

Normclasspath = cygpath if sys.platform = = 'cygwin' else identity

Cause analysis:

Python2.4

Python2.6

Version problem, you need to specify version 2.6, method:

Rm / usr/bin/python

Ln-s / usr/local/bin/python2.6 / usr/bin/python

The method of expanding into a Strom cluster

Copy the software package under shaka/storm to the new machine exactly the same.

The configuration file does not need to be modified!

Because you have to share zk and nimbus

Configure environment variables

Vim / .bash_profile

Append export STORM_HOME=/home/shaka/storm/apache-storm-0.9.2-incubating

Export PATH=$PATH:$STORM_HOME/bin

How to start supervisro &:

Storm supervisor &

After startup, you can use http://{nimbus host}: 8080 on Liu Basketball in windows.

The installation of storm for this cluster version is complete.

A cluster mode storm has been set up! Thank you for reading, the above is the content of "the installation and deployment method of Storm". After the study of this article, I believe you have a deeper understanding of the installation and deployment method of Storm, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.