Shulou(Shulou.com)05/31 Report--

This article introduces the relevant knowledge of "what is the method of building a Storm DRPC cluster". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

1. What is DRPC

RPC: remote procedure call protocol

DRPC:rpc requests are streamed and processed

The RPC request parameter is used as the input stream and the result as the output stream

Using the distributed processing mechanism and capability of Strom

Receive the request and return the response with the help of RPC server

* storm can only obtain data, but cannot receive requests and send responses, so here is a DRPC Server to help with it.

* DRPC server coordination: 1. Receive a rpc request; 2. Send the request to storm topology;3 and receive the result from storm topology; 4. Send the result back to the waiting client.

2. Cluster construction of DRPC

Import installation package

Pip-8.0.0.tar.gz

Setuptools-19.6.tar.gz

Thrift-0.9.3.tar.gz

# # using root users to install python Module

1), install python module, install thrift

Tar-zxvf pip-8.0.0.tar.gz

Tar-zxvf setuptools-19.6.tar.gz

Cd setuptools-19.6

Python setup.py install

Cd.. / pip-8.0.0

Python setup.py install

Tar-zxvf thrift-0.9.3.tar.gz

Cd thrift-0.9.3

Python setup.py install

2) change storm configuration

Vim conf/storm.yaml

Drpc.servers:

-"node1"

Scp storm.yaml root@node12:/usr/storm/conf/

Scp storm.yaml root@node13:/usr/storm/conf/

3) start drpc

Start the storm cluster as a prerequisite

ZkServer.sh start

Bin/storm drpc

4) Test

Bin/storm jar examples/storm-starter/storm-starter-topologies-0.9.4.jar storm.starter.BasicDRPCTopology drpc

There is a command to execute the task in the source package

Directory: / usr/apache-storm-0.9.4/storm-core/src/py/storm

. / DistributedRPC-remote-h 192.168.47.21 3772-f execute exclamation testdfdf

This is the end of the content of "what is the method of building a Storm DRPC cluster". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.