Shulou(Shulou.com)05/31 Report--

This article will explain in detail what the communication format requirements of Hadoop and RPC are. The editor thinks it is very practical, so I share it for you as a reference. I hope you can get something after reading this article.

Hadoop's internal communication between nodes uses the RPC,RPC protocol to translate the message into a binary byte stream and send it to the remote node, which then deserializes the binary flow into the original message.

Serialization of Rpc requires the following:

1, compression, can play the effect of compression, the occupation of broadband resources should be small.

2. Fast, internal processes build high-speed links for distributed systems, so between serialization and deserialization must be

Fast, can not let the transmission speed become a bottleneck.

3. Extensible, the new server adds a parameter to the new client, and the old client can still use it.

4. Good compatibility and can support clients in multiple languages.

This is the end of this article on "what are the requirements for Hadoop and RPC communication formats?". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.