Shulou(Shulou.com)05/31 Report--

Editor to share with you what is the use of Streaming in Hadoop, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

Streaming is suitable for text processing and can handle binary streams.

When used in text mode, it has a row view of the data.

The input data of the map is passed to the map function through the standard input stream, and is transmitted line by line, and finally the result line is written to the standard output.

The key / value pair output by map is a line split by a tab, which is written to standard output in this form.

The input format of the reduce function is the same-key / value pairs split by tabs-and transmitted through the standard input stream.

The reduce function reads the input lines from the standard input stream, which has been sorted by the Hadoop framework according to keys, and finally writes the results to standard output.

The above is all the content of the article "what is the use of Streaming in Hadoop". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.