Shulou(Shulou.com)05/31 Report--

This article mainly introduces the example analysis of map-reduce, map and reduce in hadoop, which is very detailed and has certain reference value. Friends who are interested must finish it!

Map-reduce process

The green line in the middle is the shuffle (shuffle) process: the process after map and before reduce.

It can be understood that the data generated by a map is partitioned through the hash process but assigned to different reduce tasks, which is equivalent to the process of shuffling the data.

Map end process

Reduce process

The above is all the contents of the article "sample Analysis of map-reduce, map and reduce in hadoop". Thank you for reading! Hope to share the content to help you, more related knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.