Shulou(Shulou.com)06/01 Report--

This article will explain in detail how to set the number of Map in Mapreduce. The content of the article is of high quality, so the editor shares it for you as a reference. I hope you will have a certain understanding of the relevant knowledge after reading this article.

The description is as follows:

Setting the number of Map is not supported in the new version of MapReduce, namely MR on yarn.

The number of Map is determined by MinInputSplitSize, the formula:

Number of Map = TotalSize / MinInputSplitSize

To control the number of Map, you can control the number of Map by controlling the size of the MinInputSplitSize.

If the MinInputSplitSize is greater than BlockSize,MinInputSplitSize, the value is set; otherwise, the value of MinInputSplitSize less than BlockSize,MinInputSplitSize is set to BlockSize.

If the default setting is maintained, MinInputSplitSize is BlockSize

On how to set the number of Map in Mapreduce to share here, I hope the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.