Shulou(Shulou.com)06/01 Report--

This article will explain in detail what the HDFS copy placement strategy is. The editor thinks it is very practical, so I share it for you as a reference. I hope you can get something after reading this article.

1. Each document is generally divided into three copies, when the actual situation requires (when the job demand is large, there will be 5 or 7 copies)

two。 First copy: when the node is on DN, the first copy is usually on DN, but in other cases (commit outside the cluster), the first copy can also be on a randomly selected disk with more space left and faster.

3. The second copy: placed on a rack different from the first copy.

4. The third copy: placed on a different rack from the second copy.

This is the end of this article on "what is the HDFS copy placement strategy?". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it out for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.