Shulou(Shulou.com)06/01 Report--

This article mainly introduces how to expand the capacity of hdfs, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

Hdfs expansion operation

First, create a new subdirectory / dfs/dn in the mount directory [/ data3] of each partition, such as mkdir-p / data3/dfs/dn

Then modify the permissions of the dn directory: chown-R hdfs:hadoop / data3/dfs/dn

So that hdfs can use this directory (create a new / dfs/dn for each partition)

Open cloudera manager cloudmanager

Add directory / data3/dfs/dn addDir in datanode

Find Advanced, and in the datanode volume selection strategy on the right, select Free Space so that the next two attributes ("10Gbyte" and "0.75") will play a role in balancing space usage in each volume.

Restart each datanode restart-datanode

Save the above configuration, and then restart hdfs to expand the hdfs.

Thank you for reading this article carefully. I hope the article "how to expand the capacity of hdfs" shared by the editor will be helpful to everyone. At the same time, I also hope that you will support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.