Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Hadoop expands disk operation records

2025-02-28 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >

Share

Shulou(Shulou.com)06/03 Report--

Record cloudera expansion disk

1, 4 hosts, each adding a 2TB hard disk

2. First, briefly explain the steps.

A, partition, mount (mount directory (name, path) should be consistent)

B. in the mounted partition, create the corresponding folder and authorize

C. In the hdfs configuration interface of cdh, configure the directory of the new hdfs, then deploy the client configuration and scroll restart

3. Operation steps

Partition (LVM logical volumes):

# pvcreate / dev/sdc

# vgcreage Vgroup03 / dev/sdc

# lvcreate-n cdh01-L + 1.8T Vgroup03

# mkfs.ext4 / dev/mapper/Vgroup03-cdh01

Mount (be sure to enter in this order):

# mkdir / cdh01

# mount / dev/mapper/Vgroup01-cdh01 / cdh01

Power on and mount automatically

# vim / etc/fstab

Insert / dev/mapper/Vgroup03-cdh01 / cdh01 ext4 defaults 01

Save, exit

Create a folder:

# mkdir / cdh01/dfs

# mdkir / cdh01/dfs/dn

Authorization:

# chown-R hdfs:hadoop / cdh01/dfs/

-4 hosts do the same operation, and the partition mount directory should be consistent-

Log in to cdh and select HDFS from the cluster

Select configuration options in the middle section

In the menu bar on the left, select DataNode Default Group

Add a new directory to the "+" point after the existing directory, and then enter the directory we have mounted and save it.

Select instance option

Select the instance of DataNode and select scroll restart

After the restart, go to the interface of the HDFS cluster to see that it should have been successful.

Datanode group "Advanced", in the datanode volume selection strategy on the right, select "free space" so that the next two attributes ("10GB" and "0.75") will play a role in balancing space usage in each volume.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Internet Technology

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report