Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

How to add nodes to hadoop

2025-02-23 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)05/31 Report--

Editor to share with you how to add hadoop nodes, I hope you will learn something after reading this article, let's discuss it together!

The hadoop cluster needs to add 3 nodes.

The three hosts are configured with host, ssh login mutual trust with all the machines in the cluster, jdk1.7 and so on. All configurations, directories, etc., are consistent with other machines in the cluster.

After copying the installation files to the three hosts, distribute the modified configuration files to the corresponding directories of the three hosts at the same time.

Modify the slaves file for namenode, add the host for three hosts, and then distribute it to all datanode.

Execute on each of the three hosts:

Yarn-daemon.sh start nodemanager

Hadoop-daemon.sh start datanode

The two commands start nodemanager and datanode, respectively.

Perform load balancing, start-balancer.sh-threshold 5

Ensure that the files of hadoop are evenly distributed among the nodes.

After reading this article, I believe you have a certain understanding of "how to add new nodes in hadoop". If you want to know more about it, please follow the industry information channel. Thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report