Shulou(Shulou.com)05/31 Report--

This article mainly introduces hadoop 2.7.1 how to dynamically add nodes, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

Add nodes dynamically

Hftest0001 (master node)

[hadoop@hftest0001 hadoop] $pwd/home/hadoop/hadoop-2.7.1/etc/hadoop [hadoop@hftest0001 hadoop] $cat masters hftest0001.webex.com [hadoop@hftest0001 hadoop] $cat slaves hftest0002.webex.com [hadoop@hftest0001 hadoop] $cat hdfs-site.xml dfs.replication 1.

Hftest0002 (data node)

[hadoop@hftest0002 hadoop] $pwd/home/hadoop/hadoop-2.7.1/etc/hadoop [hadoop@hftest0002 hadoop] $cat masters hftest0001.webex.com [hadoop@hftest0002 hadoop] $cat slaves hftest0002.webex.com [hadoop@hftest0002 hadoop] $cat hdfs-site.xml dfs.replication 1. [hadoop@hftest0001 hadoop-2.7.1] $. / bin/hdfs dfs- ls / tmpFound 1 items-rw-r--r-- 1 hadoop supergroup 1366 2016-01-28 13:48 / tmp/README.txt = > replication 1

Prepare:

Create a new node hftest0003

Modify hostname (/ etc/sysconf/network) and hosts (/ etc/hosts) to make clusters ping each other

Modify the slaves file to add a new node

Modify replication= > 2

[hadoop@hftest0001 hadoop] $pwd/home/hadoop/hadoop-2.7.1/etc/hadoop [hadoop@hftest0003 hadoop] $cat masters hftest0001.webex.com [hadoop@hftest0003 hadoop] $cat slaves hftest0002.webex.comhftest0003.webex.com [hadoop@hftest0003 hadoop] $cat hdfs-site.xml dfs.replication 2.

Note: all clusters need to be modified

[hadoop@hftest0001 hadoop-2.7.1] $pwd/home/hadoop/hadoop-2.7.1 launch datanode [Hadoop @ hftest0001 hadoop-2.7.1] $. / sbin/hadoop-daemon.sh start datanode.webui can verify [hadoop@hftest0001 hadoop-2.7.1] $. / sbin/start-balancer.sh-threshold 5 launch nodemanager [Hadoop @ hftest0001 hadoop-2.7.1] $. / sbin/yarn-daemon.sh start nodemanager.... .. [hadoop@hftest0001 hadoop-2.7.1] $. / bin/hdfs dfs-ls / tmpFound 2 items-rw-r--r-- 2 hadoop supergroup 101 2016-01-28 13:54 / tmp/NOTICE.txt = = > replication=2-rw-r--r-- 1 hadoop supergroup 1366 2016-01-28 13:48 / tmp/README.txt Thank you for reading this article carefully I hope the article "how to add nodes dynamically in hadoop 2.7.1" shared by the editor is helpful to everyone. At the same time, I also hope that you can support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.