Shulou(Shulou.com)05/31 Report--

This article mainly introduces "how to configure rack awareness in cdh3u6". In daily operation, I believe many people have doubts about how to configure rack awareness in cdh3u6. The editor consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts about "how to configure rack awareness in cdh3u6". Next, please follow the editor to study!

Just write topology.sh scripts and topology.data on namenode and jobtracker machines immediately

Configuration changes only need to restart the namenode and jobtracker processes

1.topology.sh script

HADOOP_CONF=/home/...hadoop/conf

While [$#-gt 0]; do

NodeArg=$1

Exec < ${HADOOP_CONF} / topology.data

Result= ""

While read line; do

Ar= ($line)

If ["${ar [0]}" = "$nodeArg"]; then

Result= "${ar [1]}"

Fi

Done

Shift

If [- z "$result"]; then

Echo-n "/ default/rack"

Else

Echo-n "$result"

Fi

Done

two。 Write topology.data files (only work on ip to prevent accidents. Both hostname and ip are configured, for example, ip of hostname1 is ip1)

Hostname1 / dc1/rack1

Hostname2 / dc1/rack3

Ip1 / dc1/rack1

Ip2 / dc1/rack3

3.core-site.xml configuration

Topology.script.file.name

/ home/...hadoop/conf/topology.sh

Hadoop2: net.topology.script.file.name

At this point, the study on "how to configure rack awareness in cdh3u6" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.