Shulou(Shulou.com)05/31 Report--

This article will explain in detail the example analysis of the hadoop2.6 configuration file. The editor thinks it is very practical, so I share it for you as a reference. I hope you can get something after reading this article.

Hdfs-site.xml

Dfs.nameservices

Mycluster

Dfs.ha.namenodes.mycluster

Nn1,nn2

Dfs.namenode.rpc-address.mycluster.nn1

Machine1.example.com:8020

Dfs.namenode.rpc-address.mycluster.nn2

Machine2.example.com:8020

Dfs.namenode.http-address.mycluster.nn1

Machine1.example.com:50070

Dfs.namenode.http-address.mycluster.nn2

Machine2.example.com:50070

Dfs.namenode.shared.edits.dir

Qjournal://node1.example.com:8485;node2.example.com:8485;node3.example.com:8485/mycluster

Dfs.client.failover.proxy.provider.mycluster

Org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider

Dfs.ha.fencing.methods

Sshfence

/ / Private key address

Dfs.ha.fencing.ssh.private-key-files

/ home/exampleuser/.ssh/id_rsa

Dfs.journalnode.edits.dir

/ path/to/journal/node/local/data

Automatic switching

Dfs.ha.automatic-failover.enabled

True

Core-site.xml

Fs.defaultFS

Hdfs://mycluster

/ / join the zookeeper cluster in core-site

Ha.zookeeper.quorum

Zk1.example.com:2181,zk2.example.com:2181,zk3.example.com:2181

Configure hadoop.tmp.dir

Yarn-site.xml

Yarn.resourcemanager.hostname

Master

Yarn.nodemanager.aux-services.mapreduce_shuffle.class

Org.apache.hadoop.mapred.ShuffleHandler

Yarn.nodemanager.aux-services

Mapreduce_shuffle

Zookeeper configuration

TickTime=2000

DataDir=/var/lib/zookeeper

ClientPort=2181

InitLimit=5

SyncLimit=2

Server.1=zoo1:2888:3888

Server.2=zoo2:2888:3888

Server.3=zoo3:2888:3888

This is the end of this article on "sample analysis of hadoop2.6 configuration files". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.