Shulou(Shulou.com)06/03 Report--

1. Please refer to http://suyanzhu.blog.51cto.com/8050189/1946580 to prepare zookeeper server #node1,node2,node3#installation.

2. Prepare NameNode #node1, node4

3. Prepare JournalNode nodes #node2, node3, node4

4. Prepare DataNode node#node2,node3,node4#Start DataNode command hadoop-daemon.sh start dataNode

5. Modify hadoop hdfs-site.xml configuration file dfs.nameservices yunshuocluster dfs.ha.namenodes.yunshuocluster nn1,nn2 dfs.namenode.rpc-address.yunshuocluster.nn1 node1:8020 dfs.namenode.rpc-address.yunshuocluster.nn2 node4:8020 dfs.namenode.http-address.yunshuocluster.nn1 node1:50070 dfs.namenode.http-address.yunshuocluster.nn2 node4:50070 dfs.namenode.shared.edits.dir qjournal://node2:8485;node3:8485;node4:8485/yunshuocluster dfs.client.failover.proxy.provider.mycluster org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods sshfence dfs.ha.fencing.ssh.private-key-files /root/.ssh/id_dsa dfs.journalnode.edits.dir /opt/journalnode/ dfs.ha.automatic-failover.enabled true

6. Modify hadoop's core-site.xml configuration file fs.defaultFS hdfs://yunshuocluster hadoop.tmp.dir /opt/hadoop-2.5 ha.zookeeper.quorum node1:2181,node2:2181,node3:2181

7. configuring slaves configuration file node 2 node 3node4

8. Start zookeeper(node1,node2,node3)zkServer.sh start

9. Start Journalnode(execute the following commands on node2,node3,node4 respectively)#start command stop command hadoop-daemon.sh stop journalnodehadoop-daemon.sh start journalnode

10. Check Journalnode, by viewing logs cd /home/hadoop-2.5.1/logsltail-200 hadoop-root-journalnode-node2.log

11. Format NameNode(one of the two, format node4 here)hdfs nameNode -formatcd /opt/hadoop-2.5#Synchronization of two NameNodes scp -r /opt/hadoop-2.5/* root@node1:/opt/hadoop-2.5/

12. initialize zkfchdfs zkfc -formatZK

13. Start service start-dfs.sh #stop-dfs. sh means stop service

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.