Shulou(Shulou.com)06/01 Report--

This article is about how centOS6.5 installs hadoop2.7 and then installs hbase1.1.0.1 for fully distributed deployment. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Hbase's distributed environment needs to run on the hadoop environment, where the hadoop environment needs to be installed before deploying hbase.

(1) download hbase

Http://www.apache.org/dyn/closer.cgi/hbase/

Download version 1.1.0.1. (note: the following steps should be performed once on each server in the hbase cluster)

After the download is complete, upload the hbase-1.1.0.1-bin.tar.gz to each server in your cluster, and execute # tar-zxvf hbase-1.1.0.1-bin.tar.gz to extract it, and execute # mv hbase-1.1.0.1 hbase to change its directory name.

(2) configure the environment variables of hbase

# vi ~ / .bash_profile

Increase (hadoop is previously configured)

Export HBASE_HOME=/data/hbaseexport PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HBASE_HOME/bin:

(3) modify conf/hbase-env.sh

Export JAVA_HOME=/usr/java/jdk1.8.0_45export HBASE_MANAGES_ZK=true # this configuration information is set to be managed by hbase itself, without the need for a separate zookeeper. Export HBASE_HOME=/data/hbaseexport HADOOP_HOME=/data/hadoop export HBASE_CLASSPATH=$HADOOP_HOME/etc/hadoopexport HBASE_LOG_DIR=$HBASE_HOME/logs # Hbase log directory

(4) modify conf/hbase-site.xml

Hbase.rootdirhdfs://db2:9000/hbasehbase.cluster.distributedtruehbase.masterdb2:60000hbase.zookeeper.quorumpic1,pic2

Hbase.rootdir: specifies the storage directory of the local hbase

Hbase.cluster.distributed: specifies the operation mode of hbase, and true represents the fully distributed mode

Hbase.master: specify the master of the hbase and its port

Hbase.zookeeper.quorum: specify the cluster of zookeeper, separated by a comma of hostname. It is generally odd, because zookeeper has such a feature: as long as more than half of the machines in the cluster are working properly, then the whole cluster is available externally. That is to say, if there are 2 zookeeper, then as long as there is one dead zookeeper, it cannot be used, because 1 is not more than half, so the death tolerance of 2 zookeeper is 0; similarly, if there are 3 zookeeper, one is dead, there are still 2 normal ones left, more than half of them, so the tolerance of 3 zookeeper is 1; similarly, you will find a rule by enumerating more than a few: 2-> 0-3-> 1-0-4-> 1-5-> 2-6-> 2.

(5) modify the conf/regionservers file and add the datanode node hostname to the slaves file

Pic1pic2

(VI) optionally, it is said on the Internet that in order to avoid version conflicts between hadoop and hbase, the jar package of hadoop2.5 used in lib under the hbase installation directory can be replaced with 2.7.0. There is currently no replacement, and hbase is not actually used yet.

(7) make sure that all servers have been configured with the first to sixth steps of hbase, and that the hbase configuration is complete and ready to start.

(8) execute # start-hbase.sh (make sure hadoop is already running). My jdk here is 1.8, so the following message is prompted when starting. I don't know if it has any effect. But officially it works, but there is no well tested.

[hadoop@zhebuduan-db-2 hbase] $start-hbase.sh pic2: starting zookeeper, logging to / data/hbase/logs/hbase-hadoop-zookeeper-zhebuduan-pic-2.outpic1: starting zookeeper, logging to / data/hbase/logs/hbase-hadoop-zookeeper-zhebuduan-pic-1.outstarting master, logging to / data/hbase/logs/hbase-hadoop-master-zhebuduan-db-2.outJava HotSpot (TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0Java HotSpot (TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m Support was removed in 8.0pic1: starting regionserver, logging to / data/hbase/logs/hbase-hadoop-regionserver-zhebuduan-pic-1.outpic2: starting regionserver, logging to / data/hbase/logs/hbase-hadoop-regionserver-zhebuduan-pic-2.outpic1: Java HotSpot (TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0pic1: Java HotSpot (TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0pic2: Java HotSpot (TM) 64-Bit Server VM warning: ignoring option PermSize=128m Support was removed in 8.0pic2: Java HotSpot (TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0

(9) verification. Execute jps on each server to see if the hbase process exists.

Master host:

63385 NameNode

2363 Jps

63645 ResourceManager

1919 HMaster

Other child node hosts:

43872 Jps

43700 HRegionServer

57766 NodeManager

43577 HQuorumPeer

57643 DataNode

Thank you for reading! On "centOS6.5 how to install hadoop2.7 and then install hbase1.1.0.1 to achieve complete distributed deployment" this article is shared here, I hope the above content can be of some help to you, so that you can learn more knowledge, if you think the article is good, you can share it out for more people to see it!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.