Shulou(Shulou.com)06/01 Report--

Connect to: http://onlyoulinux.blog.51cto.com/7941460/1554951

As mentioned above, there are a large number of errors reported with hadoop2.4.1 distributed combined with hase0.94.23, which can not be solved. Finally, the same configuration with the new version of hbase0.96.2 did not report an error. I feel that it is a version compatibility problem. The error report is as follows:

Monday, September 22, 2014, 19:56:03 CST Starting master on nn

Core file size (blocks,-c) 0

Data seg size (kbytes,-d) unlimited

Scheduling priority (- e) 0

File size (blocks,-f) unlimited

Pending signals (- I) 5525

Max locked memory (kbytes,-l) 64

Max memory size (kbytes,-m) unlimited

Open files (- n) 1024

Pipe size (512 bytes,-p) 8

POSIX message queues (bytes,-Q) 819200

Real-time priority (- r) 0

Stack size (kbytes,-s) 10240

Cpu time (seconds,-t) unlimited

Max user processes (- u) 5525

Virtual memory (kbytes,-v) unlimited

File locks (- x) unlimited

2014-09-22 19 56 04681 INFO org.apache.hadoop.hbase.util.VersionInfo: HBase 0.94.23

2014-09-22 19 5615 04681 INFO org.apache.hadoop.hbase.util.VersionInfo: Subversion git://asf911.gq1.ygridcore.net/home/jenkins/jenkin

S-slave/workspace/HBase-0.94.23-r f42302b28aceaab773b15f234aa8718fff7eea3c

2014-09-22 19 UTC 56 UTC 04681 INFO org.apache.hadoop.hbase.util.VersionInfo: Compiled by jenkins on Wed Aug 27 00:54:09

2014-09-22 19 5615 05072 DEBUG org.apache.hadoop.hbase.master.HMaster: Set serverside HConnection retries=140

2014-09-22 19 56 05852 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 5615 05853 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05854 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05855 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05856 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05857 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05858 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05858 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 56 05859 INFO org.apache.hadoop.ipc.HBaseServer: Starting Thread-1

2014-09-22 19 5615 05863 INFO org.apache.hadoop.ipc.HBaseServer: Starting IPC Server listener on 60000

2014-09-22 1914 56 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics 05889: Initializing RPC Metrics with hostName=HMaster, port=60000

2014-09-22 19 5615 06510 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: The identifier of this process is 3210@nn

2014-09-22 19 built on 5615 06572 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09 Unix 30max 2012

17:52 GMT

2014-09-22 19 5615 06572 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=nn

2014-09-22 19 5615 06572 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67

2014-09-22 19 5615 06572 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation

2014-09-22 19 5615 06572 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.7.0_67/jre

"logs/hbase-root-master-nn.log" 165L, 30411C 1 top

At sun.nio.ch.SocketChannelImpl.finishConnect (SocketChannelImpl.java:739)

At org.apache.hadoop.net.SocketIOWithTimeout.connect (SocketIOWithTimeout.java:206)

At org.apache.hadoop.net.NetUtils.connect (NetUtils.java:489)

At org.apache.hadoop.ipc.Client$Connection.setupConnection (Client.java:434)

At org.apache.hadoop.ipc.Client$Connection.setupIOstreams (Client.java:560)

At org.apache.hadoop.ipc.Client$Connection.access$2000 (Client.java:184)

At org.apache.hadoop.ipc.Client.getConnection (Client.java:1206)

At org.apache.hadoop.ipc.Client.call (Client.java:1050)

... 18 more

2014-09-22 19 5615 18 228 INFO org.apache.hadoop.hbase.master.HMaster: Aborting

2014-09-22 19 5615 18 228 DEBUG org.apache.hadoop.hbase.master.HMaster: Stopping service threads

2014-09-22 19 56 15 18 28 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60000

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 0 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 1 on 60000: exiting

2014-09-22 19 on 56 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 2 on 60000: exiting

2014-09-22 19 5615 18 235 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 60000

2014-09-22 19 5615 18240 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder

2014-09-22 19 5615 18240 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder

2014-09-22 19 purl 56 18241 INFO org.apache.hadoop.hbase.master.HMaster: Stopping infoServer

2014-09-22 19 5615 18 247 INFO org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60010

2014-09-22 19 56 14 18 278 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down

2014-09-22 19 56 INFO org.apache.zookeeper.ZooKeeper: Session: 0x1489d3757740000 closed

2014-09-22 19 56 14 18 278 INFO org.apache.hadoop.hbase.master.HMaster: HMaster main thread exiting

2014-09-22 19 56 14 18 278 ERROR org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master

Java.lang.RuntimeException: HMaster Aborted

At org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster (HMasterCommandLine.java:160)

At org.apache.hadoop.hbase.master.HMasterCommandLine.run (HMasterCommandLine.java:104)

At org.apache.hadoop.util.ToolRunner.run (ToolRunner.java:65)

At org.apache.hadoop.hbase.util.ServerCommandLine.doMain (ServerCommandLine.java:76)

At org.apache.hadoop.hbase.master.HMaster.main (HMaster.java:2129)

2014-09-22 20 3515 5320 INFO org.mortbay.log: jetty-6.1.26

2014-09-22 20 3557557 INFO org.mortbay.log: Started SelectChannelConnector@0.0.0.0:60010

2014-09-22 20 35 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Deleting ZNode for / hbase/backup-masters/nn,60000,1

411389351537 from backup master directory

2014-09-22 20 35 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Node / hbase/backup-masters/nn,60000,14113893515

37 already deleted, and this is not a retry

2014-09-22 20 3558013 INFO org.apache.hadoop.hbase.master.ActiveMasterManager: Master=nn,60000,1411389351537

2014-09-22 20 INFO org.apache.hadoop.ipc.Client 3600237 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 0 tim

E (s).

2014-09-22 20 localhost/127.0.0.1:9000 36 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 01239. Already tried 1 tim

E (s).

2014-09-22 20 INFO org.apache.hadoop.ipc.Client 3602312 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 2 tim

E (s).

2014-09-22 20 localhost/127.0.0.1:9000 3615 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 03314. Already tried 3 tim

E (s).

2014-09-22 20 INFO org.apache.hadoop.ipc.Client 36 04320 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 4 tim

E (s).

2014-09-22 20 36 05321 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 5 tim

E (s).

2014-09-22 20 INFO org.apache.hadoop.ipc.Client 3663 22 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000. Already tried 6 tim

E (s).

2014-09-22 20 localhost/127.0.0.1:9000 36 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 07323 Already tried 7 tim

E (s).

2014-09-22 20 localhost/127.0.0.1:9000 36 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 08325. Already tried 8 tim

E (s).

2014-09-22 20 localhost/127.0.0.1:9000 36 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 09389. Already tried 9 tim

E (s).

2014-09-22 20 FATAL org.apache.hadoop.hbase.master.HMaster 36 09395: Unhandled exception. Starting shutdown.

Java.net.ConnectException: Call to localhost/127.0.0.1:9000 failed on connection exception: java.net.ConnectException: reject connection

At org.apache.hadoop.ipc.Client.wrapException (Client.java:1099)

At org.apache.hadoop.ipc.Client.call (Client.java:1075)

At org.apache.hadoop.ipc.RPC$Invoker.invoke (RPC.java:225)

At com.sun.proxy.$Proxy10.getProtocolVersion (Unknown Source)

At org.apache.hadoop.ipc.RPC.getProxy (RPC.java:396)

At org.apache.hadoop.ipc.RPC.getProxy (RPC.java:379)

At org.apache.hadoop.hdfs.DFSClient.createRPCNamenode (DFSClient.java:119)

At org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:238)

At org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:203)

At org.apache.hadoop.hdfs.DistributedFileSystem.initialize (DistributedFileSystem.java:89)

At org.apache.hadoop.fs.FileSystem.createFileSystem (FileSystem.java:1386)

Here is my configuration:

> hbase-env.sh

Export JAVA_HOME=/usr/java/jdk1.7.0_67/

Export HBASE_HOME=/usr/local/hbase-0.96.2-hadoop2

Export HADOOP_HOME=/usr/local/hadoop-2.4.1/

Export HBASE_MANAGES_ZK=false

> regionservers

[root@nn hbase-0.96.2-hadoop2] # cat conf/regionservers

Nn

Sn

Dn1

> hbase-site.xml

[root@nn hbase-0.96.2-hadoop2] # cat conf/hbase-site.xml

Hbase.rootdir

Hdfs://nn:9000/tmpdir

The directory shared by RegionServers.

Dfs.replication

two

The replication count for HLog and HFile storage. Should not be greater than HDFS datanode count.

Hbase.zookeeper.quorum

Nn,sn,dn1

Hbase.zookeeper.property.datadir

/ tmpdir/zookeeperdata/

Hbase.zookeeper.property.clientPort

2181

Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.

Hbase.cluster.distributed

True

Hbase.hregion.memstore.flush.size

5242880

Hbase.hregion.memstore.flush.size

5242880

Hbase.master

Master:60000

Start and verify:

A simple bash shell test:

[root@sn test] # hbase shell

2014-09-26 16 Configuration.deprecation 22 INFO [main] 26178: hadoop.native.lib is deprecated. Instead, use io.native.lib.available

HBase Shell; enter 'help' for list of supported commands.

Type "exit" to leave the HBase Shell

Version 0.96.2-hadoop2, r1581096, Mon Mar 24 16:03:18 PDT 2014

Hbase (main): 001VR 0 > list

TABLE

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/usr/local/hbase-0.96.2-hadoop2/lib/slf4j-log4j12-1.6.4.jar _ r _ r _ r]

SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jarr _ r _ r _ r]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

0 row (s) in 6.7970 seconds

= > []

Hbase (main): 002purl 0 > create

Create create_namespace

Hbase (main): 002 create 0 > test','stu_id','stu_xx'

0 row (s) in 18.0590 seconds

= > Hbase::Table-test

Hbase (main): 003 put 0 > test','1','stu_id:name','jaybing'

0 row (s) in 3.2750 seconds

Hbase (main): 004scan 0 > test'

ROW COLUMN+CELL

1 column=stu_id:name, timestamp=1411720116252, value=jaybing

1 row (s) in 0.2280 seconds

Hbase (main): 005 0 > list

TABLE

Test

1 row (s) in 0.2460 seconds

= > ["test"]

Hbase (main): 006purl 0 >

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.