Shulou(Shulou.com)05/31 Report--

It is believed that many inexperienced people have no idea about the access interface of HBase database. Therefore, this paper summarizes the causes and solutions of the problem. Through this article, I hope you can solve this problem.

HBase is a distributed, column-oriented open source database. This technology comes from the Google paper "Bigtable: a distributed Storage system for structured data" written by Changetal. Just as Bigtable takes advantage of the distributed data storage provided by the Google File system (FileSystem), HBase provides Bigtable-like capabilities on top of Hadoop. HBase is a subproject of Apache's Hadoop project. Different from the general relational database, HBase is a database suitable for unstructured data storage. Another difference is that HBase is column-based rather than row-based.

HBase-HadoopDatabase is a distributed storage system with high reliability, high performance, column-oriented and scalable. Large-scale structured storage cluster can be built on cheap PCServer by using HBase technology. HBase is an open source implementation of GoogleBigtable, similar to GoogleBigtable using GFS as its file storage system and HBase using HadoopHDFS as its file storage system; Google runs MapReduce to deal with massive data in Bigtable, HBase also uses HadoopMapReduce to deal with massive data in HBase; GoogleBigtable uses Chubby as a collaborative service and HBase uses Zookeeper as its counterpart.

HBase access interface

NativeJavaAPI, the most conventional and efficient access method, is suitable for HadoopMapReduceJob parallel batch processing of HBase table data

HBaseShell,HBase command line tool, the simplest interface, suitable for HBase management

ThriftGateway, using Thrift serialization technology, supports many languages, such as Clearing, recording, recording, PHP, Python, and so on. It is suitable for other heterogeneous systems to access HBase table data online.

RESTGateway, which supports REST-style HttpAPI access to HBase, lifting language restrictions

Pig, you can use PigLatin streaming programming language to manipulate data in HBase. Similar to Hive, it is ultimately compiled into MapReduceJob to deal with HBase table data, which is suitable for data statistics.

Hive, the current Release version of Hive has not yet added support for HBase, but HBase will be supported in the next version of Hive0.7.0, and HBase can be accessed using a language similar to SQL.

The main functional features of HBase are:

Support billions of rows, X and millions of columns

Using distributed architecture Map/reduce

Optimize real-time query

High performance Thrift Gateway

The prediction of query operation is realized by scanning and filtering on the server side.

HTTP that supports XML,Protobuf and binary

Shell based on Jruby (JIRB)

Configuration changes and minor upgrades will be rolled back

There will be no single point of failure

Comparable to the random access performance of MySQL

After reading the above, have you mastered the methods of accessing the HBase database? If you want to learn more skills or want to know more about it, you are welcome to follow the industry information channel, thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.