Shulou(Shulou.com)06/03 Report--

What is MyCat?

From the point of view of definition and classification, it is an open source distributed database system and a server that implements MySQL protocol. Front-end users can regard it as a database agent, which can be accessed by MySQL client tools and command line, while its back-end can communicate with multiple MySQL servers using MySQL native protocol, or with most mainstream database servers using JDBC protocol. Its core function is to separate tables, libraries, reads and writes. Split a large table horizontally into N small tables and store them in a back-end MySQL server or other database. You can also specify multiple write libraries and multiple read libraries.

With the development of the current version, MyCat is no longer a simple MySQL agent, its back-end can support mainstream databases such as MySQL, SQL Server, Oracle, DB2, PostgreSQL and other mainstream databases, as well as MongoDB, a new type of NoSQL storage, and will support more types of storage in the future. In the view of end-users, no matter what kind of storage method, in MyCat, it is a traditional database table, which supports standard SQL statements for data operation. In this way, for the front-end business system, it can greatly reduce the difficulty of development and improve the speed of development.

What can MyCat do?

Simple read-write separation, which is the easiest to configure. It supports read-write separation and master-slave switching.

Sub-table and sub-library. For more than 10 million tables, a maximum of 100 billion of single-table slices are supported.

Multi-tenant applications, each application has a library, but the application only connects to Mycat, so that the program itself is not modified and multi-tenancy is realized.

The report system deals with the statistics of large-scale reports with the help of the sub-table ability of Mycat.

Instead of Hbase, analyze big data

As a simple and effective scheme for real-time query of massive data, for example, 10 billion frequently queried records need to be queried within 3 seconds.

MyCat distributed architecture design:

Based on distributed relational database, it is easy to deal with 10 billion-level data analysis scenario.

Ten billion-level data is stored horizontally in the data analysis architecture.

Overall thinking:

(1) using mycat's rules of database and table, 10 billion-level data is allocated horizontally to different nodes.

(2) implement one master and multiple backups on each node to achieve data backup and read-write separation.

(3) all write operations are first calculated in mycat according to the rules and are routed to the specified node for write operations.

(4) the aggregate query mycat will be apportioned to each node for calculation, and then summarized and processed based on the results of the node.

(5) using NBI big data visual analysis tool to seamlessly connect with Mycat

(6) through the drag-and-drop analysis provided by NBI big data Visual Analysis tool (http://nbi.easydatavis.com:8033), you can quickly complete all kinds of analysis reports and tens of billions of data, and respond to the user experience in seconds.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.