Shulou(Shulou.com)06/01 Report--

Editor today to take you to understand the hundreds of billions of massive database OceanBase what is the use, the knowledge points in the article are introduced in great detail. Friends who feel helpful can browse the content of the article together with the editor, hoping to help more friends who want to solve this problem to find the answer to the problem. Let's go deep into the knowledge of "what is the use of hundreds of billions of massive database OceanBase" with the editor.

Reading is the cheapest way to acquire knowledge.

OceanBase is a scalable relational database developed by Ali Group, which realizes cross-row and cross-table transactions on hundreds of billions of records and hundreds of terabytes of data.

The goal of OceanBase is to support hundreds of TB of data and hundreds of thousands of TPS, millions of QPS visits.

1. OceanBase system architecture:

1. Client: use OceanBase in exactly the same way as MySQL, supporting JDBC and C client access, and applications developed based on MySQL database can be migrated to OceanBase directly. 2. RootServer: manage all servers in the cluster, sub-table data distribution and replica management. RootServer generally has one master and one slave, and data synchronization is enforced between master and slave. Main functions: cluster management, data distribution and replica management. RootServer master / slave can achieve high availability through Linux HA, and VIP is shared between master / slave. 3. UpdateServer: stores the incremental update data of the OceanBase system, usually one master and one standby, and different synchronization modes can be used between the master and backup. Main function: the only module in the cluster that can accept writes. The UpdateServer update operation is first written to the memory table. When the memory table exceeds a certain value, a snapshot file can be generated and transferred to SSD. 4. ChunkServer: stores the baseline data of the OceanBase system, generally storing two to three copies, which can be configured. Main functions: store multiple child tables, provide reading services, perform periodic merging and data distribution. 5. MergeServer: receive and parse the user's SQL request, and forward it to the corresponding ChunkServer or UpdateServer after a series of operations such as lexical analysis, syntax analysis and query optimization. If the requested data is distributed on multiple ChunkServer, you also need to merge the data returned by multiple ChunkServer. The client can access the MergeServer directly. Main functions: protocol parsing, SQL parsing, request forwarding, result merging, multi-table operation, etc. MergeServer first parses the MySQL protocol requested by the client, extracts the SQL statement sent by the user, then performs lexical analysis and syntax analysis, generates the logical query plan and physical query plan of the SQL statement, and finally invokes various internal operations according to the physical plan, requesting each child table data to be forwarded to the corresponding ChunkServer, if it is a write operation. It will also be forwarded to UpdateServer.

II. OceanBase read and write transaction flow

User read-write requests are sent to MergeServer,MergeServer to parse the contents of these read-write transactions, such as lexical and grammatical analysis, schema checking, etc. For read-only transactions, MergeServer sends them to the corresponding ChunkServer to execute and then merge the execution results of each ChunkServer. For read-write transactions, MergeServer preprocesses them and sends them to UpdateServer for execution.

III. OceanBase extension

OceanBase combines the two technologies of distributed storage system and relational database. UpdateServer is equivalent to a high-performance in-memory database, while the bottom layer is realized by relational database technology. ChunkServer is equivalent to a distributed file storage system, similar to Google GFS.

IV. Comparison of storage media

Category

Read and write (IOPS) times per second

Price per GB (CNY)

Random reading

Random write

Memory

Tens of thousands of levels

one hundred and fifty

friendly

friendly

SSD disk

35000

twenty

friendly

Write magnification problem

SAS disk

one hundred and eighty

three

Disk seek

Disk seek

SATA disk

ninety

0.5

Disk seek

Disk seek

Thank you for your reading, the above is "what is the use of hundreds of billions of massive database OceanBase" all the content, learn friends to hurry up to operate it. I believe that the editor will certainly bring you better quality articles. Thank you for your support to the website!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.