Shulou(Shulou.com)06/01 Report--

On November 15, 2019, the Ninth data Technology Carnival was held in Beijing with the theme of "Open Source Intelligent Cloud data-self-driven Development and Innovation leading the Future" to explore data value and discuss the intelligent future. SequoiaDB Giant Sequoia Database, as a leading financial-level distributed relational database, brings you the development trend and characteristics of the new generation of distributed database, and also helps you fully understand the current application scenarios of distributed database by sharing its rich financial practical experience.

Development trend of distributed Database

In the sharing of the main venue in the morning, Wang Tao, co-founder of Giant Sequoia Database, brought you a sharing entitled "New Generation distributed Database".

Wang Tao pointed out that with the mobile Internet and intelligence of financial business, traditional databases have been unable to cope with many problems such as large amount of data, rigid system architecture and high cost. At the same time, the existence of these problems has also become the driving force for the transformation of traditional business to distributed architecture.

At the same time, under the trend of micro-service application development and cloud platform in the future, the application is no longer built with "chimney-like" middleware plus database mode, but a complex mesh model built by thousands or even tens of thousands of micro-service programs. Therefore, the new generation of distributed database needs to be able to meet the needs of flexible expansion, high concurrency, high throughput, and agility of upper-level applications. SequoiaDB has an excellent performance in these areas, including:

Complete ACID support, transaction and consistency assurance

SQL is fully supported, and the syntax of the traditional database MySQL/PostgreSQL is fully compatible.

Distributed and scalable to cope with the change of data volume and realize the elastic expansion of storage layer and computing layer.

Multi-mode access interface, supporting multi-type data management and multi-mode access interface

HTAP transaction / analysis mixed processing capability to achieve physical isolation of data without interference with each other under complex business requirements.

Multi-tenant physical isolation and privilege management capabilities

WLM load management capabilities.

Break through the shackles and take off the distributed database application in the financial transaction scenario

As the representative of the industry's native distributed database and the new generation of distributed database, Giant Sequoia Database spans the new and old generations of distributed OLTP database, and finally insists on self-research and walks out of the characteristic technical route.

Giant sequoia database application scenarios include core transactions, data center, content management and real-time data services, etc., there are more than 50 bank customers, and the financial industry has formed a full-dimensional market matrix. Among them, Giant Sequoia database has more than 141physical servers in the largest single cluster of bank customers, and more than 544 billion management data records in a single cluster. It is one of the most widely used and largest domestic distributed database products in the financial industry.

Among them, in the distributed financial-level transaction scenario, the new generation of distributed database represented by Giant Sequoia database has been applied on a large scale and the scene is becoming more and more mature. From the practice of Giant Sequoia database, the transaction scenario requires several key points for distributed database: first of all, the support of ACID is necessary. From a database point of view, although many people are advocating that CAP can't have both, at the expense of consistency, we don't think this is desirable. For most companies, data is the core lifeline, we must not sacrifice the consistency and security of data for the sake of distribution, and we need to be responsible for the property and information of users. Therefore, the new distributed database for online transactions must have perfect support for traditional ACID and be compatible with the data security consistency of traditional Oracle DB2.

Second, SQL integrity. This is mainly from the perspective of compatibility with traditional applications and reuse of developers' capabilities. Generally speaking, SQL syntax compatibility integrity, as well as compatibility with existing standards, such as MySQL, Oracle, DB2, PostgreSQL and other mainstream protocols.

The next three are mainly from the perspective of the new technology. We all know that the future is the era of private clouds and micro-service applications, so as a distributed database, we not only position it as a replacement for a database in the past. The core value of distributed database is that it can provide database access to hundreds of small services separated from chimney architecture to micro-service architecture in the form of service resource pool at the database level.

Under this positioning, the database resource pool must meet the distributed elastic expansion on the basis of ensuring 100% compatibility with the traditional database. When the space and computing capacity in the resource pool are insufficient, the capacity needs to be expanded by dynamically adding computing storage nodes.

Secondly, multi-mode. In the past, the database only aimed at a specific application, and adopted the way of one-to-one binding between middleware and database, so it only needed to provide its own access mode. But when we pool database resources, the upper layer applications naturally face services from different developers, different business types, and different SLA levels, and we adopt different development processes, SQL standards, and security policies, so the distributed database must be able to support multiple mode access interfaces.

In addition, HTAP, that is, transaction analysis hybrid processing capacity. For example, for some accounting data, the core key application may come from the real-time use of these data by online trading business, but at the same time, some back-end real-time reports, or when security auditors need to conduct statistical analysis, businesses from different microservices may need to access the same data in the form of transaction and analysis at the same time. In this case, can we isolate the physical resources of the transaction and analysis business in the resource pool, and access the same data at the same time without interfering with each other?

Finally, data security is the most important product basic capability at the financial level, distributed database application transaction business needs to have more stringent high availability and data security. For financial trading business, "two places, three centers" and "multi-work" across data centers are "required courses". At present, with the continuous maturity of giant sequoia database and other distributed database technology, it is a general trend to apply distributed database to financial transaction business in the future.

SequoiaDB 3.4 distributed core transaction scenario re-evolution

At the conference, Giant Sequoia Database also formally introduced the recently released new version of SequoiaDB 3.4. at the same time, it updated and improved the tool matrix of Giant Sequoia database and SequoiaPerf performance diagnosis tools. We will disclose more details in the follow-up report.

Data technology is gradually becoming the core driving force for the progress of enterprises, and domestic databases have attracted more attention in the international market. Self-driven development, innovation leads the future, giant sequoia database will always adhere to independent research and development and technological innovation, and continue to lead the continuous development and progress of the new generation of distributed database.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.