Shulou(Shulou.com)06/01 Report--

Whim, for the database, thought of some interesting things and functions, can be regarded as a kind of imagination for the future development of the database, looking forward to the future powerful companies or scientific research institutions can really achieve.

One: distributed operating system-permanent operating system

Talking about the database, we should first talk about the operating system. After all, the database should be installed and deployed on the operating system.

At present, the common hard faults in application services are power supply, CPU, hard disk, memory, network and so on. These are common and irresistible faults. Under the non-distributed operating system, the resources of each server can not be used reasonably, even in the current K8S container era. At present, at the level of application services, there are bottlenecks such as read and write performance, CPU, memory, network and so on, but the database under the distributed operating system will break through these bottlenecks and will realize the application of permanent machines. In the case of no downtime and sufficient resources, all kinds of resources will automatically stretch and scale automatically, there will never be bottlenecks in performance, the overall resources will also be used reasonably, and application services will no longer care about hardware problems.

At present, it has realized the distribution of file storage (such as ceph and other file systems), but it has not realized the distribution of CPU, memory and network. Even if it only realizes the distribution of file system, it has also brought about great changes in the database, representing Aurora, PolarDB, etc., to achieve the separation of storage and computing. In hardware, there is basically no need to pay attention to the failure of hard disk, and the security, performance and flexible expansion ability have been greatly improved.

If the most important CPU, hard disk, memory and network are truly distributed, and there is no longer a distinction between stand-alone CPU, hard disk, memory and network, all resources are in a large pool, and all resources such as CPU and memory in all distributed clusters are shared by the cluster and can be shared, which can not only limit the use of service resources, but also achieve automatic elastic expansion. In that case, it is possible to provide 100% reliable application services. At this time, the service is not running on a physical machine, but dynamically running in a distributed operating system, even if one of the physical nodes fails, it will not affect the normal operation of the business or the security and reliability of the data.

It is not practical to talk about architecture without cost. The emergence of this kind of distributed operating system requires the support of software and hardware, but with the rapid development of software and hardware technology, it is believed that this kind of operating system will appear in the future.

Second: intelligent database

At present, the intelligence of database should be said to be automatic, and so is the intelligence of operation and maintenance. there are not many companies that really realize intelligence. For intelligent database, personal imagination should be the use of machine learning, automatic, adaptive to a variety of complex environment, unattended installation, deployment, operation and maintenance, and keep the database running in the best state at all times.

1: automatic tuning of performance parameters, no configuration file, automatic tuning of CPU, memory, hard disk, network, kernel, thread, TCP connection, etc., database startup and running process to maintain the settings of various parameters is the best, the performance of the database is the best.

2: automatically add and optimize the index, the database table does not need to specify the index when it is created, and the database creates the optimal index according to the real-time situation.

3: database operators can dynamically specify development specifications, such as disabling large fields, reporting errors directly when creating tables without primary keys, and increasing the audit function in database development specifications.

The automatic rewriting function of 4:SQL statements can automatically rewrite complex SQL, simplifying and optimizing the efficiency of SQL execution.

5: parallel query improves query efficiency.

6: detailed database table access statistics, can distinguish between hot and cold data, and can automatically separate hot and cold data, so that the database hot data is always in the best read and write state.

7: data storage column storage and row storage coexist, similar to excel, which can be calculated and read, realizing the real HTAP of the database, and perfectly supporting OLTP and OLAP scenarios.

8: cluster management is more simplified, stupid management is realized, deployment is completed, that is, mature clusters, and failover management is more secure and reliable.

Third: hybrid database

The current database can be said that you have me, I have you, you have, you support, I must also have, also have to support. All kinds of databases have their own optimal application scenarios, but the scenarios are diversified, resulting in the coexistence of Oracle, MySQL, PG, Redis, MongoDB, Flink, Kafka and other databases, which is a great challenge to R & D and operation and maintenance personnel. The more they are used, the more complex they are, but it takes a lot of effort to install these software.

In the future, there may be a kind of database, which has a variety of database specialties and can be used directly by zero code modification, just like MariaDB supports Oralce database, it only needs to modify sql_mode=Oracle to be fully compatible with oralce syntax. This kind of database may be a framework, other databases directly hot plug, plug and play. In the end, a database dominates the world.

Ideas are constantly being updated.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.