Shulou(Shulou.com)06/01 Report--

The arrival of cloud and big data era has led to the outbreak of data in various industries. In the face of the increasing business data, enterprise IT systems are facing unprecedented challenges in terms of performance, stability and scalability. How to effectively deal with the tide of cloud and big data to embrace change has become an urgent problem for enterprises.

In the data-driven era, the core of all competition will be attributed to the competition of IT system. However, the traditional database system architecture faces the following dilemmas:

1. The centralized storage system has become the bottleneck of access to Icano, and the cost of expansion is high.

2. Minicomputer + high-end storage, high cost, relatively closed, poor scalability.

3. Complex systems bring complexity of deployment and operation, operation and management.

Distributed Storage solution zData

In order to better ensure enterprise data security, data consistency and business continuity, and to help enterprises realize cloud system transformation with low cost and flexible system expansion and change, cloud and Enmo expert team developed a set of distributed storage solution zData based on years of data service experience.

The zData scheme is based on x86 servers and uses flash memory cards and InfiniBand switches to provide ultra-high processing power and IO throughput for Oracle databases.

ZData ultra-high performance index

ZData LightStorage storage software can support 10000 devices, a maximum capacity of 20p, a maximum of 1024 storage nodes, 31 devices per node, 32 compute nodes, a maximum of 64 resource pools, and storage resource pools composed of different storage media. As high as over one million IOPS, the throughput exceeds 10GB/s.

Due to the use of open x86 architecture and high-bandwidth and low-latency InfiniBand network, storage capacity, storage nodes and database nodes can be increased online at any time, and the system performance and processing capacity can be increased nearly linearly after the expansion.

The zData program provides quality services to enterprises in the following two forms:

? Distributed storage management software zData Light Storage

ZData Light Storage takes full advantage of internal direct-attached storage based on x86 servers to create virtual, scalable SAN with better performance than external traditional fibre Channel SAN, while reducing cost and complexity exponentially. Support the RDMA protocol in InfiniBand network, which can significantly reduce the CPU occupation and IO access delay, and has unparalleled performance advantages.

Under the benchmark, the zData architecture of three storage nodes can achieve nearly 1 million IOPS and exceed the throughput of 10GB/s.

ZData database all-in-one machine

ZData database all-in-one machine is a super-convergence solution independently developed by cloud and Enmo. Through high-bandwidth and low-latency InfiniBand interconnection, high-performance X86 server nodes and distributed storage with flash memory as the core realize resource pooling, linear expansion of dynamic resources and performance, and multi-tenant centralized management, high availability and scalability cloud database services with multi-tenant database software. Solve the current performance bottleneck and future resource agile expansion problems for user enterprises, and greatly improve user enterprise management and performance experience.

While meeting the high-performance needs of enterprises, zData database integrated machine realizes one-stop delivery, one-click deployment and automatic operation and maintenance, which not only reduces the skill requirements for IT personnel, but also greatly saves customer procurement and management costs, thus a good solution to a series of negative effects of traditional IT architecture on enterprises. In addition, zData can easily realize the multi-dimensional dynamic development of computing resources and storage resources with business changes, the linear growth of performance, and the dynamic addition of disk and storage node requirements.

Resource pooling for rapid deployment and dynamic expansion

The traditional IT system extension and change from the hardware purchase configuration to the database installation will bring high time and labor costs. Now the PaaS platform based on zData can realize the deployment, operation and expansion of the database with low cost and low requirements, pool resources through zData distributed storage management software, and realize the allocation and flexible recovery of resources on demand.

ZData architecture features:

1. Multidimensional dynamic expansion: compute nodes and storage nodes can be dynamically expanded on demand, with linear growth in capacity and performance

2. Resource pooling & clouding: pooling of computing resources and storage resources, unified management, distribution and expansion on demand

3. High performance: based on x86 servers, using flash memory cards and InfiniBand switches to achieve high processing power and IO throughput

4. Security & redundancy: all components are redundant, storage automatic mirroring and fault automatic reconstruction, no manual intervention and no impact on online business.

High availability implementation of zData

Redundancy and mirroring of zData data

ZData storage failure data migration

ZData elastic multi-dimensional expansion

For the lack of resources of computing nodes and storage nodes, it is convenient to dynamically expand. Computing resources can be multidimensional and dynamically expanded with business changes, and performance increases linearly; storage resources can be dynamically expanded with business changes, which can add both disks and storage nodes dynamically.

ZCache caching mechanism

The zData-based caching mechanism zCache can achieve the following functions:

? Support for writeback and pass-through mode

? Support for online startup and shutdown of cache

? Support for automatic / manual refresh of dirty data

? Support the dynamic control of refresh frequency and speed of dirty blocks

ZMonitor monitoring software

At the same time, in order to better monitor the operation status and performance of the database under the distributed storage architecture, zMonitor monitoring software is specially developed for the zData light all-in-one system, which can visually monitor the performance of all components of the all-in-one machine, automatic topology map, and multi-dimensional monitoring of the performance of the whole zData all-in-one machine.

ZMonitor has a complete alarm function, the alarm content includes detailed system event alarm functions, including host, database, hard disk life, etc.; at the same time, it will automatically discover and manage computing and storage resources; with detailed log and trend analysis functions.

Extensions to the zData architecture:

ZData disaster recovery: multiple data protection through remote deployment of disaster recovery center

ZData backup: remote data backup center through RMAN or NFS

Create scene-based solutions based on customer needs

ZData solution has best practices in many enterprises and organizations. With its distributed storage architecture with high computing power, high Imax O capability, high availability, high scalability and high robustness, it is the best choice for systems with high concurrency and high IO requirements. It has also been confirmed and recognized in the past practice.

? Guizhou traffic police

With the in-depth and extensive application of a business system of Guizhou traffic police, the problems in the planning and design of the original infrastructure and data architecture have gradually emerged. It is mainly manifested in the explosive growth of business data, the increase of business applications, the slow response of the system, the bottleneck of physical capacity expansion, and the service life of equipment. After the integration of zData all-in-one machine, the overall user experience has been greatly improved, and the business acceptance and management efficiency have been praised by users.

Performance improvement:

1. The overall performance is improved by 18 times: the core metric DBTIME is 3563.15 per hour per day before and 199.68 per hour per day after reconfiguration, and the performance is improved by 17.8 times.

2. The response of I _ pico is improved 1000 times: the average time of single request is 10.07 milliseconds before refactoring, and the average request time is shortened to 0.01ms after refactoring, and the efficiency of I _ picuro is improved 1007 times.

3. The performance of SQL is improved by 117x: the SQL execution efficiency of the illegal approval report is examined. It takes 10206.1 seconds for SQL execution before refactoring, and only 87.07s for SQL execution after refactoring, and the execution efficiency is improved 117x.

? Tian'an Life Insurance

With the rapid development of the company's business, the business support pressure of its core system and reporting system is also increasing, the peak throughput per second is more than 1G, the original system architecture has been unable to meet the rapid development of business growth momentum.

In the face of this situation, Tian'an decided to give priority to high-performance storage to solve the problem of Ipicuro. With the zData architecture with high computing power, high I / O capability and high availability, cloud and Enmo easily provide more than one million IOPS, exceeding the throughput capacity of 10GB/s, fully supporting the efficient operation of high concurrent transactions with huge IOPS requirements, as well as report reports and data warehouses with massive data throughput requirements, while achieving high performance requirements for Tian'an Life Insurance. It also greatly reduces the time cost and resource cost of the whole system, and becomes a model of integrated mechanization of business system in the insurance industry.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.