Shulou(Shulou.com)11/24 Report--

CTOnews.com, January 18, China E-Cloud self-developed CeaStor massive distributed object storage has been officially released, mainly for massive unstructured data scenarios to achieve unified operation and management of data assets.

IDC estimates that unstructured data such as e-mail, video, photos, web pages, audio files, sensor data and web pages may account for 80 per cent of all global data by 2025. CTOnews.com learned that object storage combines the advantages of block storage and file storage, has the characteristics of high speed and large capacity, and is suitable for dealing with large amounts of unstructured data.

Chinese e-cloud CeaStor distributed object storage is designed based on cloud native multi-protocol integrated architecture, on which the rock engine is built as the core, leading the traditional distributed storage in efficiency.

Figure: cloud native multi-protocol integrated architecture multi-protocol storage services: a set of storage can provide block / file / object / big data services at the same time to meet the needs of various protocols.

Declarative storage resources: block and file storage resource services seamlessly dock cloud native applications in a declarative manner through customized CSI drivers.

Rapid self-healing of each fault: after the storage software stack module serves the POD fault, the new service POD is pulled up automatically and quickly to achieve rapid fault self-healing.

Automatic deployment, operation and maintenance: one-click automatic deployment of storage software PXE, one-click automatic inspection of storage management and automated sub-health inspection.

Agile release of new features: the use of cloud native features, the product has agile development advantages, users have the ability to quickly upgrade, while supporting operator push down to achieve computing power sinking.

Figure: the new rock engine architecture supports full-user mode design, saving a lot of processor time overhead; CPU resources are lock-free, which greatly improves the utilization efficiency of processors; independent collaborative model ensures the uninterrupted work of processors, and task switching time is reduced to nanosecond; media resources are lock-free, removing lock mechanism interference and avoiding resource competition; large IO pass-through and small IO aggregation, greatly improve the performance of random and small IO Intelligent cache read-ahead, greatly improve storage read performance.

China Electronic Cloud says CeaStor distributed object storage also has the following advantages:

Single bucket object infinite

In the face of a large number of electronic bill images, autopilot pictures, bayonet pictures, electronic files and other scenes, a single namespace often has trillions of unstructured file storage requirements, CeaStor distributed object storage can achieve unlimited number of objects per bucket.

CeaStor distributed object storage can automatically match the number of hard disks responsible for supporting metadata through metadata index dynamic slicing, which solves the problem that traditional object storage can not give full play to all hard disk capabilities due to too few metadata index fragments, and that too many slices lead to low efficiency of object enumeration. When there are storage anomalies (such as bad disk, crash restart, disconnection reconnection, etc.), the object repair of metadata index shard adopts lock-free incremental repair mechanism, so that the number of objects under the jurisdiction of each index shard can be increased infinitely; combined with multi-version control of new data, data repair can be achieved without affecting new data writing.

Large proportion of corrections and deletions

In large-scale cluster storage scenarios, it can support up to a large proportion of deletion correction of "32Secret2", and the space availability rate is as high as 94%, which can greatly reduce the investment cost of users.

Global Lifecycle Management

Through this feature, users can customize the rules, specify the scanning prefix and modification time of the object file, and set a valid period for the objects in the bucket, and the objects exceeding this period will be automatically deleted or moved to cheaper storage media. let the data of different activity levels dynamically match or automatically clear with different types of storage media to achieve more efficient data lifecycle management. Here are some sample use cases:

Demote objects longer than 90 days from SSD storage pool to HDD storage pool.

Delete objects created before January 1, 2022.

Only the 3 latest versions of each object are retained in versioning-enabled buckets.

Multi-tenant resource management

Multi-tenant feature provides unified resource management based on tenant granularity, allocating and managing resources with tenants as units, multiple tenants sharing the same physical storage system, and resource isolation between tenants to ensure security and privacy. In practical application, the design idea of multi-tenant technology is to use the multi-tenant model to bring a high degree of integration of resources, so as to improve the utilization of resources, reduce the resource cost of the organization, and ensure the security of resources at the same time.

Business load balancing

The applications of different business clients are configured with the same domain name. After DNS resolution, the domain name will be resolved into different VIP, and then the data will be scattered to the storage nodes of the corresponding VIP through polling or node load strategies, so as to achieve business load balancing. When a node failure occurs, the VIP of the node will drift to other healthy nodes, and the business on this node will quickly switch to the corresponding node for support.

The application scenarios of China E-Cloud CeaStor distributed object storage are as follows:

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.