Shulou(Shulou.com)05/31 Report--

This article analyzes "what is Cloud Computing object Storage"? The content is detailed and easy to understand. Friends who are interested in "what is Cloud Computing object Storage" can follow the editor's idea to read it slowly and deeply. I hope it will be helpful to you after reading. Let's follow the editor to learn more about "what cloud computing object storage is".

It may be a bit confusing for those who have never been exposed to object storage, what is object storage, what is the usage scenario, and are there any file system POSIX interfaces?

Definition of object storage by public cloud vendors

AWS S3

Amazon Simple Storage Service (Amazon S3) is an object storage service that provides industry-leading scalability, data availability, security, and performance. This means that customers of all sizes and industries can use it to store and protect any amount of data for use cases such as websites, mobile applications, backup and restore, archiving, enterprise applications, IoT devices, and big data analytics. AWS

Tencent Cloud

Object Storage (Cloud Object Storage,COS) is a distributed storage service introduced by Tencent Cloud without directory hierarchy and data format restrictions, which can accommodate large amounts of data and support HTTP/HTTPS protocol access. COS

Ali Yun

Object Storage Service (Object Storage Service,OSS) is a massive, secure, low-cost, highly reliable cloud storage service, which is suitable for storing any type of files. Flexible expansion of capacity and processing capacity, a variety of storage types to choose from, and comprehensively optimize storage costs. OSS

Qiniuyun

Qiniuyun Mass Storage system (KODO) is a self-developed unstructured data storage management platform that supports central and edge storage. After years of large-scale user verification, the platform has become one of the advanced technologies, and is widely used in various scenarios of massive data management. KODO

Object storage is a storage product form first introduced by AWS, and the S3 protocol of AWS has also become the de facto standard of object storage. The cloud storage service protocols of various cloud storage vendors are compatible with S3. From the descriptions of the four public cloud vendors at home and abroad, we can see several characteristics of object storage:

1. Huge amount of data, regardless of file size and number of files, is huge.

two。 The directory structure without file system adopts a flat hierarchical structure.

3. Easy to scale and relatively low cost

For a more detailed description, you can search for yourself on the Internet. Is there a more visual description of the characteristics of object storage? In the following vernacular, let's talk about my understanding:

Mass storage

Generally speaking, if the volume of block storage (public cloud is cloud disk) can reach the PB level, we all think it is quite large, but the volume of object storage is not enough for PB, at least it is supported by EB. The volume of object storage in domestic public cloud is basically at EB level (narrator: PB is not enough, EB is the norm).

Hierarchical structure

Object storage is a completely different storage form from file system and block storage. The hierarchical concepts embodied externally are: bucket, key, and no directory structure.

So some rookies may be confused. Can I still see objects organized in a directory hierarchy in Tencent Cloud, Aliyun, or other S3 clients?

In fact, that is just a client-side visual display, when your key name contains "/", some will help you appear as a directory, but this has nothing to do with the object storage itself (narrator: no directory, no directory, no directory). In other words, the logo you use to store the object store is (bucket,key), and download the object store only using: (bucket,key), but there is no other identity.

Easy to scale, low cost

The external service of object storage can claim that the space is unlimited, and users do not have to worry about the lack of space. I can save as much as you have (narrator: how much you have, how old I am).

Object storage products can also be subdivided into standard storage, archive storage, low-frequency storage and so on. Different products are suitable for different scenarios, so specific software and hardware solutions are allowed to limit costs.

For example, archival storage, this kind of storage is likely to be written for a year without reading it once, then the disk machine where the data is located can be powered on directly at ordinary times (narrator: in fact, this is simple to say, and the technical content is very high. Domestic should not have this kind of real archived storage with hardware, but just make a distinction on the product to preempt users)

For example, in addition to multiple copies of data redundancy, techniques such as erasure codes can be used to reduce data redundancy, so as to ensure equal reliability and reduce costs relatively (narrator: erasure codes are a good thing, we also use this)

Interface protocol

The de facto protocol standard of object storage is S3, which is based on the application protocol based on http, and the core interface is extremely simple (narrator: before doing block storage, I just came into contact with this, thinking, "how can I write data at 1m offset from object storage?" It turns out that there is no semantics for block storage corresponding to "modification" at all. Object storage provides only two abstract concepts: bucket and object. What are the interfaces between these two objects? here are the most important ones:

Bucket (bucket)

CREATE: creating buckets

LIST: enumerate buckets

DELETE: delete bucket

Object (object)

PUT: upload object

GET: download object

DELETE: deleting object

Object storage usage scene

Basically, the products and services of the Internet use object storage.

Massive short videos: for example, Douyin and Kuaishou's audio and video data are very suitable for object storage.

Static website, picture bed, etc.

Big data, AI data, these data are also very suitable for object storage

Surveillance video, massive logs, archived data, streaming data

Domestic public cloud vendors generally add additional value, such as multimedia data processing.

So much for sharing about what cloud computing object storage is. I hope the above content can improve everyone. If you want to learn more knowledge, please pay more attention to the editor's updates. Thank you for following the website!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.