Shulou(Shulou.com)06/02 Report--

This article is to share with you about the unified distributed database and file system mongodb and its storage cost solution for doing stations on aliyun. The editor thinks it is quite practical, so I share it with you for study. I hope you can get something after reading this article.

From Local Packaging Technology to Station-making Media maintenance in distributed Storage

The file system / packaging technology is inseparable from the client release of large local programs, which is common in gaming technology (just look at the expansion / asset library files that move a few gigabytes in the large 3D online game DATA). For example, the zip package is also a simple file system. However, in more complex scenarios, such as when you need to maintain updates and versioning when publishing a large number of small files, packaging + hash+ encryption technology (one index and one repository) is often used, such as mpq in the warcraft series. These are examples, so we won't go into details.

When it comes to WEB and stations, similarly, the static resources of WEB sometimes become huge, with pictures as small files as well as large files. Let's analyze these requirements in detail-first of all, distributed storage and its various schemes, from raw filesystem on the server to distributed file systems. To simple ftp,webdav (support for unified client synchronization etc.. Such as owncloud and davros), sliced file systems to the network disk (such as dropbox), to object storage technology (es2,aws,aliyun oss), to traditional databases and their combinations such as mysql+fuse files (aw3fs,okasoft), and even to stream made from release-free client resources in games based on cloud computing rendering, can be used to manipulate and store website files. Our current web stack is often a httpd page ui srv + a database srv + the program database entries maintained by specific WEB programs index local files or distributed files. It can be seen that the processing of storage is a basic link in the general web stack.

However, now all of these involve different technologies that are too fragmented, and the same storage uses a variety of different technologies, and none of them can make web store and maintain the website system as locally (except that OSS can be mounted to the local site a little closer to this). This makes the process of maintaining the site's static resources often painful, so is there a local way to maintain / back up the site system like packaged files? Uniformly back up the data / media of the website, and avoid the disadvantage that it is difficult to backup the tightly bound media and database like wordpress. Further, you can do the same as dokuwiki-free database, post and store, package, copy and take away, that is, the maintenance of the entire site.

Ps: integrated things tend to have a clean, simple facade. It can be transformed into a version suitable for developers at all levels, keeping the complexity behind the code. This is actually a common technology in modern development, in source code processing (syntax) and release (component technology). The facade in software abstraction and design patterns are such examples. Integrated things can also improve the simplicity of the application. Our job is to make the storage in web stacks self-contained, making it more integrated and easier to maintain. In the previous release / demonstration of this site, ocwp,cmserpone is an example of a certain program to make media maintenance maintenance-free. Owcp uses a network disk as the media backend, backup is to synchronize the network disk, and cmserpone exports a company's db. The next introduction of mongodb is more like a breakthrough. Unlike oss, which is not a database technology (it is clean and distributed storage), it is called a document database, which means website resources. It has the fact that gridfs itself is a file system, integrating mysql and fs. It can also be used as mysql to store program data, which you can think of as mysql+oss, or native storage backend for web apps (that shipped with webstack as ehanced lamp), which is a reasonable integration in the web stack.

Mongodb and easy / low-cost / pit-free station in Aliyun

Aliyun designs ECS in this way. In its product plan, it sells ECS as a computing product, not a versatile iaas product with storage / computing. (if you want to do this, it is technically possible, but the cost is very high. Ecs has no advantage in security / load / traffic, and its storage products have facilities and price concessions in this area.), therefore, there is oss,ecs file system in cloud storage. Block, including storage products such as rds,mongodo. For example, at the iaas layer, Aliyun wants users to use ecs+rds with it.

There is even a load ecs, and even, according to these, Ali proposes game solutions to users, e-commerce solutions, with the use of solutions.

But, this is a mess. And the composition of its storage cost includes not only the storage itself but also the traffic generated by the media in the storage.

I hope there is a plan. All-inclusive like ECS, but don't involve too many products and billing schemes. Only involves at most two products, and avoid the shortcomings of the above stations in ecs, and then match ecs. Aliyun Apsara for mongodb+ecs is such a kind. The traffic of these two products in the private network is free, and the outbound traffic in mongodb is free. The postpaid ecs only playing the web program should not generate too much traffic, so it is more cost-effective in terms of traffic bandwidth. Ecs+rds for mysql+oss is fine, but this solution involves at least three products.

In mongodb, you only need to rent mongodo, with a space that supports the program (such as Aliyun's free PHP space). In terms of program support, if you are a personal blog, you can choose app under the mean stack series of mature nodejs+mongodb (but you need at least an ecs, because the js in aliyun ews has been removed).

Installation method: download mongopress 0.2.3 under apps/wamdata/source, install admin/admin with default password, then import data at the back point where the installation is successful, download plupload 1.5.1, decompress 2 files plupload.js,plupload-html5.js to overwrite 2 files in mp-admin/js/plupload/.

Here are the results of my tests in the wam/wnm architecture used by msyscuione+ocwp:

-

Of course, its aliyun Apsara for mongodb is not inexpensive, sharing mongodb is cost-effective, in other words: to reduce the lowest cost of personal websites and the natural integration of similar products, my initial idea was that mailbox as an attachment to the website space and develop it into something like owncloud, but still inclined to web, that idea is a little crazy and a bit like the google openwave idea of the web1.0 era.

The above is the unified distributed database and file system mongodb and its storage cost solution for doing stations on aliyun. The editor believes that there are some knowledge points that we may see or use in our daily work. I hope you can learn more from this article. For more details, please follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.