In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-02-24 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >
Share
Shulou(Shulou.com)06/03 Report--
MogileFS is a set of efficient automatic file backup components developed by Six Apart and widely used in web2.0 sites including LiveJournal.
Features of MogileFS:
Work in the application layer, no single point, automatic file replication (the smallest unit of replication is class, not files), transfer neutral and transfer using nfs or http protocols.
The structure of MogileFS is as follows:
Tracker: is the core of mogilefs, is a scheduler, through the database to save meta-information, including daemon,class,host and other information, the main responsibilities: monitoring back-end mogstore nodes, and instructing store nodes to complete data addition, deletion, query, and replication between nodes.
Mogstore: the storage location of the actual data, usually a pseudo-http server.
Database: used to save the global information of a node.
1. Install MogileFS
a. Download MogileFS
MogileFS-Server: https://github.com/mogilefs/MogileFS-Server
MogileFS-Utils: https://github.com/mogilefs/MogileFS-Utils
Perl-MogileFS-Client: https://github.com/mogilefs/perl-MogileFS-Client
b. Installation:
Extract the file and enter it into the file
[root@clone3 nginx-1.11.12] # make Makefile.PL
[root@clone3 nginx-1.11.12] # make & & make install
[root@clone3 nginx-1.11.12] # yum install perl-IO-AIO123123
two。 Configuration file explanation
Parameter answer: total dosage 8
3. Start and test
1. Create the / var/run/mogilefsd directory and modify the group owner
[root@Master mogilefs] # mkdir-p / var/run/mogilefsd
[root@Master mogilefs] # chown-R mogilefs.mogilefs / var/run/mogilefsd/
two。 Create the / mog/mogdata directory and modify the group owner
[root@Master mogilefs] # mkdir-p / mog/mogdata
[root@Master mogilefs] # chown-R mogilefs.mogilefs / mog/mogdata/
3. Start the mogilefsd process and the mogstored process
[root@Master mogilefs] # service mogilefsd start
Starting mogilefsd
[root@Master mogilefs] # service mogstored start
Starting mogstored
* * the startup script here is installed using the rpm package and comes with it. Generally, there is no service script installed using make * *
4. Configure mogstord node hosts using administrative tools
* * actual access location of files * *
5. Access using a browser
Such a mogilefs distributed storage is set up, but the mogilefsd process and the mogstored process are on the unified host.
6. Load balancing design structure
7. Use nginx real, now reverse proxy
When using nginx reverse proxy mogilefs, you need to use a third-party module to enable the implementation of the proxy. Nginx does not support the proxy of mogilefs. Download the module as nginx_mogilefs_module, download address: http://www.grid.net.ru/nginx/download/nginx_mogilefs_module-1.0.4.tar.gz
* * for more information, please refer to the official document: http://www.grid.net.ru/nginx/mogilefs.en.html**
8. Configure two mogilefs host
When configuring two hosts, the mogilefsd process will read the information of the mogstord node in the database, which can only be configured according to the above description. It is recommended to configure on one mogilefsd node and the other node can read it in the database.
9. Test result
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.