Shulou(Shulou.com)06/02 Report--

MFS

MooseFS file system can realize RAID function, save cost and realize online expansion. It is a semi-distributed file system.

1. The composition of MFS file system:

1 、 mfsmaster

Metadata server. Responsible for managing the file system in the whole system, MFS currently supports only one metadata server, master, which is a single point of failure and requires a server with stable performance. It is hoped that MFS can support multiple master servers in the future and further improve the reliability of the system.

2. Data storage service chunkserver

The server that stores user data. When storing files, first divide the files into blocks, and then copy these blocks between data servers chunkserver (the number of copies can be specified manually, it is recommended to set the number of copies to 3). There can be multiple data servers, and the greater the number, the greater the "disk space" that can be used and the higher the reliability.

3. MFS client

The client that uses the MFS file system to store and access the host is called MFS. After successfully attaching the MFS file system, you can share this virtual storage as before using NFS. Metadata server installation and configuration metadata server can be linux, can also be unix, you can choose the operating system according to your usage habits, in my environment, I use freebsd as the MFS metadata running platform. GNU source code, in all kinds of unix platform installation are basically the same.

II. Infrastructure

MFSmaster: 10.10.100.101

Metalogger: 10.10.100.102

Metalogger can also be on the same station as master.

Chunkserver:10.10.100.103-105

Client: IP

1. Yum installation; set yum source

For EL6 family:

# curl "http://ppa.moosefs.com/MooseFS-3-el6.repo" > / etc/yum.repos.d/MooseFS.repo"

MooseFS.repo needs to set gpgcheck=0

2. MFSmaster management server

Mfsmaster.cfg main configuration file

9419 9420 9421 9422 ports are open by default

Configure the location of metadata storage

Metadata.mfs default metadata files need to be placed in the set DATA_PATH directory

# cat / etc/mfs/mfsmaster.cfg | grep-v ^ $| grep-v ^ #

DATA_PATH = / mfs/data

Mfsexports.cfg configures the mounted directory and its permissions

Mfsexports.cfg sets the attached directory and its permissions

# cat / etc/mfs/mfsexports.cfg | grep-v ^ $| grep-v ^ #

* / rw,alldirs,admin,maproot=0:0

* .rw

Metalogger-metadata log server

Main profile mfsmetalogger.cfg

Master_host

# cat / etc/mfs/mfsmetalogger.cfg | grep-v ^ $| grep-v ^ #

MASTER_HOST = 10.10.100.101

Configure the location of metadata storage

Metadata.mfs default metadata files need to be placed in the set DATA_PATH directory

3. Data storage server

# yum install moosefs-chunkserver

Chunkservers-data storage server

Main profile mfschunkserver.cfg

Master_host

Master_port

# cat / etc/mfs/mfschunkserver.cfg | grep-v ^ $| grep-v ^ #

DATA_PATH = / mfs/data

MASTER_HOST = 10.10.100.101

MASTER_PORT = 9420

Mfshdd.cfg specifies the space that the server allocates to MFS

Configure MFS Partition

/ mfsdata

Chown-R mfs:mfs / mfsdata

# cat / etc/mfs/mfshdd.cfg | grep-v ^ $| grep-v ^ #

/ mfs/data

4 、 port:

9419 metadata log service listening port

9420 chunk server data Storage Server Connector address

9421 client link hook link port

9422 chunkserver server port

9425 moosefs-cgiserv monitors the link status of clients

5. Clients client mount requires fuse plug-in

# yum install moosefs-client

# yum install fuse

# modprobe fuse (load fuse module)

Fuse Settings / etc/fstab

And then add one of the following entries to your / etc/fstab:

"classic" entry (works with all MooseFS 3.0 and 2.0 verisons):

Mfsmount / mnt/mfs fuse defaults 0 0

Or "NFS-like" entry (works with MooseFS 3.0.75 +):

Mfsmaster.host.name: / mnt/mfs moosefs defaults 0 0

3.

The client creates a mount point

Mkdir / mnt/mfs

Mount MFS

Mfsmount / mnt/mfs-H mfsmasterIP

(if you have a password, add a-p to enter the password; note that this is only mounting the same metadata server IP; not the iP; of the storage server)

Fourth, mfscgiserv monitors the link status of the client; check the status and services.

Http://MFSMASTER:PORT/ default port 9425

5. Source code compilation

# useradd mfs-s / sbin/nologin

# wget http://ftp5.gwdg.de/pub/linux/archlinux/extra/os/x86_64//fuse2-2.9.7-3-x86_64.pkg.tar.xz

# wget http://ppa.moosefs.com/src/moosefs-3.0.91-1.tar.gz

1. Management services, metadata services, storage services, for different services:

Mfsmaster

Mfschunkserver

Mfsmetalogger

Chown-R mfs:mfs / usr/local/mfs

Cd / usr/local/mfs

. / configure-- prefix=/usr/local/mfs-- with-default-user=mfs-- with-default-group=mfs

Make & & make install

2. MFS client

#. / configure-prefix=/usr/local/mfs-with-default-user=mfs-with-default-group=mfs-enable-mfsmount

# make & & make install

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.