Shulou(Shulou.com)05/31 Report--

This article shows you how to install and configure MPICH and MDTEST in the construction of BeeGFS development environment. The content is concise and easy to understand, which will definitely brighten your eyes. I hope you can get something through the detailed introduction of this article.

After installation, if we want to evaluate and test the performance of its metadata service, we can install the MDTEST tool as follows:

Install and configure MPICH

The MDTEST testing tool relies on the MPI protocol, so you need to install MPICH (an implementation of the MPI protocol) first.

Installation and configuration (all three nodes use the same operation):

# http://www.mpich.org/$ yum install-y gcc gcc-c++ gcc-gfortran$ wget http://www.mpich.org/static/downloads/3.3/mpich-3.3.tar.gz$ tar xvf mpich-3.3.tar.gz$ cd mpich-3.3/$. / configure-- prefix=/usr/local/mpich$ make-j $(nproc) & & make install$ cp-r examples/ / usr/local/mpich$ vi ~ / .bashrcPATH=$PATH:/usr/local/mpich/binMANPATH=$MANPATH:/usr/local/mpich/manexport PATH MANPATH$. ~ / .bashrc

Test whether the installation is normal (secret-free login needs to be configured for SSH among the three nodes):

$mpirun-np 10 / usr/local/mpich/examples/cpiProcess 2 of 10 is on sacd01Process 3 of 10 is on sacd01Process 8 of 10 is on sacd01Process 1 of 10 is on sacd01Process 0 of 10 is on sacd01Process 5 of 10 is on sacd01Process 9 of 10 is on sacd01Process 4 of 10 is on sacd01Process 7 of 10 is on sacd01Process 6 of 10 is on sacd01pi is approximately 3.1415926544231256 Error is 0.0000000008333325wall clock time = 0.002448$ vi serverssacd01:2sacd02:2sacd03:2$ mpirun-np 10-f servers / usr/local/mpich/examples/cpiProcess 6 of 10 is on sacd01Process 7 of 0 of 10 is on sacd01Process 5 of 10 is on sacd03Process 1 of 10 is on sacd01Process 2 of 10 is on sacd02Process 8 of 10 is on sacd02Process 9 of 10 is on sacd02Process 3 of 10 is on sacd02Process 4 of 10 is on sacd03pi is approximately 3.1415926544231256, Error is 0.0000000008333325wall clock time = 0.001612 install and configure MDTEST

Install and configure MDTEST:

$wget https://sourceforge.net/projects/mdtest/files/mdtest%20latest/mdtest-1.9.3/mdtest-1.9.3.tgz$ mkdir mdtest-1.9.3 & & tar xvf mdtest-1.9.3.tgz-C mdtest-1.9.3 & & cd mdtest-1.9.3 $MPI_CC=mpicc make$ cp mdtest / usr/bin/

Test that the installation is normal:

$cd / mnt/beegfs/$ mdtest- I 10-z 5-b 2-L cd-started at 05 Inodes 08 mdtest-1.9.3 was launched with 9 17:17:42-mdtest-1.9.3 was launched with 1 total task (s) GiB Used FS 1 node (s) Command line used: mdtest- I 10-z 5-b 2-LPath: / mntFS: 122.3 GiB Used FS: 11.0% Inodes: 61.2 Mi Used Inodes: 1.8% 1 tasks 630 files/directoriesSUMMARY: (of 1 iterations) Operation Max Min Mean Std Dev-Directory creation: 1305.970 1305.970 1305.970 0.000 Directory stat: 2253.825 2253.825 2253.825 0.000 Directory removal: 1170.048 1170.048 1170.048 0.000 File creation: 1045.978 1045.978 1045.978 0.000 File stat: 2025.179 2025.179 2025. 179 0.000 File read: 1334.224 1334.224 1334.224 0.000 File removal: 1623.509 1623.509 1623.509 0.000 Tree creation: 429.608 429.608 429.608 0.000 Tree removal: 799.761 799.761 799.761 0.000np-finished at 05on 08on 2019 17:17:45-$vi serverssacd01:2sacd02:2sacd03:2$ mpirun-np 10-f servers mdtest- d / mnt/beegfs-I 10-z 5-b 2-L started at 05qure 2019 vi serverssacd01:2sacd02:2sacd03:2 17:25:13-mdtest-1.9.3 was launched with 10 total task (s) on 2 node (s) Command line used: mdtest- d / mnt/beegfs-I 10 -z 5-b 2-LPath: / mntFS: 122.3 GiB Used FS: 64.1% Inodes: 61.2 Mi Used Inodes: 2.5 tasks 6300 files/directoriesSUMMARY: (of 1 iterations) Operation Max Min Mean Std Dev-Directory creation: 2778.114 2778.114 2778.114 0.000 Directory stat: 4538.071 4538.071 4538.071 0.000 Directory removal: 3858.621 3858.621 3858.621 0.000 File creation: 2146.615 2146.615 2146.615 0.000 File stat: 4305.599 4305.599 4305. 599 0.000 File read: 3106.186 3106.186 3106.186 0.000 File removal: 3695.281 3695.281 3695.281 0.000 Tree creation: 670.204 670.204 670.204 0.000 Tree removal: 748.542 748.542 748.542 0.000servers mdtest--finished at 05node 08node-$mpirun-np 10-f servers mdtest- d / mnt/beegfs-I 2-b 10-u-L-started at 05node 2019 17:26:11-mdtest-1.9.3 was launched with 10 total task (s) on 2 node (s) Command line used: mdtest- d / mnt/beegfs-I 2-I 100- B 10-u-L-FPath: / mntFS: 122.3 GiB Used FS: 64.1% Inodes: 61.2 Mi Used Inodes: 2.5 tasks 1000 filesSUMMARY: (of 2 iterations) Operation Max Min Mean Std Dev-File creation: 2150.731 1990.272 2070.502 80.229 File stat: 4334.598 4025.630 4180.114 154.484 File read: 2337.454 2256.293 2296.873 40.581 File removal: 4273.461 3998.520 4135.991 137.470 Tree creation: 243.232 55.898 149.567 93.666 Tree removal: 296.417 265.496 280.957 15.461 UV-finished at 05Accord 08Universe 2019 17:26:13--

View command help:

Mdtest-- helpUsage: mdtest [- b branching_factor] [- B] [- c] [- C] [- d testdir] [- D] [- e number_of_bytes_to_read] [- E] [- f first] [- F] [- h] [- I iterations] [- I items_per_dir] [- l last] [- L] [- n number_] Of_items] [- N stride_length] [- p seconds] [- r] [- R [seed]] [- s stride] [- S] [- t] [- T] [- u] [- v] [- V verbosity_value] [- w number_of_bytes_to_write] [- y] [- z depth]-b: branching factor of hierarchical directory structure -B: no barriers between phases-c: collective creates: task 0 does all creates-C: only create files/dirs-d: the directory in which the tests will run-D: perform test on directories only (no files)-e: bytes to read from each file-E: only read files/dir-f: first number of tasks on which the test will run-F: perform test On files only (no directories)-h: prints this help message-I: number of iterations the test will run-I: number of items per directory in tree-l: last number of tasks on which the test will run-L: files only at leaf level of tree-n: every process will creat/stat/read/remove # directories and files-N: stride # between neighbor tasks for file/dir operation (local=0) -p: pre-iteration delay (in seconds)-r: only remove files or directories left behind by previous runs-R: randomly stat files (optional argument for random seed)-s: stride between the number of tasks for each test-S: shared file access (file only No directories)-t: time unique working directory overhead-T: only stat files/dirs-u: unique working directory for each task-v: verbosity (each instance of option increments by one)-V: verbosity value-w: bytes to write to each file after it is created-y: sync file after writing-z: depth of hierarchical directory structure the above is how to install and configure MPICH and MDTEST in the construction of BeeGFS development environment Have you learned any knowledge or skills? If you want to learn more skills or enrich your knowledge reserve, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.