In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-02-27 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >
Share
Shulou(Shulou.com)06/03 Report--
Vdbench multi-node test file system read and write
Procedure:
1. First install java (including master control node) on each node that needs to be tested
two。 Then make sure that the hostname of each node is different, and it is best to turn off each firewall
3. Mount the network storage to be tested on each node
4. Then operate each node in turn, enter the vdbench directory with cmd, and run "vdbenchrsh" (enter listening mode)
5. Open the host file on the master control and write down the ip and hostname of each node.
6. To the master control node, use cmd to enter the vdbench directory and run "vdbench-f parmfile" (parmfile is a pre-configured configuration file)
Write operation profile:
Hd=default,shell=vdbench
Hd=hd1,system=10.20.16.96
Hd=hd2,system=10.20.16.98
Hd=hd3,system=10.20.16.99
Fsd=default,depth=1,width=1,files=3,size=5g
Fsd=fsd1,anchor=Z:\\ 1
Fsd=fsd2,anchor=Z:\\ 2
Fsd=fsd3,anchor=Z:\\ 3
Fwd=default,operation=write,xfersize=1M,threads=2,fileio=random,fileselect=random,openflags=directio
Fwd=fwd1,fsd=fsd1,host=hd1
Fwd=fwd2,fsd=fsd2,host=hd2
Fwd=fwd3,fsd=fsd3,host=hd3
Rd=rd1,fwd= (fwd1-fwd3), fwdrate=max,format=yes
Read the operation profile:
Hd=default,shell=vdbench
Hd=hd1,system=10.20.16.96
Hd=hd2,system=10.20.16.98
Hd=hd3,system=10.20.16.99
Fsd=default,depth=1,width=1,files=3,size=5g
Fsd=fsd1,anchor=Z:\\ 1
Fsd=fsd2,anchor=Z:\\ 2
Fsd=fsd3,anchor=Z:\\ 3
Fwd=default,operation=read,xfersize=1M,threads=2,fileio=random,fileselect=random,openflags=directio
Fwd=fwd1,fsd=fsd1,host=hd1
Fwd=fwd2,fsd=fsd2,host=hd2
Fwd=fwd3,fsd=fsd3,host=hd3
Rd=rd1,fwd= (fwd1-fwd3), fwdrate=max,format=no
Interpretation of profile parameters:
Hd
Host definition (hd=default is the default configuration and will be applied to every hd you define)
System
IP address or network name
Fsd
Name of the file system definition
Depth
The number of levels to create under the locator
Width
The number of directories to be created under the locator
Files
Number of files to create at the lowest level
Sizes
File size to be created
Anchor
The directory in which the directory structure will be created (the mounted test directory)
Fwd
Name of the file system workload definition
Operation
Mkdir, rmdir, create, delete, open, close, read, write, getattr and setattr. Select a single file operation to perform.
Xfersizes
Block size processed by data transfer (read and write operations)
Threads
The number of concurrent threads for this workload. Each thread needs at least 1 file (the number of threads cannot be greater than the number of files)
Fileio
Random or sequential, indicating how the file Iramp O will be executed
Fileselect
Random or sequential, identifying how to select a file or directory
Rd
Run definition
Fwdrate
Number of file system operations performed per second
Format
Yes / no / only / restart / clean / directories
Actions to be performed before starting to run
Yes: delete the previous file structure and recreate directories and files according to the configuration file
No: the original file directory structure is used by default, and no files are created.
Elapsed
The running duration in seconds. Default is 30s.
Interval
Report interval sequence number, default 1s
Openflags
Use the "directio" value in Windows to eliminate caching
Statement interpretation:
The report output by default is in the output folder under the program directory
(you can also specify the report location "vdbench-f parmfile-o C:\ test\" when running the program.)
In the default report folder, mainly look at summary.html and totals.html
The entry data of "starting RD=format_for_rd1" in the report is to initialize the test environment (create folders, empty files, etc.), mainly looking at the next entry (self-defined)
Summary.html: record all the data information
Totals.html: record the average data after all data calculations
Note:
1. Test environment: multi-node, windows, file system, for testing linux/ block devices, please see the manual.
two。 The name of the configuration file is customized. for more parameters of the configuration file, please see the manual.
Appendix: (sample configuration file for single node is as follows)
Fsd=fsd1,anchor=C:\\ test,depth=1,width=1,files=2,size=5g
Fwd=fwd1,fsd=fsd1,operation=read,xfersize=1M,threads=1,fileio=random,fileselect=random,openflags=directio
Rd=rd1,fwd=fwd1,fwdrate=max,format=no,elapsed=30
Attachment: http://down.51cto.com/data/2366754
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.