Shulou(Shulou.com)06/03 Report--

1. Install dependency packages yum install epel-release -y yum install gcc gcc-c++ bc openssl-devel automake ncurses-devel libibverbs -y yum install libibverbs-devel libibverbs-utils librdmacm librdmacm-devel librdmacm-utils perl-Switch elfutils-libelf-devel -y2, librxe dev and rxe dev downloads

download address

Github: https://github.com/SoftRoCE/rxe-dev.git Github: https://github.com/SoftRoCE/librxe-dev.git

Note: rxe-dev download v18 version, i.e. rxe-dev-rxesubmissionv18

3, Install rxe-devunzip rxe-dev-rxe_submission_v18.zipcd rxe-dev-rxe_submission_v18/cp /boot/config-3.10.0-514.el7.x86_64 .config

Note: As root, execute the following command

make menuconfig

The selection screen will appear (if not, ncurse-devel needs to be installed)

Enter "/," then enter rxe, press enter to find options for rxe.

Enter the number 1 to select the "Software RDMA over Ethernet (ROCE) driver" setting, enter "M" to select the RDMA configuration, if M cannot be entered, enter a space.

Move to the save button, press enter, save to.config, exit the installation interface.

Then vi .config to confirm

CONFIGRDMARXE is m

CONFIGINFINIBANDADDRTRANS and CONFIGINFINIBANDADDRTRANS_CONFIGFS for y

make -j 4 make modules_install, it may prompt that some modules are missing midway, this does not matter, it does not matter. make install make headers_install INSTALL_HDR_PATH=/usr

Verify that the new kernel is in the grub boot. See/etc/grub.cfg to see. You can choose to boot the new kernel at boot time

4, Install librxe-devcd librxe-dev ./ configure --libdir=/usr/lib64/ --prefix= make make install

Restart the operating system, select 4.7.0-rc3 kernel when booting

After startup, check kernel version

uname -r5, Verify rdma[root@aboss ~]# rxe_cfg start Name Link Driver Speed NMTU IPv4_addr RDEV RMTU ens33 yes e1000 virbr0 no bridge virbr0-nic no tun [root@aboss ~]# rxe_cfg add ens33[root@aboss ~]# rxe_cfg status Name Link Driver Speed NMTU IPv4_addr RDEV RMTU ens33 yes e1000 rxe0 1024 (3) virbr0 no bridge virbr0-nic no tun

View rxe devices

The ibv devices program displays all the devices currently in the system, and the ibv devices info command gives specific information about each device

[root@aboss ~]# ibv_devices device node GUID ------ ---------------- rxe0 020c29fffe55c818[root@aboss ~]# ibv_devinfo rxe0hca_id: rxe0 transport: InfiniBand (0) fw_ver: 0.0.0 node_guid: 020c:29ff:fe55:c818 sys_p_w_picpath_guid: 0000:0000:0000:0000 vendor_id: 0x0000 vendor_part_id: 0 hw_ver: 0x0 phys_port_cnt: 1 port: 1 state: PORT_ACTIVE (4) max_mtu: 4096 (5) active_mtu: 1024 (3) sm_lid: 0 port_lid: 0 port_lmc: 0x00 link_layer: Ethernet6, softRoCE connectivity test

server

rping -s -a 192.168.1.133 -v -C 10

client

rping -c -a 192.168.1.133-v -C 107, About librdmacm compilation instructions git clone https://github.com/ofiwg/librdmacm.gitcd librdmacmyum install autoconf automake gettext gettext-devel libtool -y./ autogen.sh ./ configure make install8, FAQ

(1)If you clone a virtual machine, you need to solve the network card problem

(2)To use rdma, turn off firewall and selinx

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.