Shulou(Shulou.com)06/03 Report--

Reference documentation

Https://blog.csdn.net/nwpushuai/article/details/79935740

Https://blog.csdn.net/qq_43030766/article/details/91513501

Https://blog.csdn.net/zhqh200/article/details/77646497

Https://www.cnblogs.com/zixuan-L/p/11023051.html

Https://blog.csdn.net/huangfei711/article/details/79230446

Https://www.cnblogs.com/yjlch2016/p/8641910.html

Hardware environment CPU I7-7700, 8m, 3.6GHz, Z, 4 cores, DDR4, 16G, hard disk, SSD, 500G system, Ubuntu, Desktop version (image interface required) graphics card NVDIA GeForce GTX1050Ti 4G system environment

1. Double network card binding

Root@mec03:~# cat / etc/modules# / etc/modules: kernel modules to load at boot time.## This file contains the names of kernel modules that should be loaded# at boot time, one per line. Lines beginning with "#" are ignored.bonding mode=0 miimon=100root@mec03:/etc/network# cat / etc/network/interfacesauto bond0iface bond0 inet staticaddress 172.30.10.249netmask 255.255.255.0gateway 172.30.10.254post-up ifenslave bond0 enp2s0 enp3s0pre-down ifenslave-d bond0 enp2s0 enp3s0 boot up and put in rc.local root@mec03:/etc/network# modprobe bonding shutdown network card management will conflict with bonding root@mec03:/etc/network# systemctl disable network-manager.service

two。 Set up the apt-list source

Root@mec03:~# cat / etc/apt/sources.listdeb http://mirrors.163.com/ubuntu/ xenial main restricted universe multiversedeb http://mirrors.163.com/ubuntu/ xenial-security main restricted universe multiversedeb http://mirrors.163.com/ubuntu/ xenial-updates main restricted universe multiversedeb http://mirrors.163.com/ubuntu/ xenial-proposed main restricted universe multiversedeb http://mirrors.163.com/ubuntu/ xenial-backports main restricted universe multiversedeb-src http://mirrors.163.com/ Ubuntu/ xenial main restricted universe multiversedeb-src http://mirrors.163.com/ubuntu/ xenial-security main restricted universe multiversedeb-src http://mirrors.163.com/ubuntu/ xenial-updates main restricted universe multiversedeb-src http://mirrors.163.com/ubuntu/ xenial-proposed main restricted universe multiversedeb-src http://mirrors.163.com/ubuntu/ xenial-backports main restricted universe multiverse

3. Default language settin

Root@mec03:~# cat / etc/default/locale # File generated by update-locale# LANG= "zh_CN.UTF-8" # LANGUAGE= "zh_CN:zh" LANG= "en_US.UTF-8" LANGUAGE= "en_US:en" II. Install the Nvidia GTX 1050TI driver

1. Disable the system default built-in nvidia driver

Root@mec03:~# lsmod | grep nouveaunouveau 1724416 1mxm_wmi 16384 1 nouveauwmi 24576 2 mxm_wmi,nouveaui2c_algo_bit 16384 1 nouveauttm 106496 1 nouveaudrm_kms_helper 172032 1 nouveaudrm 401408 4 drm_kms_helper,ttm,nouveauvideo 45056 1 nouveau

two。 Disable module

Root@mec03:~# vim / etc/modprobe.d/blacklist.conf adds the following lines at the end of the file: blacklist vga16fb blacklist nouveau blacklist rivafb blacklist rivatv blacklist nvidiafb

3. Update the kernel

Root@mec03:~# update-initramfs-uupdate-initramfs: Generating / boot/initrd.img-4.15.0-45-generic

4. Restart

Root@mec03:~# reboot

5. Upload cudnn_ cudn.zip package

Root@mec03:~# rzroot@mec03:~# lscudnn_cuda cudnn_cuda.ziproot@mec03:~# cd cudnn_cuda/root@mec03:~/cudnn_cuda# lscuda_10.0.130.1_linux.run libcudnn7-dev_7.6.3.30-1+cuda10.0_amd64.debcuda_10.0.130_410.48_linux.run libcudnn7-doc_7.6.3.30-1+cuda10.0_amd64.deblibcudnn7_7 .6.3.30-1+cuda10.0_amd64.deb NVIDIA-Linux-x86_64-435.21.run

6. Install the driver

Root@mec03:~/cudnn_cuda# systemctl stop lightdm.service root@mec03:~/cudnn_cuda# sh NVIDIA-Linux-x86_64-435.21.runVerifying archive integrity... OKUncompressing NVIDIA Accelerated Graphics Driver for Linux-x86_64 435.21. . . . .... root@mec03:~/cudnn_cuda# lsmod | grep nvinvidia_drm 45056 0nvidia_modeset 1118208 1 nvidia_drmnvidia 19472384 1 nvidia_modesetdrm_kms_helper 172032 1 nvidia_drmdrm 401408 3 drm_kms_helper Nvidia_drmipmi_msghandler 53248 2 ipmi_devintf,nvidia III. Install cuda 10.1root@mec03:~/cudnn_cuda# sh cuda_10.0.130_410.48_linux.runDo you accept the previously read EULA?accept/decline/quit: acceptInstall NVIDIA Accelerated Graphics Driver for Linux-x86_64 410.48? (y) es/ (n) o / (Q) uit: nInstall the CUDA 10.0 Toolkit? (y) es/ (n) o / (Q) uit: yEnter Toolkit Location [default is / usr/local/cuda-10.0]: Do you want to install A symbolic link at / usr/local/cuda? (y) es/ (n) o / (Q) uit: yInstall the CUDA 10.0 Samples? (y) es/ (n) o / (Q) uit: yEnter CUDA Samples Location [default is / root]: Installing the CUDA Toolkit in / usr/local/cuda-10.0... Installing the CUDA Toolkit in / usr/local/cuda-10.0. Missing recommended library: libGLU.soMissing recommended library: libX11.soMissing recommended library: libXi.soMissing recommended library: libXmu. SoInstalling the CUDA Samples in / root... Copying samples to / root/NVIDIA_CUDA-10.0_Samples now...Finished copying samples.= Summary = Driver: Not SelectedToolkit: Installed in / usr/local/cuda-10.0Samples: Installed in / root But missing recommended librariesPlease make sure that-PATH includes / usr/local/cuda-10.0/bin-LD_LIBRARY_PATH includes / usr/local/cuda-10.0/lib64, or, add / usr/local/cuda-10.0/lib64 to / etc/ld.so.conf and run ldconfig as rootTo uninstall the CUDA Toolkit Run the uninstall script in / usr/local/cuda-10.0/binPlease see CUDA_Installation_Guide_Linux.pdf in / usr/local/cuda-10.0/doc/pdf for detailed information on setting up CUDA.***WARNING: Incomplete installation! This installation did not install the CUDA Driver. A driver of version at least 384.00 is required for CUDA 10.0 functionality to work.To install the driver using this installer, run the following command Replacing with the name of this run file: sudo .run-silent-driverLogfile is / tmp/cuda_install_9752.logroot@mec03:~/cudnn_cuda# vim / etc/ld.so.confroot@mec03:~/cudnn_cuda# ldconfigroot@mec03:~# cat / etc/profileexport PATH=/usr/local/cuda-10.0/bin$ {PATH:+:$ {PATH}} export LD_LIBRARY_PATH=/usr/local/cuda/lib64 ${LD_LIBRARY_PATH:+:$ {LD_LIBRARY_PATH } export CUDA_HOME=/usr/local/cudaroot@mec03:~# nvcc-- versionnvcc: NVIDIA (R) Cuda compiler driverCopyright (c) 2005-2018 NVIDIA CorporationBuilt on Sat_Aug_25_21:08:01_CDT_2018Cuda compilation tools Release 10.0, V10.0.130 IV. Install cuDNN 7.6root@mec03:~/cudnn_cuda# dpkg-I libcudnn7_7.6.3.30-1+cuda10.0_amd64.deb Selecting previously unselected package libcudnn7. (Reading database... 184057 files and directories currently installed.) Preparing to unpack libcudnn7_7.6.3.30-1+cuda10.0_amd64.deb. Unpacking libcudnn7 (7.6.3.30-1+cuda10.0). Setting up libcudnn7 (7.6.3.30-1+cuda10.0). Processing triggers for Libc-bin (2.23-0ubuntu11)... root@mec03:~/cudnn_cuda# dpkg-I libcudnn7-dev_7.6.3.30-1+cuda10.0_amd64.deb Selecting previously unselected package libcudnn7-dev. (Reading database... 184063 files and directories currently installed.) Preparing to unpack libcudnn7-dev_7.6.3.30-1+cuda10.0_amd64.deb. Unpacking libcudnn7-dev (7.6.3.30-1+cuda10.0)... Setting up libcudnn7-dev ( 7.6.3.30-1+cuda10.0). Update-alternatives: using / usr/include/x86_64-linux-gnu/cudnn_v7.h to provide / usr/include/cudnn.h (libcudnn) in auto moderoot@mec03:~/cudnn_cuda# dpkg-I libcudnn7-doc_7.6.3.30-1+cuda10.0_amd64.deb Selecting previously unselected package libcudnn7-doc. (Reading database. 184069 files and directories currently installed.) Preparing to unpack libcudnn7-doc_7.6.3 .30-1+cuda10.0_amd64.deb... Unpacking libcudnn7-doc (7.6.3.30-1+cuda10.0)... Setting up libcudnn7-doc (7.6.3.30-1+cuda10.0)... root@mec03:~/cudnn_cuda# cp / usr/include/cudnn.h / usr/local/cuda/includeroot@mec03:~/cudnn_cuda# cat / usr/local/cuda/include/cudnn.h | grep CUDNN_MAJOR-A 2#define CUDNN_MAJOR 7 # define CUDNN_MINOR 6#define CUDNN_PATCHLEVEL 3--#define CUDNN_VERSION (CUDNN_MAJOR * 1000 + CUDNN_MINOR * 100 + CUDNN_PATCHLEVEL) # include "driver_types.h" V. Test GPU effect

1. Install python3.6

Root@mec03:~# add-apt-repository ppa:jonathonf/python-3.6 A plain backport of * just* Python 3.6. System extensions/Python libraries may or may not work.Don't remove Python 3.5from your system-it will break. More info: https://launchpad.net/~jonathonf/+archive/ubuntu/python-3.6Press [ENTER] to continue or ctrl-c to cancel adding itgpg: keyring `/ tmp/tmpec5st1dk/secring.gpg' createdgpg: keyring` / tmp/tmpec5st1dk/pubring.gpg' createdgpg: requesting key F06FC659 from hkp server keyserver.ubuntu.comgpg: / tmp/tmpec5st1dk/trustdb.gpg: trustdb createdgpg: key F06FC659: public key "Launchpad PPA for J Fernyhough" importedgpg: Total number processed: 1gpg: imported: 1 (RSA 1) OKroot@mec03:~# update-alternatives-- install / usr/bin/python3 python3 / usr/bin/python3.5 1update-alternatives: using / usr/bin/python3.5 to provide / usr/bin/python3 (python3) in auto moderoot@mec03:~# update-alternatives-- install / usr/bin/python3 python3 / usr/bin/python3.6 2update-alternatives: using / usr/bin/python3.6 to provide / usr/bin/python3 (python3) in auto moderoot@mec03:~# update-alternatives- -install / usr/bin/python python / usr/bin/python2 100update-alternatives: using / usr/bin/python2 to provide / usr/bin/python (python) in auto moderoot@mec03:~# update-alternatives-- install / usr/bin/python python / usr/bin/python3 150update-alternatives: using / usr/bin/python3 to provide / usr/bin/python (python) in auto moderoot@mec03:~# python3Python 3.6.8 (default May 7 2019, 14:58:50) [GCC 5.4.0 20160609] on linuxType "help", "copyright", "credits" or "license" for more information. >

two。 Install pip3

Root@mec03:~# apt install python3-pip

3. Install tensorflow

Root@mec03:~# pip3 install tensorflow-gpu==1.13.1-I https://pypi.tuna.tsinghua.edu.cn/simpleCollecting tensorflow-gpu==1.13.1

4. Test gpu

Test python statement

Import numpy

Import tensorflow as tf

A = tf.constant ([1.0,2.0,3.0,4.0,5.0,6.0], shape= [2,3], name='a')

B = tf.constant ([1.0,2.0,3.0,4.0,5.0,6.0], shape= [3,2], name='b')

C = tf.matmul (a, b)

Sess = tf.Session (config=tf.ConfigProto (log_device_placement=True))

Print (sess.run (c)

Root@mec03:~# python3Python 3.6.8 (default, May 7 2019, 14:58:50) [GCC 5.4.0 20160609] on linuxType "help", "copyright", "credits" or "license" for more information. > > import numpyement=True) print (sess.run (c)) > import tensorflow as tf/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:526: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated In a future version of numpy, it will be understood as (type, (1,)) /'(1,) type'. _ np_qint8 = np.dtype ([("qint8", np.int8, 1)]) / usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:527: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) /' (1,) type'. _ np_quint8 = np.dtype ([("quint8", np.uint8, 1)]) / usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:528: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) /' (1,) type'. _ np_qint16 = np.dtype ([("qint16", np.int16, 1)]) / usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:529: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) /' (1,) type'. _ np_quint16 = np.dtype ([("quint16", np.uint16, 1)]) / usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:530: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) /' (1,) type'. _ np_qint32 = np.dtype ([("qint32", np.int32, 1)]) / usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/dtypes.py:535: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) /' (1,) type'. Np_resource = np.dtype ([("resource", np.ubyte, 1)]) > a = tf.constant ([1.0,2.0,3.0,4.0,5.0,6.0], shape= [2,3], name='a') > b = tf.constant ([1.0,2.0,3.0,4.0,5.0,6.0], shape= [3,2], name='b') > > c = tf.matmul (a) B) > sess = tf.Session (config=tf.ConfigProto (log_device_placement=True)) 2019-09-14 12 config=tf.ConfigProto 2718.309361: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA2019-09-14 12 12 purge 2718. 360212: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:998] successful NUMA node read from SysFS had negative value (- 1), but there must be at least one NUMA node So returning NUMA node zero2019-09-14 12 XLA service 0x3bb3a20 executing computations on platform CUDA. 2718.360498: I tensorflow/compiler/xla/service/service.cc:150. Devices:2019-09-14 12 GeForce GTX 2718.360512: I tensorflow/compiler/xla/service/service.cc:158] StreamExecutor device (0): GeForce GTX 1050 Ti, Compute Capability 6.12019-09-14 12 StreamExecutor device 2718. 379184: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 3600000000 Hz2019-09-14 12 StreamExecutor device 2718.380446: I tensorflow/compiler/xla/service/service.cc:150] XLA service 0x3ccb2f0 executing computations on platform Host. Devices:2019-09-14 12 StreamExecutor device 2718.380503: I tensorflow/compiler/xla/service/service.cc:158: 2019-09-14 12 tensorflow/core/common_runtime/gpu/gpu_device.cc:1433 2718 380792: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1433] Found device 0 with properties: name: GeForce GTX 1050 Ti major: 6 minor: 1 memoryClockRate (GHz): 1.392pciBusID: 0000:01:00.0totalMemory: 3.94GiB freeMemory: 3.66GiB2019-09-14 12 Vera 27 Vera 18.380852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 02019-09-14 12:27: 18.382037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix:2019-09-14 12 edge matrix:2019 2718.382075: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0 2019-09-14 12 edge matrix:2019 2718 382090: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0: n 2019-09-14 12 edge matrix:2019 2718 382242: I tensorflow/ Core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/ job:localhost/replica:0/task:0/device:GPU:0 with 3452 MB memory)-> physical GPU (device: 0) Name: GeForce GTX 1050 Ti, pci bus id: 0000 Ti 01Ti, compute capability: 6.1) Device mapping:/job:localhost/replica:0/task:0/device:XLA_GPU:0-> device:XLA_GPU device/job:localhost/replica:0/task:0/device:XLA_CPU:0-> device:XLA_CPU device/job:localhost/replica:0/task:0/device:GPU:0-> device: 0, name: GeForce GTX 1050 Ti, pci bus id: 0000Freight 00.0 Compute capability: 6.12019-09-14 12 Device mapping:/job:localhost/replica:0/task:0/device:XLA_GPU:0 2715 18.384493: I tensorflow/core/common_runtime/direct_session.cc:317] Device mapping:/job:localhost/replica:0/task:0/device:XLA_GPU:0-> device:XLA_GPU device/job:localhost/replica:0/task:0/device:XLA_CPU:0-> device:XLA_CPU device/job:localhost/replica:0/task:0/device:GPU:0-> device: 0, name: GeForce GTX 1050 Ti Pci bus id: 0000:01:00.0 Compute capability: 6. 1 > > print (sess.run (c)) MatMul: (MatMul): / job:localhost/replica:0/task:0/device:GPU:02019-09-14 12 MatMul 2720.118473: I tensorflow/core/common_runtime/placer.cc:1059] MatMul: (MatMul) / job:localhost/replica:0/task:0/device:GPU:0a: (Const): / job:localhost/replica:0/task:0/device:GPU:02019-09- 14 12 tensorflow/core/common_runtime/placer.cc:1059 27 tensorflow/core/common_runtime/placer.cc:1059 20.118492: I tensorflow/core/common_runtime/placer.cc:1059] a: (Const) / job:localhost/replica:0/task:0/device:GPU:0b: (Const): / job:localhost/replica:0/task:0/device:GPU:02019-09-14 12 job:localhost/replica:0/task:0/device:GPU:0b 1412 job:localhost/replica:0/task:0/device:GPU:0b 2720. 118502: I tensorflow/core/common_runtime/placer.cc:1059] b: (Const) / job:localhost/replica:0/task:0/device:GPU:0 [[22. 28.] [49. 64.] >

5. View GPU usage

Root@mec03:~# nvidia-smi Fri Sep 6 19:42:42 2019 +-+ | Processes: GPU Memory | | GPU PID Type Process name Usage | = | | 0 9558 C python3 3865MiB | | 0 12510 G / usr/lib/xorg/Xorg 39MiB | | 0 12608 G gnome-shell 38MiB | +-+ Fri Sep 6 00:22:27 2019 +- -- + | NVIDIA-SMI 435.21 Driver Version: 435.21 CUDA Version: 10.1 | |-+-- -+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | = = + = | 0 GeForce GTX 105. Off | 00000000VO13955MiB 00.0 On | NumberA | | 31% 62C P0 Nramp A / 80W | 3955MiB / 4038MiB | 97% Default | +-- + -+ +-- + | Processes: GPU Memory | | GPU PID Type Process name Usage | | = | | 0 9558 C python3 3865MiB | | 0 12510 G / usr/lib/xorg/Xorg 39MiB | | 0 12608 G gnome-shell 38MiB | | +-+

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.