Shulou(Shulou.com)05/31 Report--

Today, I will talk to you about how to analyze the new features of ProxmoxVE v6.0, which may not be well understood by many people. in order to make you understand better, the editor has summarized the following contents for you. I hope you can get something according to this article.

Proxmox released PVE version 6.0in July 2019, mainly the debian operating system and ceph version, as well as other key components were upgraded. In terms of PVE's own functions, the most important thing is to achieve hot migration of local disk virtual machines.

For me, there are three major improvements in the v6.0 version:

1. With the new function against the sky, the local disk virtual machine can achieve hot migration.

This v6.0 version has an unnatural new feature that hosts virtual machines on the local domain (local disk) to achieve hot migration!

It is generally understood that hot migration can only be achieved using distributed storage or shared disks, and PVE breaks this limitation. This feature enriches the use of specific application scenarios, for example, some people are not interested in distributed storage, they like to use local storage, and now they can also use the hot migration feature of virtual machines.

2. Zero command line to build the cluster

I found that proxmox has an idea of continuous improvement, which is zero command line! For many users of open source products, this is simply a direct poke into the user's heart (don't get it wrong). It's so sweet.

Through the web management interface, you do not need to configure any dual network card bond, do not need to install complex cluster software and complex cluster configuration, do not need to enter a single command!

Just install all the host physical servers in the PVE environment, then create the cluster on the first node, join the cluster on the second node (copy and paste key), join the cluster (copy and paste key) on the third node, and join the cluster (copy and paste key) on the fourth node. We're done.

3. Zero command line to realize the construction and management of ceph cluster

Through the web interface, you do not need to configure yum sources to install ceph cluster software, and you do not need to configure a bunch of ceph cluster parameters. If you click ceph directly, you will be prompted for the next step (automatic software installation in the background), next step (ceph parameter configuration), and the next step is done.

Through the web interface, you can manage the ceph cluster very well, for example, check the location, status and version of each ceph service, stop OSD disk, mon, mds, etc., start OSD disk, mon, mds, and so on.

In fact, the above points 2 and 3 have also been implemented in version 5.4. I am just a text summary based on the introduction video released on the official website.

Take the time today to verify that point 1, the local disk virtual machine for hot migration.

Let's start with the conclusion:

1. Pve6.0 version can achieve hot migration of local disk virtual machines.

2. The whole process does not execute a command on the pve backend (except for testing)

Details of the process can be found in the operation record below.

Design ideas:

The basic idea is to form a HA in a cluster environment with more than 3 physical nodes. The specific ideas are as follows:

1. The network aspect requires internal cluster management (corosync) network, business network, 2 networks. Because the local disk virtual machine migration is being tested, there is no ceph cluster network.

two。 In terms of storage, in addition to the system disk, each physical machine uses 1 hard disk as the local lvm storage, which is used as the disk of the virtual machine, because we need to test the local disk virtual machine of 6.0 to achieve hot migration, so we do not build a ceph distributed storage cluster.

The 3.CPU and memory aspects are determined according to the actual requirements, which are not discussed here.

Operation record:

one。 Environmental preparation:

Based on the above considerations, on this pve environment, create 3 virtual machines, 3vcpu/12G memory / 2 hard drives / 2 network cards, of which one hard disk on the hard disk is the system disk 31G LVM disk, one network card on the network card is used as the virtual machine network (192.168.170.0and24 network segment), and one network card is used for the cluster (192.168.1.0pm 24 network segment). Create a virtual machine as follows:

The remaining 2 test virtual machines are cloned directly, which are pve-2,pve-3.

Next, start pve-1,pve-2,pve-3 to install proxmox VE, as shown below:

Note that when I use PVE to create PVE virtual machines, I need to use virtualization nesting. When installing PVE, it is prompted that the kvm virtualization feature is not enabled, and a solution will be given later. As prompted below, click OK:

The installation steps are simple and foolish, in which selecting the hard disk will install the system by default on the first hard disk, then setting the root password (123456), and so on, network configuration steps:

Three virtual machines were installed at the same time, which was very fast and finished in less than 10 minutes. It feels faster than the ESXI with vmware.

Click the Reboot in the lower right corner to restart.

The first stage is completed, and then you can build clusters, configure networks, build storage and other follow-up operations.

By entering the URL:

Https://192.168.1.111:8006

Https://192.168.1.112:8006

Https://192.168.1.113:8006

The three pve can be managed respectively.

two。 Configure the network

First, match the network of the second network card. During the system installation, the first network card is configured as the internal management cluster network. The network segment is 192.168.1.0 and 24. After logging in to the system, you can find that this address is configured on the bridge, and a network card is set up on the bridge for bridging. Therefore, build a new bridge and configure the address of 192.168.170.0Universe 24 to it, and bridge it with another network card, as shown below:

Note that the gateway is set to 192.168.1.1 on the first network card, so the gateway cannot be set on this network card. This is easy to understand, in fact, there is only one default gateway set on the host.

After adding the bridge, you need to restart the effective configuration of the pve node. (network changes require a restart of the node to take effect. )

three。 Storage settin

Next, deal with the storage. Go to the storage of the pve node. During installation, the installer will create a vg on the installation disk by default, named pve, and establish three lv of swap/root/data on this vg, of which root is mounted on the lv / root directory. After the installation is completed, there are two storage ID by default, one is local, which corresponds to directory storage. The mount directory is / var/lib/vz, the other is local-lvm, and the mount is data lv. The type of lv is lvm-thin, and lvm-thin is very suitable for virtual machines. How to create it will be described later. In addition, the various storage types of pve are mainly directory / lvm/lvm-thin/zfs/nfs/ceph and so on. For more information, please refer to the admin document on the official website.

My original design was to store the last 50G disk / dev/sdb as a virtual machine disk and create it directly on the web interface:

Upload the first ISO image. Through the scp program, I use winscp, which is uploaded directly from this machine to the / var/lib/vz/templates/iso/ directory of pve-1:

four。 Create a cluster:

Note: before creating a cluster, make sure that the network configuration of the three nodes has been configured, and don't forget to restart pve to make the network configuration effective.

First create a cluster on the web management interface of one of the pve servers, as shown below:

Click "copy information" above to join the cluster in the other two pve nodes, as follows:

When you are finished, log in to the web management interface of any pve and you can see the cluster information of the 3 pve nodes:

It is found that the second hard disk on pve-2 and pve-3 has not yet been created as a lvm-thin disk. Use the same method as pve-1 to create a local lvm-thin disk, which is used to store virtual machine images. After creation, it is as follows:

Fifth, hot migration function verification (local disk virtual machine)

Everything is ready except the east wind. We have previously created a three-node cluster. Instead of using distributed storage ceph, the cluster host is going to use local lvm-thin disks to store virtual machine images. Now let's create a test virtual machine, such as creating a centos7 virtual machine on pve-1, and then hot migrate to pve-2 or pve-3.

The virtual machine configuration is as follows:

Start the virtual machine and report an error:

The problem of virtualization nesting mentioned above. The original solution is to solve the problem through the virtualization nesting of kvm. Later, I found that there is a simpler solution, that is, when creating a nested virtual machine, select the CPU type as host, as follows:

Restart the virtual machine created above, successfully!

When the installation is complete, start the hot migration test and migrate from pve-1 to pve-2. Note that pve-1, pve-2, and pve-3 all have only local disks, no shared storage or distributed storage ceph. You can see a prompt:

Migration with local disk might take long.

This means that local disk virtual machine migration can take a long time. As shown below:

Error report:

The cdrom of the virtual machine needs to be uninstalled:

Test again, it's okay:

While migrating, open the terminal to do a ping test to see if it affects the normal use of the virtual machine:

It is found that the migration process does not affect usage. The principle of migration should be that the virtual machine image file is copied to the target pve node in the background, the running state of the virtual machine and the incremental update data are saved, and after the copy is completed, the incremental update data is copied to the new node, at the same time, the running state of the virtual machine is transferred to the target pve node, the virtual machine of the source pve node is turned off, and the virtual machine is turned on in the target pve node.

Heat transfer succeeded! As you can see from above, the virtual machine has been migrated from pve-1 to pve-2.

The result of ping shows that the packet loss rate is 0, indicating that the virtual machine is running normally and is not affected by migration.

A log of the migration process is attached. Interested students can study how proxmoxVE implements hot migration of local disk virtual machines. The log is as follows:

Task viewer: VM 100-Migrate (pve-1-- > pve-2)

OutputStatus

Stop

2019-08-16 11:43:27 starting migration of VM 100 to node 'pve-2' (192.168.1.112)

2019-08-16 11:43:27 found local disk 'local-lvm:vm-100-disk-0' (in current VM config)

2019-08-16 11:43:27 copying disk images

2019-08-16 11:43:27 starting VM 100 on remote node 'pve-2'

2019-08-16 11:43:31 start remote tunnel

2019-08-16 11:43:32 ssh tunnel ver 1

2019-08-16 11:43:32 starting storage migration

2019-08-16 11:43:32 scsi0: start migration to nbd:192.168.1.112:60000:exportname=drive-scsi0

Drive mirror is starting for drive-scsi0

Drive-scsi0: transferred: 0 bytes remaining: 34359738368 bytes total: 34359738368 bytes progression: 0.00% busy: 1 ready: 0

Drive-scsi0: transferred: 36700160 bytes remaining: 34323038208 bytes total: 34359738368 bytes progression: 0.11% busy: 1 ready: 0

Drive-scsi0: transferred: 94371840 bytes remaining: 34265366528 bytes total: 34359738368 bytes progression: 0.27% busy: 1 ready: 0

Drive-scsi0: transferred: 169869312 bytes remaining: 34189869056 bytes total: 34359738368 bytes progression: 0.49% busy: 1 ready: 0

Drive-scsi0: transferred: 255852544 bytes remaining: 34103885824 bytes total: 34359738368 bytes progression: 0.74% busy: 1 ready: 0

Drive-scsi0: transferred: 372244480 bytes remaining: 33987493888 bytes total: 34359738368 bytes progression: 1.08% busy: 1 ready: 0

Drive-scsi0: transferred: 479199232 bytes remaining: 33880539136 bytes total: 34359738368 bytes progression: 1.39% busy: 1 ready: 0

Drive-scsi0: transferred: 565182464 bytes remaining: 33794555904 bytes total: 34359738368 bytes progression: 1.64% busy: 1 ready: 0

Drive-scsi0: transferred: 670040064 bytes remaining: 33689698304 bytes total: 34359738368 bytes progression: 1.95% busy: 1 ready: 0

Drive-scsi0: transferred: 783286272 bytes remaining: 33576452096 bytes total: 34359738368 bytes progression: 2.28% busy: 1 ready: 0

Drive-scsi0: transferred: 887095296 bytes remaining: 33472643072 bytes total: 34359738368 bytes progression: 2.58% busy: 1 ready: 0

Drive-scsi0: transferred: 995098624 bytes remaining: 33364639744 bytes total: 34359738368 bytes progression: 2.90% busy: 1 ready: 0

Drive-scsi0: transferred: 1110441984 bytes remaining: 33249296384 bytes total: 34359738368 bytes progression: 3.23% busy: 1 ready: 0

Drive-scsi0: transferred: 1233125376 bytes remaining: 33126612992 bytes total: 34359738368 bytes progression: 3.59% busy: 1 ready: 0

Drive-scsi0: transferred: 1333788672 bytes remaining: 33025949696 bytes total: 34359738368 bytes progression: 3.88% busy: 1 ready: 0

Drive-scsi0: transferred: 1453326336 bytes remaining: 32906412032 bytes total: 34359738368 bytes progression: 4.23% busy: 1 ready: 0

Drive-scsi0: transferred: 1555038208 bytes remaining: 32804700160 bytes total: 34359738368 bytes progression: 4.53% busy: 1 ready: 0

Drive-scsi0: transferred: 1723858944 bytes remaining: 32635879424 bytes total: 34359738368 bytes progression: 5.02% busy: 1 ready: 0

Drive-scsi0: transferred: 1804599296 bytes remaining: 32555139072 bytes total: 34359738368 bytes progression: 5.25% busy: 1 ready: 0

Drive-scsi0: transferred: 1892679680 bytes remaining: 32467058688 bytes total: 34359738368 bytes progression: 5.51% busy: 1 ready: 0

Drive-scsi0: transferred: 1993342976 bytes remaining: 32366395392 bytes total: 34359738368 bytes progression: 5.80% busy: 1 ready: 0

Drive-scsi0: transferred: 2077229056 bytes remaining: 32282509312 bytes total: 34359738368 bytes progression: 6.05% busy: 1 ready: 0

Drive-scsi0: transferred: 2147483648 bytes remaining: 32212254720 bytes total: 34359738368 bytes progression: 6.25% busy: 1 ready: 0

Drive-scsi0: transferred: 2283798528 bytes remaining: 32075939840 bytes total: 34359738368 bytes progression: 6.65% busy: 1 ready: 0

Drive-scsi0: transferred: 2405433344 bytes remaining: 31954305024 bytes total: 34359738368 bytes progression: 7.00% busy: 1 ready: 0

Drive-scsi0: transferred: 2529165312 bytes remaining: 31830573056 bytes total: 34359738368 bytes progression: 7.36% busy: 1 ready: 0

Drive-scsi0: transferred: 2632974336 bytes remaining: 31726764032 bytes total: 34359738368 bytes progression: 7.66% busy: 1 ready: 0

Drive-scsi0: transferred: 2750414848 bytes remaining: 31609323520 bytes total: 34359738368 bytes progression: 8.00% busy: 1 ready: 0

Drive-scsi0: transferred: 2867855360 bytes remaining: 31491883008 bytes total: 34359738368 bytes progression: 8.35% busy: 1 ready: 0

Drive-scsi0: transferred: 2955935744 bytes remaining: 31403802624 bytes total: 34359738368 bytes progression: 8.60% busy: 1 ready: 0

Drive-scsi0: transferred: 3070230528 bytes remaining: 31289507840 bytes total: 34359738368 bytes progression: 8.94% busy: 1 ready: 0

Drive-scsi0: transferred: 3196059648 bytes remaining: 31163678720 bytes total: 34359738368 bytes progression: 9.30% busy: 1 ready: 0

Drive-scsi0: transferred: 3246391296 bytes remaining: 31113347072 bytes total: 34359738368 bytes progression: 9.45% busy: 1 ready: 0

Drive-scsi0: transferred: 3297771520 bytes remaining: 31061966848 bytes total: 34359738368 bytes progression: 9.60% busy: 1 ready: 0

Drive-scsi0: transferred: 3342860288 bytes remaining: 31016878080 bytes total: 34359738368 bytes progression: 9.73% busy: 1 ready: 0

Drive-scsi0: transferred: 3388997632 bytes remaining: 30970740736 bytes total: 34359738368 bytes progression: 9.86% busy: 1 ready: 0

Drive-scsi0: transferred: 3435134976 bytes remaining: 30924603392 bytes total: 34359738368 bytes progression: 10.00% busy: 1 ready: 0

Drive-scsi0: transferred: 3498049536 bytes remaining: 30861688832 bytes total: 34359738368 bytes progression: 10.18% busy: 1 ready: 0

Drive-scsi0: transferred: 3579838464 bytes remaining: 30779965440 bytes total: 34359803904 bytes progression: 10.42% busy: 1 ready: 0

Drive-scsi0: transferred: 3670016000 bytes remaining: 30689787904 bytes total: 34359803904 bytes progression: 10.68% busy: 1 ready: 0

Drive-scsi0: transferred: 3802136576 bytes remaining: 30557667328 bytes total: 34359803904 bytes progression: 11.07% busy: 1 ready: 0

Drive-scsi0: transferred: 3905945600 bytes remaining: 30453858304 bytes total: 34359803904 bytes progression: 11.37% busy: 1 ready: 0

Drive-scsi0: transferred: 4005560320 bytes remaining: 30354243584 bytes total: 34359803904 bytes progression: 11.66% busy: 1 ready: 0

Drive-scsi0: transferred: 4124049408 bytes remaining: 30235754496 bytes total: 34359803904 bytes progression: 12.00% busy: 1 ready: 0

Drive-scsi0: transferred: 4248829952 bytes remaining: 30110973952 bytes total: 34359803904 bytes progression: 12.37% busy: 1 ready: 0

Drive-scsi0: transferred: 4366270464 bytes remaining: 29993533440 bytes total: 34359803904 bytes progression: 12.71% busy: 1 ready: 0

Drive-scsi0: transferred: 4501536768 bytes remaining: 29858267136 bytes total: 34359803904 bytes progression: 13.10% busy: 1 ready: 0

Drive-scsi0: transferred: 4588568576 bytes remaining: 29771235328 bytes total: 34359803904 bytes progression: 13.35% busy: 1 ready: 0

Drive-scsi0: transferred: 4688183296 bytes remaining: 29671620608 bytes total: 34359803904 bytes progression: 13.64% busy: 1 ready: 0

Drive-scsi0: transferred: 4782555136 bytes remaining: 29577248768 bytes total: 34359803904 bytes progression: 13.92% busy: 1 ready: 0

Drive-scsi0: transferred: 4894752768 bytes remaining: 29465051136 bytes total: 34359803904 bytes progression: 14.25% busy: 1 ready: 0

Drive-scsi0: transferred: 5006950400 bytes remaining: 29352853504 bytes total: 34359803904 bytes progression: 14.57% busy: 1 ready: 0

Drive-scsi0: transferred: 5107613696 bytes remaining: 29252190208 bytes total: 34359803904 bytes progression: 14.87% busy: 1 ready: 0

Drive-scsi0: transferred: 5214568448 bytes remaining: 29145235456 bytes total: 34359803904 bytes progression: 15.18% busy: 1 ready: 0

Drive-scsi0: transferred: 5314183168 bytes remaining: 29045620736 bytes total: 34359803904 bytes progression: 15.47% busy: 1 ready: 0

Drive-scsi0: transferred: 5428477952 bytes remaining: 28931325952 bytes total: 34359803904 bytes progression: 15.80% busy: 1 ready: 0

Drive-scsi0: transferred: 5535432704 bytes remaining: 28824371200 bytes total: 34359803904 bytes progression: 16.11% busy: 1 ready: 0

Drive-scsi0: transferred: 5649727488 bytes remaining: 28710076416 bytes total: 34359803904 bytes progression: 16.44% busy: 1 ready: 0

Drive-scsi0: transferred: 5754585088 bytes remaining: 28605218816 bytes total: 34359803904 bytes progression: 16.75% busy: 1 ready: 0

Drive-scsi0: transferred: 5874122752 bytes remaining: 28485681152 bytes total: 34359803904 bytes progression: 17.10% busy: 1 ready: 0

Drive-scsi0: transferred: 5994708992 bytes remaining: 28365094912 bytes total: 34359803904 bytes progression: 17.45% busy: 1 ready: 0

Drive-scsi0: transferred: 6098518016 bytes remaining: 28261285888 bytes total: 34359803904 bytes progression: 17.75% busy: 1 ready: 0

Drive-scsi0: transferred: 6235881472 bytes remaining: 28123922432 bytes total: 34359803904 bytes progression: 18.15% busy: 1 ready: 0

Drive-scsi0: transferred: 6340739072 bytes remaining: 28019064832 bytes total: 34359803904 bytes progression: 18.45% busy: 1 ready: 0

Drive-scsi0: transferred: 6458179584 bytes remaining: 27901624320 bytes total: 34359803904 bytes progression: 18.80% busy: 1 ready: 0

Drive-scsi0: transferred: 6591348736 bytes remaining: 27768455168 bytes total: 34359803904 bytes progression: 19.18% busy: 1 ready: 0

Drive-scsi0: transferred: 6698303488 bytes remaining: 27661500416 bytes total: 34359803904 bytes progression: 19.49% busy: 1 ready: 0

Drive-scsi0: transferred: 6828326912 bytes remaining: 27531476992 bytes total: 34359803904 bytes progression: 19.87% busy: 1 ready: 0

Drive-scsi0: transferred: 6936330240 bytes remaining: 27423473664 bytes total: 34359803904 bytes progression: 20.19% busy: 1 ready: 0

Drive-scsi0: transferred: 7057965056 bytes remaining: 27301838848 bytes total: 34359803904 bytes progression: 20.54% busy: 1 ready: 0

Drive-scsi0: transferred: 7176454144 bytes remaining: 27183349760 bytes total: 34359803904 bytes progression: 20.89% busy: 1 ready: 0

Drive-scsi0: transferred: 7279214592 bytes remaining: 27080589312 bytes total: 34359803904 bytes progression: 21.19% busy: 1 ready: 0

Drive-scsi0: transferred: 7386169344 bytes remaining: 26973634560 bytes total: 34359803904 bytes progression: 21.50% busy: 1 ready: 0

Drive-scsi0: transferred: 7486832640 bytes remaining: 26872971264 bytes total: 34359803904 bytes progression: 21.79% busy: 1 ready: 0

Drive-scsi0: transferred: 7587495936 bytes remaining: 26772307968 bytes total: 34359803904 bytes progression: 22.08% busy: 1 ready: 0

Drive-scsi0: transferred: 7703887872 bytes remaining: 26655916032 bytes total: 34359803904 bytes progression: 22.42% busy: 1 ready: 0

Drive-scsi0: transferred: 7810842624 bytes remaining: 26548961280 bytes total: 34359803904 bytes progression: 22.73% busy: 1 ready: 0

Drive-scsi0: transferred: 7921991680 bytes remaining: 26437812224 bytes total: 34359803904 bytes progression: 23.06% busy: 1 ready: 0

Drive-scsi0: transferred: 8024752128 bytes remaining: 26335051776 bytes total: 34359803904 bytes progression: 23.36% busy: 1 ready: 0

Drive-scsi0: transferred: 8136949760 bytes remaining: 26222854144 bytes total: 34359803904 bytes progression: 23.68% busy: 1 ready: 0

Drive-scsi0: transferred: 8218738688 bytes remaining: 26141065216 bytes total: 34359803904 bytes progression: 23.92% busy: 1 ready: 0

Drive-scsi0: transferred: 8324644864 bytes remaining: 26035159040 bytes total: 34359803904 bytes progression: 24.23% busy: 1 ready: 0

Drive-scsi0: transferred: 8419016704 bytes remaining: 25940787200 bytes total: 34359803904 bytes progression: 24.50% busy: 1 ready: 0

Drive-scsi0: transferred: 8534360064 bytes remaining: 25825443840 bytes total: 34359803904 bytes progression: 24.84% busy: 1 ready: 0

Drive-scsi0: transferred: 8632926208 bytes remaining: 25726877696 bytes total: 34359803904 bytes progression: 25.13% busy: 1 ready: 0

Drive-scsi0: transferred: 8751415296 bytes remaining: 25608388608 bytes total: 34359803904 bytes progression: 25.47% busy: 1 ready: 0

Drive-scsi0: transferred: 8869904384 bytes remaining: 25489899520 bytes total: 34359803904 bytes progression: 25.81% busy: 1 ready: 0

Drive-scsi0: transferred: 8977907712 bytes remaining: 25381896192 bytes total: 34359803904 bytes progression: 26.13% busy: 1 ready: 0

Drive-scsi0: transferred: 9102688256 bytes remaining: 25257115648 bytes total: 34359803904 bytes progression: 26.49% busy: 1 ready: 0

Drive-scsi0: transferred: 9206497280 bytes remaining: 25153306624 bytes total: 34359803904 bytes progression: 26.79% busy: 1 ready: 0

Drive-scsi0: transferred: 9326034944 bytes remaining: 25033834496 bytes total: 34359869440 bytes progression: 27.14% busy: 1 ready: 0

Drive-scsi0: transferred: 9432989696 bytes remaining: 24926879744 bytes total: 34359869440 bytes progression: 27.45% busy: 1 ready: 0

Drive-scsi0: transferred: 9534701568 bytes remaining: 24825167872 bytes total: 34359869440 bytes progression: 27.75% busy: 1 ready: 0

Drive-scsi0: transferred: 9629073408 bytes remaining: 24730796032 bytes total: 34359869440 bytes progression: 28.02% busy: 1 ready: 0

Drive-scsi0: transferred: 9719250944 bytes remaining: 24640618496 bytes total: 34359869440 bytes progression: 28.29% busy: 1 ready: 0

Drive-scsi0: transferred: 9822011392 bytes remaining: 24537858048 bytes total: 34359869440 bytes progression: 28.59% busy: 1 ready: 0

Drive-scsi0: transferred: 9939451904 bytes remaining: 24420417536 bytes total: 34359869440 bytes progression: 28.93% busy: 1 ready: 0

Drive-scsi0: transferred: 10043260928 bytes remaining: 24316608512 bytes total: 34359869440 bytes progression: 29.23% busy: 1 ready: 0

Drive-scsi0: transferred: 10176430080 bytes remaining: 24183439360 bytes total: 34359869440 bytes progression: 29.62% busy: 1 ready: 0

Drive-scsi0: transferred: 10295967744 bytes remaining: 24063901696 bytes total: 34359869440 bytes progression: 29.97% busy: 1 ready: 0

Drive-scsi0: transferred: 10408165376 bytes remaining: 23951704064 bytes total: 34359869440 bytes progression: 30.29% busy: 1 ready: 0

Drive-scsi0: transferred: 10504634368 bytes remaining: 23855235072 bytes total: 34359869440 bytes progression: 30.57% busy: 1 ready: 0

Drive-scsi0: transferred: 106269184 bytes remaining: 23733600256 bytes total: 34359869440 bytes progression: 30.93% busy: 1 ready: 0

Drive-scsi0: transferred: 10719592448 bytes remaining: 23640276992 bytes total: 34359869440 bytes progression: 31.20% busy: 1 ready: 0

Drive-scsi0: transferred: 10827595776 bytes remaining: 23532273664 bytes total: 34359869440 bytes progression: 31.51% busy: 1 ready: 0

Drive-scsi0: transferred: 10942939136 bytes remaining: 23416930304 bytes total: 34359869440 bytes progression: 31.85% busy: 1 ready: 0

Drive-scsi0: transferred: 11027873792 bytes remaining: 23331995648 bytes total: 34359869440 bytes progression: 32.10% busy: 1 ready: 0

Drive-scsi0: transferred: 11080302592 bytes remaining: 23279566848 bytes total: 34359869440 bytes progression: 32.25% busy: 1 ready: 0

Drive-scsi0: transferred: 11132731392 bytes remaining: 2322138048 bytes total: 34359869440 bytes progression: 32.40% busy: 1 ready: 0

Drive-scsi0: transferred: 11191451648 bytes remaining: 23168417792 bytes total: 34359869440 bytes progression: 32.57% busy: 1 ready: 0

Drive-scsi0: transferred: 11249123328 bytes remaining: 23110746112 bytes total: 34359869440 bytes progression: 32.74% busy: 1 ready: 0

Drive-scsi0: transferred: 11304697856 bytes remaining: 23055171584 bytes total: 34359869440 bytes progression: 32.90% busy: 1 ready: 0

Drive-scsi0: transferred: 11355029504 bytes remaining: 23004839936 bytes total: 34359869440 bytes progression: 33.05% busy: 1 ready: 0

Drive-scsi0: transferred: 11396972544 bytes remaining: 2296286896 bytes total: 34359869440 bytes progression: 33.17% busy: 1 ready: 0

Drive-scsi0: transferred: 11480858624 bytes remaining: 22879010816 bytes total: 34359869440 bytes progression: 33.41% busy: 1 ready: 0

Drive-scsi0: transferred: 11580473344 bytes remaining: 22779396096 bytes total: 34359869440 bytes progression: 33.70% busy: 1 ready: 0

Drive-scsi0: transferred: 11727273984 bytes remaining: 22632595456 bytes total: 34359869440 bytes progression: 34.13% busy: 1 ready: 0

Drive-scsi0: transferred: 11821645824 bytes remaining: 22538223616 bytes total: 34359869440 bytes progression: 34.41% busy: 1 ready: 0

Drive-scsi0: transferred: 11957960704 bytes remaining: 22401908736 bytes total: 34359869440 bytes progression: 34.80% busy: 1 ready: 0

Drive-scsi0: transferred: 12069109760 bytes remaining: 22290759680 bytes total: 34359869440 bytes progression: 35.13% busy: 1 ready: 0

Drive-scsi0: transferred: 12160335872 bytes remaining: 22199533568 bytes total: 34359869440 bytes progression: 35.39% busy: 1 ready: 0

Drive-scsi0: transferred: 12268339200 bytes remaining: 22091530240 bytes total: 34359869440 bytes progression: 35.71% busy: 1 ready: 0

Drive-scsi0: transferred: 12383682560 bytes remaining: 21976186880 bytes total: 34359869440 bytes progression: 36.04% busy: 1 ready: 0

Drive-scsi0: transferred: 12499025920 bytes remaining: 21860843520 bytes total: 34359869440 bytes progression: 36.38% busy: 1 ready: 0

Drive-scsi0: transferred: 12607029248 bytes remaining: 21752840192 bytes total: 34359869440 bytes progression: 36.69% busy: 1 ready: 0

Drive-scsi0: transferred: 12724469760 bytes remaining: 21635399680 bytes total: 34359869440 bytes progression: 37.03% busy: 1 ready: 0

Drive-scsi0: transferred: 12811501568 bytes remaining: 21548367872 bytes total: 34359869440 bytes progression: 37.29% busy: 1 ready: 0

Drive-scsi0: transferred: 12910067712 bytes remaining: 21449801728 bytes total: 34359869440 bytes progression: 37.57% busy: 1 ready: 0

Drive-scsi0: transferred: 13011779584 bytes remaining: 21348089856 bytes total: 34359869440 bytes progression: 37.87% busy: 1 ready: 0

Drive-scsi0: transferred: 13117685760 bytes remaining: 21242183680 bytes total: 34359869440 bytes progression: 38.18% busy: 1 ready: 0

Drive-scsi0: transferred: 13228834816 bytes remaining: 21131034624 bytes total: 34359869440 bytes progression: 38.50% busy: 1 ready: 0

Drive-scsi0: transferred: 13336838144 bytes remaining: 21023031296 bytes total: 34359869440 bytes progression: 38.82% busy: 1 ready: 0

Drive-scsi0: transferred: 13458472960 bytes remaining: 20901396480 bytes total: 34359869440 bytes progression: 39.17% busy: 1 ready: 0

Drive-scsi0: transferred: 13566476288 bytes remaining: 20793393152 bytes total: 34359869440 bytes progression: 39.48% busy: 1 ready: 0

Drive-scsi0: transferred: 13667139584 bytes remaining: 20692729856 bytes total: 34359869440 bytes progression: 39.78% busy: 1 ready: 0

Drive-scsi0: transferred: 13782482944 bytes remaining: 20577386496 bytes total: 34359869440 bytes progression: 40.11% busy: 1 ready: 0

Drive-scsi0: transferred: 13895729152 bytes remaining: 20464140288 bytes total: 34359869440 bytes progression: 40.44% busy: 1 ready: 0

Drive-scsi0: transferred: 13993246720 bytes remaining: 20366622720 bytes total: 34359869440 bytes progression: 40.73% busy: 1 ready: 0

Drive-scsi0: transferred: 14106492928 bytes remaining: 20253376512 bytes total: 34359869440 bytes progression: 41.06% busy: 1 ready: 0

Drive-scsi0: transferred: 14206107648 bytes remaining: 20153761792 bytes total: 34359869440 bytes progression: 41.35% busy: 1 ready: 0

Drive-scsi0: transferred: 14309916672 bytes remaining: 20049952768 bytes total: 34359869440 bytes progression: 41.65% busy: 1 ready: 0

Drive-scsi0: transferred: 14426308608 bytes remaining: 19933560832 bytes total: 34359869440 bytes progression: 41.99% busy: 1 ready: 0

Drive-scsi0: transferred: 14553186304 bytes remaining: 19806683136 bytes total: 34359869440 bytes progression: 42.36% busy: 1 ready: 0

Drive-scsi0: transferred: 14668529664 bytes remaining: 19691339776 bytes total: 34359869440 bytes progression: 42.69% busy: 1 ready: 0

Drive-scsi0: transferred: 14796455936 bytes remaining: 19563413504 bytes total: 34359869440 bytes progression: 43.06% busy: 1 ready: 0

Drive-scsi0: transferred: 14903410688 bytes remaining: 19456458752 bytes total: 34359869440 bytes progression: 43.37% busy: 1 ready: 0

Drive-scsi0: transferred: 14979956736 bytes remaining: 19379912704 bytes total: 34359869440 bytes progression: 43.60% busy: 1 ready: 0

Drive-scsi0: transferred: 15065939968 bytes remaining: 19293929472 bytes total: 34359869440 bytes progression: 43.85% busy: 1 ready: 0

Drive-scsi0: transferred: 15156117504 bytes remaining: 19203751936 bytes total: 34359869440 bytes progression: 44.11% busy: 1 ready: 0

Drive-scsi0: transferred: 15270412288 bytes remaining: 19089457152 bytes total: 34359869440 bytes progression: 44.44% busy: 1 ready: 0

Drive-scsi0: transferred: 15394144256 bytes remaining: 18965725184 bytes total: 34359869440 bytes progression: 44.80% busy: 1 ready: 0

Drive-scsi0: transferred: 15514730496 bytes remaining: 18845138944 bytes total: 34359869440 bytes progression: 45.15% busy: 1 ready: 0

Drive-scsi0: transferred: 15643705344 bytes remaining: 187164096 bytes total: 34359869440 bytes progression: 45.53% busy: 1 ready: 0

Drive-scsi0: transferred: 15747514368 bytes remaining: 18612355072 bytes total: 34359869440 bytes progression: 45.83% busy: 1 ready: 0

Drive-scsi0: transferred: 15871246336 bytes remaining: 18488623104 bytes total: 34359869440 bytes progression: 46.19% busy: 1 ready: 0

Drive-scsi0: transferred: 159886848bytes remaining: 18371182592 bytes total: 34359869440 bytes progression: 46.53% busy: 1 ready: 0

Drive-scsi0: transferred: 16089350144 bytes remaining: 18270519296 bytes total: 34359869440 bytes progression: 46.83% busy: 1 ready: 0

Drive-scsi0: transferred: 16200499200 bytes remaining: 18159370240 bytes total: 34359869440 bytes progression: 47.15% busy: 1 ready: 0

Drive-scsi0: transferred: 16320036864 bytes remaining: 18039832576 bytes total: 34359869440 bytes progression: 47.50% busy: 1 ready: 0

Drive-scsi0: transferred: 16416505856 bytes remaining: 17943363584 bytes total: 34359869440 bytes progression: 47.78% busy: 1 ready: 0

Drive-scsi0: transferred: 16521363456 bytes remaining: 17838505984 bytes total: 34359869440 bytes progression: 48.08% busy: 1 ready: 0

Drive-scsi0: transferred: 16656629760 bytes remaining: 17703239680 bytes total: 34359869440 bytes progression: 48.48% busy: 1 ready: 0

Drive-scsi0: transferred: 16735272960 bytes remaining: 17624596480 bytes total: 34359869440 bytes progression: 48.71% busy: 1 ready: 0

Drive-scsi0: transferred: 16854810624 bytes remaining: 17505058816 bytes total: 34359869440 bytes progression: 49.05% busy: 1 ready: 0

Drive-scsi0: transferred: 16977494016 bytes remaining: 17382375424 bytes total: 34359869440 bytes progression: 49.41% busy: 1 ready: 0

Drive-scsi0: transferred: 17123246080 bytes remaining: 17236623360 bytes total: 34359869440 bytes progression: 49.84% busy: 1 ready: 0

Drive-scsi0: transferred: 17248026624 bytes remaining: 17111842816 bytes total: 34359869440 bytes progression: 50.20% busy: 1 ready: 0

Drive-scsi0: transferred: 17373855744 bytes remaining: 16986013696 bytes total: 34359869440 bytes progression: 50.56% busy: 1 ready: 0

Drive-scsi0: transferred: 17488150528 bytes remaining: 16871718912 bytes total: 34359869440 bytes progression: 50.90% busy: 1 ready: 0

Drive-scsi0: transferred: 17586716672 bytes remaining: 16773152768 bytes total: 34359869440 bytes progression: 51.18% busy: 1 ready: 0

Drive-scsi0: transferred: 17693671424 bytes remaining: 16666198016 bytes total: 34359869440 bytes progression: 51.50% busy: 1 ready: 0

Drive-scsi0: transferred: 17804820480 bytes remaining: 16555048960 bytes total: 34359869440 bytes progression: 51.82% busy: 1 ready: 0

Drive-scsi0: transferred: 17937989632 bytes remaining: 16421879808 bytes total: 34359869440 bytes progression: 52.21% busy: 1 ready: 0

Drive-scsi0: transferred: 18060673024 bytes remaining: 16299196416 bytes total: 34359869440 bytes progression: 52.56% busy: 1 ready: 0

Drive-scsi0: transferred: 18179162112 bytes remaining: 16180707328 bytes total: 34359869440 bytes progression: 52.91% busy: 1 ready: 0

Drive-scsi0: transferred: 18276679680 bytes remaining: 16083189760 bytes total: 34359869440 bytes progression: 53.19% busy: 1 ready: 0

Drive-scsi0: transferred: 18395168768 bytes remaining: 15964700672 bytes total: 34359869440 bytes progression: 53.54% busy: 1 ready: 0

Drive-scsi0: transferred: 18475909120 bytes remaining: 15883960320 bytes total: 34359869440 bytes progression: 53.77% busy: 1 ready: 0

Drive-scsi0: transferred: 18579718144 bytes remaining: 15780151296 bytes total: 34359869440 bytes progression: 54.07% busy: 1 ready: 0

Drive-scsi0: transferred: 18688770048 bytes remaining: 15671099392 bytes total: 34359869440 bytes progression: 54.39% busy: 1 ready: 0

Drive-scsi0: transferred: 18796773376 bytes remaining: 15563096064 bytes total: 34359869440 bytes progression: 54.71% busy: 1 ready: 0

Drive-scsi0: transferred: 18853396480 bytes remaining: 15506472960 bytes total: 34359869440 bytes progression: 54.87% busy: 1 ready: 0

Drive-scsi0: transferred: 18904776704 bytes remaining: 15455092736 bytes total: 34359869440 bytes progression: 55.02% busy: 1 ready: 0

Drive-scsi0: transferred: 18949865472 bytes remaining: 15410003968 bytes total: 34359869440 bytes progression: 55.15% busy: 1 ready: 0

Drive-scsi0: transferred: 18993905664 bytes remaining: 15365963776 bytes total: 34359869440 bytes progression: 55.28% busy: 1 ready: 0

Drive-scsi0: transferred: 19048431616 bytes remaining: 15311437824 bytes total: 34359869440 bytes progression: 55.44% busy: 1 ready: 0

Drive-scsi0: transferred: 19108200448 bytes remaining: 15251668992 bytes total: 34359869440 bytes progression: 55.61% busy: 1 ready: 0

Drive-scsi0: transferred: 19176357888 bytes remaining: 15183511552 bytes total: 34359869440 bytes progression: 55.81% busy: 1 ready: 0

Drive-scsi0: transferred: 19277021184 bytes remaining: 15082848256 bytes total: 34359869440 bytes progression: 56.10% busy: 1 ready: 0

Drive-scsi0: transferred: 19391315968 bytes remaining: 1498553472 bytes total: 34359869440 bytes progression: 56.44% busy: 1 ready: 0

Drive-scsi0: transferred: 19500367872 bytes remaining: 14859501568 bytes total: 34359869440 bytes progression: 56.75% busy: 1 ready: 0

Drive-scsi0: transferred: 19618856960 bytes remaining: 14741012480 bytes total: 34359869440 bytes progression: 57.10% busy: 1 ready: 0

Drive-scsi0: transferred: 19713228800 bytes remaining: 14646640640 bytes total: 34359869440 bytes progression: 57.37% busy: 1 ready: 0

Drive-scsi0: transferred: 19818086400 bytes remaining: 14541783040 bytes total: 34359869440 bytes progression: 57.68% busy: 1 ready: 0

Drive-scsi0: transferred: 19919798272 bytes remaining: 14440071168 bytes total: 34359869440 bytes progression: 57.97% busy: 1 ready: 0

Drive-scsi0: transferred: 20033044480 bytes remaining: 14326824960 bytes total: 34359869440 bytes progression: 58.30% busy: 1 ready: 0

Drive-scsi0: transferred: 20134756352 bytes remaining: 14225113088 bytes total: 34359869440 bytes progression: 58.60% busy: 1 ready: 0

Drive-scsi0: transferred: 20223885312 bytes remaining: 14135984128 bytes total: 34359869440 bytes progression: 58.86% busy: 1 ready: 0

Drive-scsi0: transferred: 20325597184 bytes remaining: 14034272256 bytes total: 34359869440 bytes progression: 59.16% busy: 1 ready: 0

Drive-scsi0: transferred: 20466106368 bytes remaining: 13893763072 bytes total: 34359869440 bytes progression: 59.56% busy: 1 ready: 0

Drive-scsi0: transferred: 20559429632 bytes remaining: 13800439808 bytes total: 34359869440 bytes progression: 59.84% busy: 1 ready: 0

Drive-scsi0: transferred: 20683161600 bytes remaining: 13676707840 bytes total: 34359869440 bytes progression: 60.20% busy: 1 ready: 0

Drive-scsi0: transferred: 20781727744 bytes remaining: 13578141696 bytes total: 34359869440 bytes progression: 60.48% busy: 1 ready: 0

Drive-scsi0: transferred: 20876099584 bytes remaining: 13483769856 bytes total: 34359869440 bytes progression: 60.76% busy: 1 ready: 0

Drive-scsi0: transferred: 20974665728 bytes remaining: 13385203712 bytes total: 34359869440 bytes progression: 61.04% busy: 1 ready: 0

Drive-scsi0: transferred: 21110980608 bytes remaining: 13248888832 bytes total: 34359869440 bytes progression: 61.44% busy: 1 ready: 0

Drive-scsi0: transferred: 21216886784 bytes remaining: 13142982656 bytes total: 34359869440 bytes progression: 61.75% busy: 1 ready: 0

Drive-scsi0: transferred: 21298675712 bytes remaining: 13061193728 bytes total: 34359869440 bytes progression: 61.99% busy: 1 ready: 0

Drive-scsi0: transferred: 21418213376 bytes remaining: 12941656064 bytes total: 34359869440 bytes progression: 62.33% busy: 1 ready: 0

Drive-scsi0: transferred: 21540896768 bytes remaining: 12818972672 bytes total: 34359869440 bytes progression: 62.69% busy: 1 ready: 0

Drive-scsi0: transferred: 21653094400 bytes remaining: 12706775040 bytes total: 34359869440 bytes progression: 63.02% busy: 1 ready: 0

Drive-scsi0: transferred: 21771583488 bytes remaining: 12588285952 bytes total: 34359869440 bytes progression: 63.36% busy: 1 ready: 0

Drive-scsi0: transferred: 21905801216 bytes remaining: 12454068224 bytes total: 34359869440 bytes progression: 63.75% busy: 1 ready: 0

Drive-scsi0: transferred: 22025338880 bytes remaining: 12334530560 bytes total: 34359869440 bytes progression: 64.10% busy: 1 ready: 0

Drive-scsi0: transferred: 22141730816 bytes remaining: 12218138624 bytes total: 34359869440 bytes progression: 64.44% busy: 1 ready: 0

Drive-scsi0: transferred: 22256025600 bytes remaining: 12103843840 bytes total: 34359869440 bytes progression: 64.77% busy: 1 ready: 0

Drive-scsi0: transferred: 22353543168 bytes remaining: 12006326272 bytes total: 34359869440 bytes progression: 65.06% busy: 1 ready: 0

Drive-scsi0: transferred: 22466789376 bytes remaining: 11893080064 bytes total: 34359869440 bytes progression: 65.39% busy: 1 ready: 0

Drive-scsi0: transferred: 22588424192 bytes remaining: 11771445248 bytes total: 34359869440 bytes progression: 65.74% busy: 1 ready: 0

Drive-scsi0: transferred: 22694330368 bytes remaining: 11665539072 bytes total: 34359869440 bytes progression: 66.05% busy: 1 ready: 0

Drive-scsi0: transferred: 22811770880 bytes remaining: 11548098560 bytes total: 34359869440 bytes progression: 66.39% busy: 1 ready: 0

Drive-scsi0: transferred: 22905094144 bytes remaining: 11454775296 bytes total: 34359869440 bytes progression: 66.66% busy: 1 ready: 0

Drive-scsi0: transferred: 23021486080 bytes remaining: 11338383360 bytes total: 34359869440 bytes progression: 67.00% busy: 1 ready: 0

Drive-scsi0: transferred: 23133683712 bytes remaining: 11226185728 bytes total: 34359869440 bytes progression: 67.33% busy: 1 ready: 0

Drive-scsi0: transferred: 23220715520 bytes remaining: 11139153920 bytes total: 34359869440 bytes progression: 67.58% busy: 1 ready: 0

Drive-scsi0: transferred: 23306698752 bytes remaining: 11053170688 bytes total: 34359869440 bytes progression: 67.83% busy: 1 ready: 0

Drive-scsi0: transferred: 23418896384 bytes remaining: 10940973056 bytes total: 34359869440 bytes progression: 68.16% busy: 1 ready: 0

Drive-scsi0: transferred: 23528996864 bytes remaining: 10830872576 bytes total: 34359869440 bytes progression: 68.48% busy: 1 ready: 0

Drive-scsi0: transferred: 23640145920 bytes remaining: 10719723520 bytes total: 34359869440 bytes progression: 68.80% busy: 1 ready: 0

Drive-scsi0: transferred: 23743954944 bytes remaining: 10615914496 bytes total: 34359869440 bytes progression: 69.10% busy: 1 ready: 0

Drive-scsi0: transferred: 23865589760 bytes remaining: 10494279680 bytes total: 34359869440 bytes progression: 69.46% busy: 1 ready: 0

Drive-scsi0: transferred: 23970447360 bytes remaining: 10389422080 bytes total: 34359869440 bytes progression: 69.76% busy: 1 ready: 0

Drive-scsi0: transferred: 24088936448 bytes remaining: 10270932992 bytes total: 34359869440 bytes progression: 70.11% busy: 1 ready: 0

Drive-scsi0: transferred: 24216862720 bytes remaining: 10143006720 bytes total: 34359869440 bytes progression: 70.48% busy: 1 ready: 0

Drive-scsi0: transferred: 24331157504 bytes remaining: 10028711936 bytes total: 34359869440 bytes progression: 70.81% busy: 1 ready: 0

Drive-scsi0: transferred: 24445452288 bytes remaining: 9914417152 bytes total: 34359869440 bytes progression: 71.15% busy: 1 ready: 0

Drive-scsi0: transferred: 24529338368 bytes remaining: 9830531072 bytes total: 34359869440 bytes progression: 71.39% busy: 1 ready: 0

Drive-scsi0: transferred: 24621613056 bytes remaining: 9738256384 bytes total: 34359869440 bytes progression: 71.66% busy: 1 ready: 0

Drive-scsi0: transferred: 24727519232 bytes remaining: 9632350208 bytes total: 34359869440 bytes progression: 71.97% busy: 1 ready: 0

Drive-scsi0: transferred: 24861736960 bytes remaining: 9498132480 bytes total: 34359869440 bytes progression: 72.36% busy: 1 ready: 0

Drive-scsi0: transferred: 24978128896 bytes remaining: 9381740544 bytes total: 34359869440 bytes progression: 72.70% busy: 1 ready: 0

Drive-scsi0: transferred: 25093472256 bytes remaining: 9266397184 bytes total: 34359869440 bytes progression: 73.03% busy: 1 ready: 0

Drive-scsi0: transferred: 25227689984 bytes remaining: 9132179456 bytes total: 34359869440 bytes progression: 73.42% busy: 1 ready: 0

Drive-scsi0: transferred: 25321013248 bytes remaining: 9038856192 bytes total: 34359869440 bytes progression: 73.69% busy: 1 ready: 0

Drive-scsi0: transferred: 25432162304 bytes remaining: 8927707136 bytes total: 34359869440 bytes progression: 74.02% busy: 1 ready: 0

Drive-scsi0: transferred: 25540165632 bytes remaining: 8819703808 bytes total: 34359869440 bytes progression: 74.33% busy: 1 ready: 0

Drive-scsi0: transferred: 25637683200 bytes remaining: 8722186240 bytes total: 34359869440 bytes progression: 74.62% busy: 1 ready: 0

Drive-scsi0: transferred: 25738346496 bytes remaining: 8621522944 bytes total: 34359869440 bytes progression: 74.91% busy: 1 ready: 0

Drive-scsi0: transferred: 25847398400 bytes remaining: 8512471040 bytes total: 34359869440 bytes progression: 75.23% busy: 1 ready: 0

Drive-scsi0: transferred: 25951207424 bytes remaining: 8408662016 bytes total: 34359869440 bytes progression: 75.53% busy: 1 ready: 0

Drive-scsi0: transferred: 26079133696 bytes remaining: 8280735744 bytes total: 34359869440 bytes progression: 75.90% busy: 1 ready: 0

Drive-scsi0: transferred: 26163019776 bytes remaining: 8196849664 bytes total: 34359869440 bytes progression: 76.14% busy: 1 ready: 0

Drive-scsi0: transferred: 26264731648 bytes remaining: 8095137792 bytes total: 34359869440 bytes progression: 76.44% busy: 1 ready: 0

Drive-scsi0: transferred: 26381123584 bytes remaining: 7978745856 bytes total: 34359869440 bytes progression: 76.78% busy: 1 ready: 0

Drive-scsi0: transferred: 26494369792 bytes remaining: 7865499648 bytes total: 34359869440 bytes progression: 77.11% busy: 1 ready: 0

Drive-scsi0: transferred: 26590838784 bytes remaining: 7769030656 bytes total: 34359869440 bytes progression: 77.39% busy: 1 ready: 0

Drive-scsi0: transferred: 26623344640 bytes remaining: 7736524800 bytes total: 34359869440 bytes progression: 77.48% busy: 1 ready: 0

Drive-scsi0: transferred: 26685210624 bytes remaining: 7674658816 bytes total: 34359869440 bytes progression: 77.66% busy: 1 ready: 0

Drive-scsi0: transferred: 26741833728 bytes remaining: 7618035712 bytes total: 34359869440 bytes progression: 77.83% busy: 1 ready: 0

Drive-scsi0: transferred: 26785873920 bytes remaining: 7573995520 bytes total: 34359869440 bytes progression: 77.96% busy: 1 ready: 0

Drive-scsi0: transferred: 26870808576 bytes remaining: 7489060864 bytes total: 34359869440 bytes progression: 78.20% busy: 1 ready: 0

Drive-scsi0: transferred: 26977763328 bytes remaining: 7382106112 bytes total: 34359869440 bytes progression: 78.52% busy: 1 ready: 0

Drive-scsi0: transferred: 27081572352 bytes remaining: 7278297088 bytes total: 34359869440 bytes progression: 78.82% busy: 1 ready: 0

Drive-scsi0: transferred: 27191672832 bytes remaining: 7168196608 bytes total: 34359869440 bytes progression: 79.14% busy: 1 ready: 0

Drive-scsi0: transferred: 27283947520 bytes remaining: 7075921920 bytes total: 34359869440 bytes progression: 79.41% busy: 1 ready: 0

Drive-scsi0: transferred: 27385659392 bytes remaining: 6974210048 bytes total: 34359869440 bytes progression: 79.70% busy: 1 ready: 0

Drive-scsi0: transferred: 27486322688 bytes remaining: 6873546752 bytes total: 34359869440 bytes progression: 80.00% busy: 1 ready: 0

Drive-scsi0: transferred: 27605860352 bytes remaining: 6754009088 bytes total: 34359869440 bytes progression: 80.34% busy: 1 ready: 0

Drive-scsi0: transferred: 27705475072 bytes remaining: 6654394368 bytes total: 34359869440 bytes progression: 80.63% busy: 1 ready: 0

Drive-scsi0: transferred: 27793555456 bytes remaining: 6566313984 bytes total: 34359869440 bytes progression: 80.89% busy: 1 ready: 0

Drive-scsi0: transferred: 27869052928 bytes remaining: 6490816512 bytes total: 34359869440 bytes progression: 81.11% busy: 1 ready: 0

Drive-scsi0: transferred: 27965521920 bytes remaining: 6394347520 bytes total: 34359869440 bytes progression: 81.39% busy: 1 ready: 0

Drive-scsi0: transferred: 28073525248 bytes remaining: 6286344192 bytes total: 34359869440 bytes progression: 81.70% busy: 1 ready: 0

Drive-scsi0: transferred: 28187820032 bytes remaining: 6172049408 bytes total: 34359869440 bytes progression: 82.04% busy: 1 ready: 0

Drive-scsi0: transferred: 28282191872 bytes remaining: 6077677568 bytes total: 34359869440 bytes progression: 82.31% busy: 1 ready: 0

Drive-scsi0: transferred: 28400680960 bytes remaining: 5959188480 bytes total: 34359869440 bytes progression: 82.66% busy: 1 ready: 0

Drive-scsi0: transferred: 28487712768 bytes remaining: 5872156672 bytes total: 34359869440 bytes progression: 82.91% busy: 1 ready: 0

Drive-scsi0: transferred: 28587327488 bytes remaining: 5772541952 bytes total: 34359869440 bytes progression: 83.20% busy: 1 ready: 0

Drive-scsi0: transferred: 28693233664 bytes remaining: 5666635776 bytes total: 34359869440 bytes progression: 83.51% busy: 1 ready: 0

Drive-scsi0: transferred: 28797042688 bytes remaining: 5562826752 bytes total: 34359869440 bytes progression: 83.81% busy: 1 ready: 0

Drive-scsi0: transferred: 28896657408 bytes remaining: 5463212032 bytes total: 34359869440 bytes progression: 84.10% busy: 1 ready: 0

Drive-scsi0: transferred: 29025632256 bytes remaining: 5334237184 bytes total: 34359869440 bytes progression: 84.48% busy: 1 ready: 0

Drive-scsi0: transferred: 29124198400 bytes remaining: 5235671040 bytes total: 34359869440 bytes progression: 84.76% busy: 1 ready: 0

Drive-scsi0: transferred: 29234298880 bytes remaining: 5125570560 bytes total: 34359869440 bytes progression: 85.08% busy: 1 ready: 0

Drive-scsi0: transferred: 29351739392 bytes remaining: 5008130048 bytes total: 34359869440 bytes progression: 85.42% busy: 1 ready: 0

Drive-scsi0: transferred: 29440868352 bytes remaining: 4919001088 bytes total: 34359869440 bytes progression: 85.68% busy: 1 ready: 0

Drive-scsi0: transferred: 29538385920 bytes remaining: 4821483520 bytes total: 34359869440 bytes progression: 85.97% busy: 1 ready: 0

Drive-scsi0: transferred: 29647437824 bytes remaining: 4712431616 bytes total: 34359869440 bytes progression: 86.29% busy: 1 ready: 0

Drive-scsi0: transferred: 29763829760 bytes remaining: 4596039680 bytes total: 34359869440 bytes progression: 86.62% busy: 1 ready: 0

Drive-scsi0: transferred: 29887561728 bytes remaining: 4472307712 bytes total: 34359869440 bytes progression: 86.98% busy: 1 ready: 0

Drive-scsi0: transferred: 29978787840 bytes remaining: 4381081600 bytes total: 34359869440 bytes progression: 87.25% busy: 1 ready: 0

Drive-scsi0: transferred: 30096228352 bytes remaining: 4263641088 bytes total: 34359869440 bytes progression: 87.59% busy: 1 ready: 0

Drive-scsi0: transferred: 30212620288 bytes remaining: 4147249152 bytes total: 34359869440 bytes progression: 87.93% busy: 1 ready: 0

Drive-scsi0: transferred: 30329012224 bytes remaining: 4030857216 bytes total: 34359869440 bytes progression: 88.27% busy: 1 ready: 0

Drive-scsi0: transferred: 30433869824 bytes remaining: 3925999616 bytes total: 34359869440 bytes progression: 88.57% busy: 1 ready: 0

Drive-scsi0: transferred: 30519853056 bytes remaining: 3840016384 bytes total: 34359869440 bytes progression: 88.82% busy: 1 ready: 0

Drive-scsi0: transferred: 30643585024 bytes remaining: 3716284416 bytes total: 34359869440 bytes progression: 89.18% busy: 1 ready: 0

Drive-scsi0: transferred: 30755782656 bytes remaining: 3604086784 bytes total: 34359869440 bytes progression: 89.51% busy: 1 ready: 0

Drive-scsi0: transferred: 30874271744 bytes remaining: 3485597696 bytes total: 34359869440 bytes progression: 89.86% busy: 1 ready: 0

Drive-scsi0: transferred: 31005343744 bytes remaining: 3354525696 bytes total: 34359869440 bytes progression: 90.24% busy: 1 ready: 0

Drive-scsi0: transferred: 31132221440 bytes remaining: 3227648000 bytes total: 34359869440 bytes progression: 90.61% busy: 1 ready: 0

Drive-scsi0: transferred: 31253856256 bytes remaining: 3106013184 bytes total: 34359869440 bytes progression: 90.96% busy: 1 ready: 0

Drive-scsi0: transferred: 31363956736 bytes remaining: 2995912704 bytes total: 34359869440 bytes progression: 91.28% busy: 1 ready: 0

Drive-scsi0: transferred: 31452037120 bytes remaining: 2907832320 bytes total: 34359869440 bytes progression: 91.54% busy: 1 ready: 0

Drive-scsi0: transferred: 31553748992 bytes remaining: 2806120448 bytes total: 34359869440 bytes progression: 91.83% busy: 1 ready: 0

Drive-scsi0: transferred: 31652315136 bytes remaining: 2707554304 bytes total: 34359869440 bytes progression: 92.12% busy: 1 ready: 0

Drive-scsi0: transferred: 31765561344 bytes remaining: 2594308096 bytes total: 34359869440 bytes progression: 92.45% busy: 1 ready: 0

Drive-scsi0: transferred: 31854690304 bytes remaining: 2505179136 bytes total: 34359869440 bytes progression: 92.71% busy: 1 ready: 0

Drive-scsi0: transferred: 31971082240 bytes remaining: 2388787200 bytes total: 34359869440 bytes progression: 93.05% busy: 1 ready: 0

Drive-scsi0: transferred: 32085377024 bytes remaining: 2274492416 bytes total: 34359869440 bytes progression: 93.38% busy: 1 ready: 0

Drive-scsi0: transferred: 32173457408 bytes remaining: 2186412032 bytes total: 34359869440 bytes progression: 93.64% busy: 1 ready: 0

Drive-scsi0: transferred: 32258392064 bytes remaining: 2101477376 bytes total: 34359869440 bytes progression: 93.88% busy: 1 ready: 0

Drive-scsi0: transferred: 32366395392 bytes remaining: 1993474048 bytes total: 34359869440 bytes progression: 94.20% busy: 1 ready: 0

Drive-scsi0: transferred: 32467058688 bytes remaining: 1892810752 bytes total: 34359869440 bytes progression: 94.49% busy: 1 ready: 0

Drive-scsi0: transferred: 32585547776 bytes remaining: 1774321664 bytes total: 34359869440 bytes progression: 94.84% busy: 1 ready: 0

Drive-scsi0: transferred: 32656850944 bytes remaining: 1703018496 bytes total: 34359869440 bytes progression: 95.04% busy: 1 ready: 0

Drive-scsi0: transferred: 32752271360 bytes remaining: 1607598080 bytes total: 34359869440 bytes progression: 95.32% busy: 1 ready: 0

Drive-scsi0: transferred: 32848740352 bytes remaining: 1511129088 bytes total: 34359869440 bytes progression: 95.60% busy: 1 ready: 0

Drive-scsi0: transferred: 32950452224 bytes remaining: 1409417216 bytes total: 34359869440 bytes progression: 95.90% busy: 1 ready: 0

Drive-scsi0: transferred: 33065795584 bytes remaining: 1294073856 bytes total: 34359869440 bytes progression: 96.23% busy: 1 ready: 0

Drive-scsi0: transferred: 33171701760 bytes remaining: 1188167680 bytes total: 34359869440 bytes progression: 96.54% busy: 1 ready: 0

Drive-scsi0: transferred: 33304870912 bytes remaining: 1054998528 bytes total: 34359869440 bytes progression: 96.93% busy: 1 ready: 0

Drive-scsi0: transferred: 33407631360 bytes remaining: 952238080 bytes total: 34359869440 bytes progression: 97.23% busy: 1 ready: 0

Drive-scsi0: transferred: 33519828992 bytes remaining: 840040448 bytes total: 34359869440 bytes progression: 97.56% busy: 1 ready: 0

Drive-scsi0: transferred: 33621540864 bytes remaining: 738328576 bytes total: 34359869440 bytes progression: 97.85% busy: 1 ready: 0

Drive-scsi0: transferred: 33741078528 bytes remaining: 618790912 bytes total: 34359869440 bytes progression: 98.20% busy: 1 ready: 0

Drive-scsi0: transferred: 33833353216 bytes remaining: 526516224 bytes total: 34359869440 bytes progression: 98.47% busy: 1 ready: 0

Drive-scsi0: transferred: 33935065088 bytes remaining: 424804352 bytes total: 34359869440 bytes progression: 98.76% busy: 1 ready: 0

Drive-scsi0: transferred: 34019999744 bytes remaining: 339935232 bytes total: 34359934976 bytes progression: 99.01% busy: 1 ready: 0

Drive-scsi0: transferred: 34119614464 bytes remaining: 240320512 bytes total: 34359934976 bytes progression: 99.30% busy: 1 ready: 0

Drive-scsi0: transferred: 34223423488 bytes remaining: 136511488 bytes total: 34359934976 bytes progression: 99.60% busy: 1 ready: 0

Drive-scsi0: transferred: 34352594944 bytes remaining: 7340032 bytes total: 34359934976 bytes progression: 99.98% busy: 1 ready: 0

Drive-scsi0: transferred: 34359934976 bytes remaining: 0 bytes total: 34359934976 bytes progression: 100.00 busy: 0 ready: 1

All mirroring jobs are ready

2019-08-16 11:49:08 starting online/live migration on unix:/run/qemu-server/100.migrate

2019-08-16 11:49:08 migrate_set_speed: 8589934592

2019-08-16 11:49:08 migrate_set_downtime: 0.1

2019-08-16 11:49:08 set migration_caps

2019-08-16 11:49:08 set cachesize: 268435456

2019-08-16 11:49:08 start migrate command to unix:/run/qemu-server/100.migrate

2019-08-16 11:49:09 migration status: active (transferred 34104177, remaining 2127441920), total 2165121024)

2019-08-16 11:49:09 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:10 migration status: active (transferred 83541717, remaining 2077822976), total 2165121024)

2019-08-16 11:49:10 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:11 migration status: active (transferred 112052530, remaining 2049282048), total 2165121024)

2019-08-16 11:49:11 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:12 migration status: active (transferred 140756294, remaining 2020519936), total 2165121024)

2019-08-16 11:49:12 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:13 migration status: active (transferred 166986156, remaining 1993859072), total 2165121024)

2019-08-16 11:49:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:14 migration status: active (transferred 193587196, remaining 1966002176), total 2165121024)

2019-08-16 11:49:14 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:15 migration status: active (transferred 220842221, remaining 1936834560), total 2165121024)

2019-08-16 11:49:15 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:16 migration status: active (transferred 246517558, remaining 1910943744), total 2165121024)

2019-08-16 11:49:16 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:17 migration status: active (transferred 272587166, remaining 1884532736), total 2165121024)

2019-08-16 11:49:17 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:18 migration status: active (transferred 300293873, remaining 1856671744), total 2165121024)

2019-08-16 11:49:18 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:19 migration status: active (transferred 326048751, remaining 1829994496), total 2165121024)

2019-08-16 11:49:19 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:20 migration status: active (transferred 353334106, remaining 1801932800), total 2165121024)

2019-08-16 11:49:20 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:21 migration status: active (transferred 410838877, remaining 1741094912), total 2165121024)

2019-08-16 11:49:21 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:22 migration status: active (transferred 442024688, remaining 1708388352), total 2165121024)

2019-08-16 11:49:22 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:23 migration status: active (transferred 465984534, remaining 1684221952), total 2165121024)

2019-08-16 11:49:23 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:24 migration status: active (transferred 493546773, remaining 1655017472), total 2165121024)

2019-08-16 11:49:24 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:25 migration status: active (transferred 521094792, remaining 1624829952), total 2165121024)

2019-08-16 11:49:25 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:26 migration status: active (transferred 548641435, remaining 1595265024), total 2165121024)

2019-08-16 11:49:26 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:27 migration status: active (transferred 575626856, remaining 1567657984), total 2165121024)

2019-08-16 11:49:27 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:28 migration status: active (transferred 602964096, remaining 1540210688), total 2165121024)

2019-08-16 11:49:28 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:29 migration status: active (transferred 630810575, remaining 1512095744), total 2165121024)

2019-08-16 11:49:29 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:30 migration status: active (transferred 659941992, remaining 1482526720), total 2165121024)

2019-08-16 11:49:30 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:31 migration status: active (transferred 684641891, remaining 1457012736), total 2165121024)

2019-08-16 11:49:31 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:32 migration status: active (transferred 713545059, remaining 1426956288), total 2165121024)

2019-08-16 11:49:32 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:33 migration status: active (transferred 771149459, remaining 1367371776), total 2165121024)

2019-08-16 11:49:33 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:34 migration status: active (transferred 820144722, remaining 1317756928), total 2165121024)

2019-08-16 11:49:34 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:35 migration status: active (transferred 849408628, remaining 1270755328), total 2165121024)

2019-08-16 11:49:35 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:36 migration status: active (transferred 876510087, remaining 1242517504), total 2165121024)

2019-08-16 11:49:36 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:37 migration status: active (transferred 903330006, remaining 1215688704), total 2165121024)

2019-08-16 11:49:37 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:38 migration status: active (transferred 933149922, remaining 1185878016), total 2165121024)

2019-08-16 11:49:38 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:39 migration status: active (transferred 958648310, remaining 1160380416), total 2165121024)

2019-08-16 11:49:39 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:40 migration status: active (transferred 984819734, remaining 1134227456), total 2165121024)

2019-08-16 11:49:40 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:41 migration status: active (transferred 1009653327, remaining 1109372928), total 2165121024)

2019-08-16 11:49:41 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:42 migration status: active (transferred 1034622586, remaining 1084276736), total 2165121024)

2019-08-16 11:49:42 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:43 migration status: active (transferred 1062612821, remaining 1055969280), total 2165121024)

2019-08-16 11:49:43 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:44 migration status: active (transferred 1090808409, remaining 1027387392), total 2165121024)

2019-08-16 11:49:44 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:45 migration status: active (transferred 1119112934, remaining 997679104), total 2165121024)

2019-08-16 11:49:45 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:46 migration status: active (transferred 1148129357, remaining 968265728), total 2165121024)

2019-08-16 11:49:46 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:47 migration status: active (transferred 1207212710, remaining 908378112), total 2165121024)

2019-08-16 11:49:47 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:48 migration status: active (transferred 1234209452, remaining 881213440), total 2165121024)

2019-08-16 11:49:48 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:49 migration status: active (transferred 1282635645, remaining 829673472), total 2165121024)

2019-08-16 11:49:49 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:50 migration status: active (transferred 1339080485, remaining 772259840), total 2165121024)

2019-08-16 11:49:50 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:51 migration status: active (transferred 1378526208, remaining 731963392), total 2165121024)

2019-08-16 11:49:51 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:52 migration status: active (transferred 1405532032, remaining 704389120), total 2165121024)

2019-08-16 11:49:52 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:53 migration status: active (transferred 1434949462, remaining 673243136), total 2165121024)

2019-08-16 11:49:53 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:54 migration status: active (transferred 1461321793, remaining 645107712), total 2165121024)

2019-08-16 11:49:54 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:55 migration status: active (transferred 1489489706, remaining 616075264), total 2165121024)

2019-08-16 11:49:55 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:56 migration status: active (transferred 1516725427, remaining 588234752), total 2165121024)

2019-08-16 11:49:56 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:58 migration status: active (transferred 1544613728, remaining 559726592), total 2165121024)

2019-08-16 11:49:58 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:49:59 migration status: active (transferred 1572437202, remaining 530903040), total 2165121024)

2019-08-16 11:49:59 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:00 migration status: active (transferred 1603688137, remaining 498376704), total 2165121024)

2019-08-16 11:50:00 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:01 migration status: active (transferred 1641161464, remaining 453722112), total 2165121024)

2019-08-16 11:50:01 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:02 migration status: active (transferred 1694574484, remaining 391405568), total 2165121024)

2019-08-16 11:50:02 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:03 migration status: active (transferred 1748789557, remaining 336801792), total 2165121024)

2019-08-16 11:50:03 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:04 migration status: active (transferred 1776459608, remaining 306982912), total 2165121024)

2019-08-16 11:50:04 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:05 migration status: active (transferred 1815021189, remaining 268378112), total 2165121024)

2019-08-16 11:50:05 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:06 migration status: active (transferred 1845138214, remaining 235667456), total 2165121024)

2019-08-16 11:50:06 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:07 migration status: active (transferred 1877470040, remaining 203227136), total 2165121024)

2019-08-16 11:50:07 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:08 migration status: active (transferred 1904196234, remaining 174321664), total 2165121024)

2019-08-16 11:50:08 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:09 migration status: active (transferred 1930237141, remaining 146063360), total 2165121024)

2019-08-16 11:50:09 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:10 migration status: active (transferred 1955568776, remaining 120049664), total 2165121024)

2019-08-16 11:50:10 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:11 migration status: active (transferred 1984565328, remaining 90357760), total 2165121024)

2019-08-16 11:50:11 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:12 migration status: active (transferred 2019780241, remaining 46641152), total 2165121024)

2019-08-16 11:50:12 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2045041805, remaining 17121280), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2048340718, remaining 13561856), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 0 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2051365391, remaining 10539008), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 905 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2055810040, remaining 6098944), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 1988 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2057829395, remaining 4005888), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 2480 overflow 0

2019-08-16 11:50:13 migration status: active (transferred 2060814104, remaining 540672), total 2165121024)

2019-08-16 11:50:13 migration xbzrle cachesize: 268435456 transferred 0 pages 0 cachemiss 3207 overflow 0

2019-08-16 11:50:13 migration speed: 5.11 MB/s-downtime 49 ms

2019-08-16 11:50:13 migration status: completed

Drive-scsi0: transferred: 34360262656 bytes remaining: 0 bytes total: 34360262656 bytes progression: 100.00 busy: 0 ready: 1

All mirroring jobs are ready

Drive-scsi0: Completing block job...

Drive-scsi0: Completed successfully.

Drive-scsi0: finished

Logical volume "vm-100-disk-0" successfully removed

2019-08-16 11:50:21 migration finished successfully (duration 00:06:55)

TASK OK

After reading the above, do you have any further understanding of how to analyze the new features of ProxmoxVE v6.0? If you want to know more knowledge or related content, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.