Shulou(Shulou.com)06/03 Report--

Let's talk about the data migration of Azure storage. When we need to migrate data to storage, we actually have many ways to choose, each of which applies in a different scenario. To sum up, it can be divided into the following

Network transmission

Graphical interface

AzCopy

PowerShell

CLI

SDK

Azure Data Factory

Physical transmission

Azure Import/Export

Azure Databox

There are many ways we can choose, but which one is appropriate should be seen by case by case.

First of all, one of the biggest disadvantages of network transmission is that the speed is slow and the stability is poor. If we have large-scale data that needs to be transferred to the cloud (such as 10T +), it is recommended not to use network transmission. The speed is uncontrollable, the bandwidth dependence is very strong, and there is the risk of transmission interruption. For this large-scale data, it is recommended to use the physical method of Azure import/Export for transmission. It is definitely much faster to copy the data directly to the hard disk and send it directly to the data center after encryption.

Secondly, if the amount of data is relatively small, then the advantage of network transmission over physical transmission will be more obvious. In so many network transmission schemes, it has been recommended to use azcopy,azcopy for a long time. After a large version of the update, the latest version of azcopy v10 V10 is easier to use than before, and it can also support the use of Azure AD for authentication.

Global has a picture that actually guides us very well on how to choose the way data is transmitted.

Of course, in addition, there are actually some third-party products that can also be used, such as cloudberry, but many of these products are paid for, so those who are interested can try it.

Next, we will focus on the use of AzCopy. A big difference between AzCopy v10 and before is that it doesn't need to be installed, it's just an executable file, so you just need to copy it to the server and run it.

The download address for AzCopy v10 is as follows:

Https://aka.ms/downloadazcopy-v10-windows

Using this address, you will download the latest version of azcopy every time.

If we want to download a fixed version of azcopy, we can first get the fixed url of azcopy, and use this url to download each time.

You can directly use curl to get relevant information on Windows 10.

(curl https://aka.ms/downloadazcopy-v10-windows-MaximumRedirection 0-ErrorAction silentlycontinue) .RawContent

After the download is complete, you can see the true face of azcopy.

Before making a copy of the data, let's take a look at how azcopy authenticates. Generally speaking, azcopy supports two authentication methods, Azure AD and SAS, which is completely different from previous versions of azcopy, which used storage's key to authenticate directly, but SAS and Azure AD are more recommended in azcopy v10.

Authorization methods supported by storage types

Blob Storage Azure AD & SAS

Blob Storage (hierarchical Namespace) Azure AD & SAS File Storage SAS

We can use AzCopy to complete a lot of data copy tasks, covering a variety of scenarios, and the function is very powerful. Next, we are going to take an actual case to illustrate when to use azcopy and how to use azcopy.

1. Local files / folders-> storage

2.storage- > Local files / folders

3.storage-> storage

4.S3-> storage

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.