Shulou(Shulou.com)06/02 Report--

Editor to share with you how to use the wget command under linux. I hope you will get something after reading this article. Let's discuss it together.

1. Download a single file using wget

The following example is to download a file from the network and save it in the current directory

Wget http://cn.wordpress.org/wordpress-3.1-zh_CN.zip

A progress bar is displayed during the download process, including (percentage of download completed, bytes already downloaded, current download speed, remaining download time).

2. Use wget-O to download and save under a different file name.

By default, wget commands with the last character following the "/", and the file name is usually incorrect for dynamically linked downloads.

Error: the following example downloads a file and saves it with the name download.php?id=1080

Wget http://www.centos.bz/download?id=1

Even if the downloaded file is in zip format, it still uses the download.php?id=1080 command.

Correct: to solve this problem, we can use the parameter-O to specify a file name:

Wget-O wordpress.zip http://www.centos.bz/download.php?id=10803, download speed limit using wget-limit-rate

When you execute wget, it takes up all possible broadband downloads by default. But the speed limit is necessary when you are ready to download a large file and you need to download other files.

Wget-limit-rate=300k http://cn.wordpress.org/wordpress-3.1-zh_CN.zip4, resume transmission using wget-c breakpoint

Restart the download interrupted file using wget-c:

Wget-c http://cn.wordpress.org/wordpress-3.1-zh_CN.zip

It is very helpful for us to download large files when we are suddenly interrupted due to network and other reasons, we can continue to download instead of downloading a file. You can use the-c parameter when you need to continue interrupting downloads.

5. Use wget-b to download in the background

For downloading very large files, we can use the parameter-b for background download.

Wget-b http://cn.wordpress.org/wordpress-3.1-zh_CN.zip

Continuing in background, pid 1840.

Output will be written to `wget-log'.

You can use the following command to check the download progress

Download tail-f wget-log6, camouflage agent name

Some websites can reject your download request by judging that the proxy name is not a browser. However, you can disguise it with the-user-agent parameter.

Wget-user-agent= "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.16 (KHTML, like Gecko) Chrome/10.0.648.204 Safari/534.16" download link 7, use wget-spider test download link

When you plan to download regularly, you should test whether the download link is valid at the scheduled time. We can add the-spider parameter to check.

Wget-spider URL

If the download link is correct, it will display

Wget-spider URLSpider mode enabled. Check if remote file exists.HTTP request sent, awaiting response... 200 OKLength: unspecified [text/html] Remote file exists and could contain further links,but recursion is disabled-not retrieving.

This ensures that the download will take place at the scheduled time, but when you give the wrong link, the following error will be displayed

Wget-spider urlSpider mode enabled. Check if remote file exists.HTTP request sent, awaiting response... 404 Not FoundRemote file does not exist-broken Linklinks!

You can use the spider parameter in the following situations:

Check before regular download

Interval to check whether a website is available

Check the dead links on the website page

8. Use wget-tries to increase the number of retries

If there is a problem with the network or downloading a large file may also fail. By default, wget retries the connection to download the file 20 times. If necessary, you can use-tries to increase the number of retries.

Wget-tries=40 URL9, download multiple files using wget-I

First, save a download link file

Cat > filelist.txturl1url2url3url4

Then use this file and parameters-I to download

Wget-I filelist.txt10, using wget-mirror mirroring website

The following example is to download the entire site locally.

Wget-mirror-p-convert-links-P. / LOCAL URL-miror: account opening image download-p: download all files that are displayed normally for the html page-convert-links: after download, convert to local link-P. / LOCAL: save all files and directories to the local specified directory 11, use wget-reject to filter the specified format for download

You want to download a website, but you do not want to download pictures, you can use the following command.

Wget-reject=gif url12, use wget-o to save download information to log file

You do not want the download information to be displayed directly on the terminal but in a log file, you can use the following command:

Wget-o download.log URL13, use wget-Q to limit the total download file size

When you want to download more than 5m files and exit the download, you can use the following command:

Wget-Q5m-I filelist.txt

Note: this parameter does not work for a single file download and is only valid for recursive downloads.

14. Use wget-r-A to download files in the specified format

You can use this feature in the following situations

Download all the pictures on a website

Download all the videos on a website

Download all the PDF files of a website

Wget-r-A.pdf url15, download using wget FTP

You can use wget to download the ftp link.

Download using wget anonymous ftp

Wget ftp-url

Ftp downloads authenticated with wget username and password

After reading this article, wget-ftp-user=USERNAME-ftp-password=PASSWORD url, I believe you have a certain understanding of "how to use wget commands under linux". If you want to know more about it, please follow the industry information channel. Thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.