Shulou(Shulou.com)06/01 Report--

The main content of this article is to explain "what is the simple picture crawler method of Python". Interested friends may wish to have a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn "what is the simple picture crawler method of Python"?

Environment:

Windows

Pycharm

Python3

Import module

Import urllib.parseimport jsonimport requestsimport jsonpath

Identify the target URL

Url = 'https://www.duitang.com/napi/blog/list/by_search/?kw={}&start={}'

Analyze the website and determine the crawling target

Label = 'Beauty' label = urllib.parse.quote (label)

Send a request to extract data

Num = 0for index in range: U = url.format (label,index) we_data = requests.get (u) .text

Type conversion

Html = json.loads (we_data) photo = jsonpath.jsonpath (html, "$.. path")

Save data

For i in photo: a = requests.get (I) with open (ritual C:\ Users\ Administrator\ Desktop\ tupian\ {} .jpg '.format (num),' wb') as f: f.write (a.content) # binary num + = 1

Run the code, as shown in the following figure:

At this point, I believe that everyone on the "Python simple picture crawler method is what" have a deeper understanding, might as well to the actual operation of it! Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.