Shulou(Shulou.com)06/02 Report--

How to use Requests to realize network request in Python? in view of this problem, this article introduces the corresponding analysis and solution in detail, hoping to help more partners who want to solve this problem to find a more simple and feasible method.

Scene

> r = requests.get ('https://google.cn') # get

> > r

# HTTP response 200

> r.headers ['content-type'] # Page Type

'text/html'

>

'ISO-8859-1

Basic usage

The above is the simplest, without the above authentication, server authentication agent, request content, customization, etc., such as bringing the request data, encapsulating the required data into a dictionary, and then bringing it in with params.

# the URL accessed by the browser is

# https://google.cn/get?key2=value2&key1=value1

# access with Requests

> payload = {'key1':' value1', 'key2':' value2'}

> r = requests.get ('https://google.cn/get', params=payload)

The returned content can also be parsed, there is a built-in JSON decoder, but for a return is a dictionary, if it is multiple dictionaries, there is an error exception prompt.

> import requests

> r = requests.get ('https://google.cn/events')

> > r.json ()

[{upright repositoryquestions: {upright openings issuescards: 0, upright urlbacks: 'https://google.cn/...

If JSON decoding fails, r.json () throws an exception. For example, if the response gets 204 (no content), or if the response contains an invalid JSON, try a r.json () throw.

ValueError: No JSON object could be decoded

Customize header content

> headers = {'user-agent':' my-app/0.0.1'}

> r = requests.get (url, headers=headers)

For POST requests, you need to bring data with you

> payload = {'key1':' value1', 'key2':' value2'}

> r = requests.post ("https://google.cn/post", data=payload)

When crawling data, you will sometimes encounter that the website is accessed with cookies. At this time, you need to authenticate, get the cookies, and then access it with the parameter cookies.

> url = 'https://google.cn/cookies'

> cookies = dict (cookies_are='working')

> r = requests.get (url, cookies=cookies)

There are also some websites with anti-"crawl" mechanism, which can be used by adding cookies of multiple paths.

> > jar = requests.cookies.RequestsCookieJar ()

> jar.set ('tasty_cookie',' yum', domain='httpbin.org', path='/cookies')

> jar.set ('gross_cookie',' blech', domain='httpbin.org', path='/elsewhere')

> url = 'https://google.cn/cookies'

> r = requests.get (url, cookies=jar)

This is the answer to the question about how to use Requests to achieve network request in Python. I hope the above content can be of some help to you. If you still have a lot of doubts to be solved, you can follow the industry information channel to learn more about it.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.