Shulou(Shulou.com)06/01 Report--

Python has also been used as a crawler for a long time. Today we share a lightweight crawler library: you-get

You-get is a video, picture and audio download tool written in Python3, which can be called a theft chain and a crawler artifact. The websites it supports are all the way to crack its algorithm and calculate the playurl directly.

Can not only grab the target cover, title description and other information, but also download the source video, very easy to use.

First you need to install python3, and then install pip. I won't go into details here.

After configuring the environment variables, execute them under cmd

Pip install you-get

After the installation is complete, you can try your skills. For example, if we climb a Tencent Video, we will directly tap "you-get" https://v.qq.com/x/cover/2tr6sh7iw7wyvhl/w0025xphmun.html" in the cmd.

You can see that crawling is being performed.

There are many websites supported by you-get. You can see GitHub-soimort/you-get: Dumb downloader that scrapes the web on github.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.