Shulou(Shulou.com)06/03 Report--

This article will explain in detail how to use python to climb the Top50 data of Zhihu hot list. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article.

1. Import the third-party library import urllib.request Urllib.error # request web page from bs4 import BeautifulSoup # parse data import sqlite3 # import database import re # regular expression import time # get the current time 2, the program's main function def main (): # declare crawled web page baseurl = "https://www.zhihu.com/hot" # crawled web page datalist = getData (baseurl) # save data dbname = time.strftime ("% Y-%m-%d " Time.localtime () # dbpath = "zhihuTop50" + dbname saveData (datalist,dbpath) 3, regular expression matching data # regular expression findlink = re.compile (r'

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.