Shulou(Shulou.com)06/01 Report--

Today, I will talk to you about how to use python to climb the ranking information of Chinese university ranking websites. Many people may not know much about it. In order to make you understand better, the editor has summarized the following content for you. I hope you can get something according to this article.

The program solves the problem as follows:

Use python web crawler to crawl the ranking information on the ranking website of Chinese universities, save the information of the top 20 universities as text files, and print out the information of these 20 universities in the window, print and save them in columns.

The program code is as follows:

Import requestsfrom bs4 import BeautifulSoupimport bs4 def getHTMLText (url): try: r = requests.get (url, timeout=30) r.raise_for_status () r.encoding = r.apparent_encoding return r.text except: return "" def fillUnivList (ulist, html): soup = BeautifulSoup (html, "html.parser") for tr in soup.find ('tbody'). Children: if isinstance (tr) Bs4.element.Tag): tds = tr ('td') hdfd = tds [0] .find (' div') tt = hdfd.string.split () ff = ".join (tt) attr = tds [1] .find ('a') hh = tds [4] .string.split () hg =" .join ( Hh) shf=tds [2] .text.split () shfn= "" .join (shf) ulist.append ([ff) Attr.string,shfn,hg]) def printUnivList (ulist, num): tplt = "{0: ^ 10}\ t {1: {4} ^ 10}\ t {2: ^ 10}\ t {3: ^ 10}" print (tplt.format ("ranking", "name of the school", "province", "total score", chr (12288)) with open ('save.txt', 'wages, encoding='utf-8') as f: f.write ("ranking") "School name", "province", "total score", chr (12288)) f.write ('\ n') for i in range (num): U = ulist [I] print (tplt.format (u [0], u [1], u [2], u [3], chr (12288)) with open ('save.txt', 'a') Encoding='utf-8') as f: f.write (tplt.format (u [0], u [1], u [2], u [3], chr (12288)) f.write ('\ n') def main (): with open ('save.txt',' winters, encoding='utf-8') as f: f.write ("ranking, schools, provinces Total score\ n "f.close () uinfo = [] url = 'https://www.shanghairanking.cn/rankings/bcur/2021' html = getHTMLText (url) fillUnivList (uinfo, html) printUnivList (uinfo, 20) main ()

The running result of the program is as follows:

After reading the above content, do you have any further understanding of how to use python to crawl the ranking information of Chinese university ranking websites? If you want to know more knowledge or related content, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.