Shulou(Shulou.com)06/01 Report--

Today, the editor will share with you the relevant knowledge points about how python crawls the recruitment position data. The content is detailed and the logic is clear. I believe most people still know too much about this, so share this article for your reference. I hope you can get something after reading this article. Let's take a look at it.

Data crawling code # encoding='utf-8'from selenium import webdriverimport timeimport reimport pandas as pdimport osdef close_windows (): # if there is a login pop-up window Just close try: time.sleep (0.5) if dr.find_element_by_class_name ("jconfirm"). Find_element_by_class_name ("closeIcon"): dr.find_element_by_class_name ("jconfirm"). Find_element_by_class_name ("closeIcon"). Click () except BaseException ase: print ('close_windows, no pop-up window' E) def get_current_region_job (k_index): flag = how many pieces of data are obtained by region page_num_set=0# Round off 30 for df_empty = pd.DataFrame (columns= ['position', 'location', 'salary', 'work experience', 'education', 'company', 'skills']) while (flag = = 0): # while (page_num_set)

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.