Shulou(Shulou.com)06/01 Report--

In this issue, the editor will bring you about how to log in and grab data with RoboBrowser. The article is rich in content and analyzes and narrates it from a professional point of view. I hope you can get something after reading this article.

RoboBrowser is a simple Python library for browsing Web without a stand-alone Web browser. RoboBrowser can get the page, click links and buttons, and then fill out and submit the form. If you need to interact with Web services that do not have API, RoboBrowser can be a great help. Let's take a look at an example, which requires pip install robobrowser to install the library before using it:

Import refrom robobrowser import RoboBrowser# create RoboBrowserbr = RoboBrowser () # Open datacoup login address br.open ("https://datacoup.com/signin")# get login form form = br.get_form () # fill in the mailbox and password in the form form ['email'] =" FILL_USERNAME_IN "form [' password'] =" FILL_PASSWORD_IN "# submit form br.submit_form (form) # return the page result after getting login Information src = str (br.parsed ()) # match start and end position htmlstart = 'Earned:' end =''# return result result = re.search ('% s (. *)% s'% (start) using regular matching End), src) .group (1)

Print (result)

In the second example, visit a music website to simulate and query song information:

Import refrom robobrowser import RoboBrowser# browse the Rap Genius website browser = RoboBrowser (history=True) browser.open ('http://rapgenius.com/')# get form form = browser.get_form (action='/search') print (form) # # enter the query keyword queen submission form form [' q']. Value = 'queen'browser.submit_form (form) # query the first song songs = browser.select (' .song _ name') # visit the song connection address browser.follow_link (songs [0]) # find the text message of the style lyrics lyrics = browser.select ('.lyrics') print (lyrics [0] .text) #\ n [Intro]\ nIs this the real life...

# return the query results page browser.back () # query my favorite song browser.follow_link ('death on two legs')

# you can also use regular to find lyrics = browser.find (class_=re.compile (r'\ blyrics\ b')) lyrics.text. This is how to log in and grab data using RoboBrowser. If you happen to have similar doubts, please refer to the above analysis for understanding. If you want to know more about it, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.