Shulou(Shulou.com)06/01 Report--

This article introduces the relevant knowledge of "Python crawler and data analysis project". In the actual case operation process, many people will encounter such difficulties. Next, let Xiaobian lead you to learn how to deal with these situations! I hope you can read carefully and learn something!

project introduction

LiveStreaming:

Content: Climbing 1.075 million live broadcast data of watermelon live broadcast (APP owned by Today's Headline) of various types of games, and analyzing whether the live broadcast platform and game anchor industry are really as profitable as we imagined

Corresponding to Weixin Official Accounts article: "Is the live game industry really as profitable as you think?"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★☆

LaborDay:

Content: According to each city in the country, grab the ticket sales data of scenic spots in the "scenic spot ticket" column of Flying Pig, and analyze which scenic spots will be crowded on May 1 and which scenic spots are worth visiting.

Corresponding to Weixin Official Accounts article: "May Day does not look at everyone, everyone, where to play appropriate?"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ★ ★ ★

KrisWu:

Content: Randomly grab 100,000 micro blog forwarding data of Wu Yifan's "Big Bowl Wide Face" micro blog, and analyze the true and false forwarding ratio of this micro blog, as well as how everyone's emotional tendency towards this song is.

Corresponding to Weixin Official Accounts: "Big bowl wide noodles VS lawyer letter warning, emotional analysis Wu Yifan self-black circle powder!"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

ESL:

Content: Climb 945 foreign English teacher recruitment data on JobLEADChina, 5780 English teacher recruitment data on Wanxing Teacher Talent Network, and 498 WeChat group member information to analyze the recruitment status of foreign teachers

Corresponding to Weixin Official Accounts article: "Why can foreign teachers without experience and education get a high salary of 1.4W+?"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★ ★ ★ ★ ★ ★

ICU996:

Content: Crawl programmers collectively resist 996 Github popular project 996.ICU, Issues page discussion data and click star programmers Github personal information data, and analyze this group of resist 996 programmers who are holy

Corresponding to Weixin Official Accounts article: "Bold, which programmers are against 996?!"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ★ ★ ★

Paediatrician:

Content: Climb 10950 recruitment data covering pediatrics, internal medicine, surgery, obstetrics and gynecology, ophthalmology, and analyze the survival situation of pediatricians

Corresponding to Weixin Official Accounts article: "Pediatrician's tears, all seen by data"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

CaiXuKun:

Content: Randomly grab 100,000 forwarding data of Cai Xukun's 1 million + forwarded micro blog "Goodbye," wayward "thousand...", and analyze the proportion of Cai Xukun's true and false forwarding traffic and the user portraits of true and false fans.

Corresponding Weixin Official Accounts Article: "Use Big Data to Steal Cai Xukun's True and False Flow Powder"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

BSGS_Rent:

Content: Climb the information of chain home rental housing in the four cities of Beijing, Guangzhou and Shenzhen, and analyze the current situation and consideration factors of rental housing in the four cities

Corresponding to Weixin Official Accounts Article: "North, Guangzhou and Shenzhen Rental Drawing Guide"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

Fireworks_and_Pm2.5:

Content: Climb the air quality index data of 367 cities in China, and analyze the impact of fireworks on air quality, and whether the ban on fireworks in cities is effective.

Corresponding to Weixin Official Accounts article: "Comprehensive analysis of 60,000 pieces of data, is it really useful to ban fireworks and firecrackers during the Spring Festival in cities?"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★★ ★ ★ ☆

TheWanderingEarth:

Content: Crawl the cat's eye reviews and ratings of the movie Wandering Earth, and analyze the reasons for the low scores of the movie

Corresponding to Weixin Official Accounts article: "One hundred thousand comments tell you what mentality is given 1 star to Wandering Earth?"

Suitable for: Python crawler learners, Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

Weibo_Comment_Pics:

Content: Simulate landing on Weibo mobile phone to crawl massive emoticons

Corresponding to Weixin Official Accounts article: "New Year's emoji package partial rich guide, dish it!"

Suitable for people: Python crawler learners

Difficulty: ★★ ★ ★ ☆

English_names:

Content: Analyze US baby naming data and provide some suggestions for English names

Corresponding to Weixin Official Accounts article: "After reading this analysis, Tony and Kevin downstairs have changed their names!"

Suitable for: Python data analysis learners, Pandas users, data visualization learners

Difficulty: ★★ ★ ★ ☆

shixiseng_packet_capture

Content: mainly through mobile phone capture packet analysis and access to the "apprentice monk" website iso data interface, with the interface you can directly write code to crawl data

Corresponding Weixin Official Accounts Article: "Reply to" Apprentice Monk "CTO's Change Posture Climb Apprentice Monk Website"

Suitable for people: Python crawler learners, mobile phone bag grabbing learners

Difficulty: ★ ★ ★ ★ ★ ★

PUBG-juediqiusheng-data_analysis

Content: The main analysis of PUBG 720,000 game data, and combined with the data to give a chicken strategy, with the data to eat chicken!

Corresponding to Weixin Official Accounts article: "[20G] Kaggle dataset strong analysis" Jedi survival,"strategy eat chicken!"

Suitable for: Python data analysis learners, Pandas users, chicken eaters

Difficulty: ★★ ★ ★ ☆

Wechat_article_collector：

Content: Weixin Official Accounts article collector, used to collect articles on Weixin Official Accounts and save them to word documents

Corresponding to Weixin Official Accounts: "50 lines of code teach you to build a public account article collector"

Suitable for people: Python learners, new media operators?

Difficulty: ★★ ★ ★ ★ ★ ★

Note: This project is temporarily unavailable due to poor maintenance of dependency package Wechat Sogou.（2019-04-02 updated）

mongoTV：

Content: Crawl Mango TV's "I am a big detective" program comment data, and conduct emotional analysis

Corresponding to Weixin Official Accounts article: "I am a Great Detective" What happened? What happened to "I am a great detective"? (Below: Emotional Analysis)

Suitable for: Python scrapy crawler learners, Python data analysis learners, Pandas users

Difficulty: ★★ ★ ★ ☆

shixiseng:

Content: Climb the data of "data mining" and other related positions in the website of the trainee monk, and analyze the data

Corresponding Weixin Official Accounts Article: "A Small Help| Cracking the font encryption of the website "Practice Monk" and "Small Busy" serial articles| Data Analysis of Internship Monk Website

Suitable for: Python crawler learners, Python data analysis learners, Pandas users

Difficulty: ★★ ★ ★ ☆

"Python crawler and data analysis project what" content is introduced here, thank you for reading. If you want to know more about industry-related knowledge, you can pay attention to the website. Xiaobian will output more high-quality practical articles for everyone!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.