Shulou(Shulou.com)06/03 Report--

Original articles, welcome to reprint. Reprint please indicate: reproduced from IT Story Association, thank you!

Original link address: "docker practical stories" python's docker- Douyin Analysis Interface data Analysis (21)

Xposed has been installed in the previous section, set the corresponding android version and proxy server.

Preparatory work

Installation of 1.xposed and JustTruestMe

two。 Douyin installation completed

Start fildder

Click to enter the specified fan interface

View data

Get the request connection

Https://api.amemv.com/aweme/v1/user/follower/list/?user_id=108719454702&max_time=1549012794&count=20&retry_type=no_retry&iid=62172089966&device_id=66011631779&ac=wifi&channel=aweGW&aid=1128&app_name=aweme&version_code=251&version_name=2.5.1&device_platform=android&ssmix=a&device_type=MI+6+&device_brand=Xiaomi&language=zh&os_api=19&os_version=4.4.2&uuid=863254011212197&openudid=1d4bed921e800405&manifest_version_code=251&resolution=1080*1920&dpi=320&update_version_code=2512&_rticket=1549012860987&ts=1549012860&as=a165c0050cb76ccf644355&cp=017bcd54cc4b54f4e1gkoo&mas=01cb98bea6c9a2c3a8d5faf856a795b13dacaccc2c2c6c66c6c66c

GET https://api.amemv.com/aweme/v1/user/follower/list/?user_id=108719454702&max_time=1549012794&count=20&retry_type=no_retry&iid=62172089966&device_id=66011631779&ac=wifi&channel=aweGW&aid=1128&app_name=aweme&version_code=251&version_name=2.5.1&device_platform=android&ssmix=a&device_type=MI+6+&device_brand=Xiaomi&language=zh&os_api=19&os_version=4.4.2&uuid=863254011212197&openudid=1d4bed921e800405&manifest_version_code=251&resolution=1080*1920&dpi=320&update_version_code=2512&_rticket=1549012860987&ts=1549012860 & as=a165c0050cb76ccf644355&cp=017bcd54cc4b54f4e1gkoo&mas=01cb98bea6c9a2c3a8d5faf856a795b13dacaccc2c2c6c66c6c66c HTTP/1.1Accept-Encoding: gzipCache-Control: max-stale=0Host: api.amemv.comConnection: Keep-AliveCookie: install_id=62172089966 Ttreq=1 $c26b0505a13059d50206f39916d5eaee910a25e9; qh [360] = 1; odin_tt=e7eabe3bd71cee75718b6ab8dea9e67e78b97933017ff975f92ca1198179dfea0553012386575dce721502cc0d378c0c65a733783a7888440928643796139b6cUser-Agent: okhttp/3.10.0.1

It is not available in the browser at all, try to enter the URL in the browser and view the data.

I said earlier that a tool called mitmdump mode can be added to python scripts.

If you are using pycharm, I recommend using the command

Pip install mitmproxy

Mitmdump-s file name. py-p port number

You can print out a list of background python background output.

Import jsontry: from douyin.handle_mongo import save_taskexcept: from handle_mongo import save_taskdef response (flow): # get the followers for user in json.loads (flow.response.text) in the analysis acquisition node of the request interface if 'aweme/v1/user/follower/list' in flow.request.url: # data through fildder [' followers']: douyin_info = {} # shared id douyin_info ['share_id'] = user [' uid'] douyin_info ['douyin_id'] = user [' short_id'] douyin_info ['nickname'] = user [' nickname'] print (douyin_info) save_task (douyin_info)

PS: find the directory of the project and execute the mitmdump-s python file-p to specify the port. Then the data spit out by the corresponding agent can be obtained. The process fildder is to obtain the url address, and the mitmdump goes out and the data spit out by the response. It is then processed and stored in mongodb. The technical goal is not to need human participation! After slowly getting the data, the next step is to use appium to simulate the machine to click and slide!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.