Shulou(Shulou.com)06/02 Report--

Today, I will talk to you about the steps of crawling App, which may not be well understood by many people. in order to make you understand better, the editor has summarized the following contents for you. I hope you can get something according to this article.

Nowadays, smart phones have been widely used in society, and along with them, application software (APP) has replaced the web and become the mainstream technology. As the content of APP can not be crawled by search engines for a time, mobile Internet will bring a survival crisis of search engines. However, the crisis has been resolved to some extent by working with application developers. Now, the editor has sorted out a comprehensive strategy for capturing App, hand-in-hand guidance on how to operate step by step.

1. APP data collection generally takes the following two ways:

1. Grab the bag

It is easy for students who have code experience or APP development to understand, in fact, many APP take the way of webservice communication protocol, and because it is public data, and most of them are unencrypted. So as long as the network port is monitored and the APP is simulated, we can know how the data in the APP is obtained. We just need to write code to simulate its request, whether POST or GET, to get the information returned by the request. Then through the analysis of the structure of the returned information, we can get the data we want.

2. HOOK technology

HOOK technology is a technology that follows the operating system kernel. Because Android is open source, you can modify the kernel with some frameworks to achieve the functions you want. In the form of HOOK, we take the Xposed framework. Xposed is an open source framework service that can change the operation of programs without modifying any applications developed by other developers (including system services). Based on it, many powerful modules can be made to achieve the purpose that the application runs according to your wishes. If you think of an Android phone as a castle, Xposed can give you a God's perspective, get a panoramic view of the details of how the city works, and give you a hand in changing the way the castle works. What do you mean? To put it simply, you can control your APP automatically through it. If we open our APP on the simulator, we can encode it and tell APP what to do and what to do next. You can just think of it as something like a button wizard or a game play weird plug-in. And every step he takes, the data that APP interacts with the server can be obtained. This approach is widely used in some mature APP.

Second, simulated click

Fundamentals (based on UIautomator)

Through the program to simulate human behavior to click, slide and other operations on the interface of APP, at the same time, you can get the text information on most of the controls on the Activity page of APP (some may not be obtained, Uiautomator itself can not).

Third, bag grabbing tools

Mac system Wireshark

Mac system charles

Windows Fiddler

Usually use the packet grabbing tool to view the requested interfaces and parameters. You can simply use fidder, and you can set up a proxy on the mobile side.

If you want to grab udp packages like sound / video, you can use wireshark.

Charlse agent grab bag sharp tool

Jadx apk decompilation

Xpoxed hook Dafa tool

Static Analysis tool in ida inverse

After reading the above, do you have any further understanding of the steps of fetching App? If you want to know more knowledge or related content, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.