Shulou(Shulou.com)06/02 Report--

Overview

With the development of Wechat ecosystem in recent years, Mini Game and Mini Program have become popular, along with the strict requirements for the user experience of Mini Game / Mini Program. Wechat team also recommended PerfDog to test the performance of Mini Game / Mini Program on its Wechat platform.

1. Evaluation index

From the point of view of the running cycle of small games, developers must mainly focus on the performance problems caused by the startup and running phases.

Startup phase: startup time, this data will significantly affect the user's open retention rate.

Running phase: peak memory, crash rate, CPU usage, fluency, network, etc.

Compatibility issues: including JS exception, black screen and other serious problems

Performance Evaluation Standard of Android existing Network

Performance Evaluation Standard of Android existing Network

two。 Evaluation tool

1.PerfDog:

You can use PerfDog to complete performance data acquisition

Performance: complete the game main flow 5~10min, PerfDog record performance data and upload, take the average, each model test 3 groups of data to take the average, the memory peak value takes the maximum value.

Startup performance: it is obtained by screenshot and framing method, and the average value of 10 tests is taken.

two。 Mini Game data Assistant

You can also use "data-performance Analysis" in Mini Game data Assistant application to obtain the performance collection data of current network players.

Mini Game data Assistant: https://developers.weixin.qq.com/minigame/analysis/assistant.html

3.PerfDog testing process

1. Run performance data acquisition:

First of all, we use the same mobile phone to test the mainstream game 5~10min of Mini Game three times, taking the average, Wechat is multi-threaded to test more accurately, we can use PerfDog to test the thread of Mini Game.

Note: try your best to ensure the consistency of the test cases in each test, and remember to distinguish whether the game limits the frame rate. I am using Mini Game with a frame limit of 30.

We can use the comparison function to view the detailed data.

An overview comparison allows you to quickly view the data for each set of test cases.

Based on the above data, we calculate the average value of each item of the three groups of test cases as follows.

FPS mean CPU occupancy mean memory peak mean 23.6325.2387.2

Apart from the fact that FPS is a little unstable here, the other performance data is good.

two。 Start-up time

Time-consuming Wechat startup is recommended to use "use screenshot framing method to take the average of 10 tests". Similarly, we can turn on the screenshot function of PerfDog to easily obtain time-consuming.

I started Mini Game at 00:06, and since there is still a part of the progress bar that has not been loaded at 00:10, the loading completion is calculated at 00:11. This startup takes time: 11-6 minutes 5 (S) = 5000 (milliseconds), it should be noted that the cold start takes time! That is, it takes time to kill the process completely in the background and start it again.

This is the time-consuming of my second test.

Since it is 00:10 if it is not finished at 00: 09:00, the second time is 10-5 seconds = 5000 milliseconds. We need to test 10 times and then calculate the average. Here one by one screenshots will not be released, the final calculated mean and then go to the table above to find their own standards to determine the performance of Mini Game.

4. Supplement

The testing procedures for Mini Program and Mini Game are the same. PerfDog can also test the performance of IOS, the operation process is equally simple, interested can test your own yo!

Around the core is:

Performance: complete the game main flow 5~10min, PerfDog record performance data and upload, take the average, each model test 3 groups of data to take the average, the memory peak value takes the maximum value.

Startup performance: it is obtained by screenshot and framing method, and the average value of 10 tests is taken.

Attached is the standard of IOS:

IOS development phase performance evaluation standards:

IOS current network performance evaluation standard:

Attached is the official document of Mini Game:

Mini Game performance Optimization: https://developers.weixin.qq.com/minigame/dev/guide/performance/perf-overview.html

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.