Shulou(Shulou.com)05/31 Report--

How to compare App cloud testing services? in view of this problem, this article introduces the corresponding analysis and solutions in detail, hoping to help more partners who want to solve this problem to find a more simple and feasible method.

Foreword:

We all know that the most time-consuming way to test a mobile app is on a variety of test devices, because both Android and iOS are fragmented. Cloud testing seems to be an effective way to solve this problem. Therefore, which kind of cloud test platform to assist testers to carry out various tests has become the primary issue.

The following are the main cloud testing platforms I have investigated: AWS Device Farm, Baidu MTC, Tencent Youtest, Aliyun Test, Testin Cloud Test

The steps of each cloud test platform are listed below, and the report is for reference only.

1. AWS Device Farm

AWS Device Farm is an application testing service that allows you to immediately test and interact with Android, iOS, and Web applications on many devices, or reproduce problems on devices in real time. View videos, screenshots, logs, and performance data to identify and resolve problems before launching the application.

1. Sign up for your AWS account and log in

2. Start to create your own test project

3. Click create project, enter project name, click the create project button, create the project successfully, and jump to the project page.

4. Project pages are divided into two functions:

* Automated tests (automated testing)

* Remote access (remote access)

5. First introduce Automated tests, then click create a new run to create the first test task

The first step: choose application, divided into two categories: app, web application

Step 2: confiure test. If app is selected in the previous step, eight frameworks are supported in this step, as shown below:

If you select web application in the previous step, this step supports three frameworks. As shown below:

Step 3: select devices. You can choose top devices, or click create a new device pool to select the devices you want.

This page is Create a new device pool, enter name,description, and select the required devices.

Step 4: Specify device state. Provide additional data and / or install additional applications for use by AWS Device Farm during operation, specify whether Wi-Fi, Bluetooth, GPS or NFC will be enabled during operation, preset the latitude and longitude of the device, and preset the device locale for operation.

Step 5: Review and start run. Test task overview, you can modify the previously set information. Click start run and the task begins to execute automatically. After execution, click to enter the task details and view the test report

6. Let's start to introduce Remote access (remote access)

Step 1: click the start a new session button to go to the Create a new remote access session page and select the model you want.

Step 2: Create a new remote access session page, you can search the device you need according to name, platform, os, form, factor

Step 3: Remote access report: you can download and view Automation Output, Application Output, XCTest UI Log and VideoSyslog during the operation.

7. The test report contains both detailed data for each device and brief results (such as the average CPU utilization or the number of specific errors). Log and session video are included in the remote access results

Baidu MTC- Mobile Cloud Test Center

Baidu MTC is the mobile cloud test center under Baidu's open platform. Provides more than 500 popular models, currently only supports Android system, does not support iOS system. The types of testing services provided are compatibility testing, performance testing and functional testing. And provides a script recording tool, similar to Testin. However, the script recording tool is updated slowly. Baidu MTC's service is currently for a fee.

1. Mobile app testing service includes: automated testing, manual testing, user acceptance evaluation, remote real machine debugging. Click to create a test task

2. Take the function playback test as an example: create a test task. The steps are uploading app, uploading use cases, selecting test terminals, screenshots, and emails.

3. The test report includes: application basic information, conclusion overview, problem distribution, problem list, problem terminal distribution, performance conclusion, performance analysis, memory footprint analysis, terminal list.

Click to enter the terminal detailed report, including terminal information, test results, performance results, test screenshots, installation log, logcat log, script log, performance details, screen video.

Third, Tencent excellent Test

Tencent Youtest is a cloud testing service platform under Tencent, with more than 1000 test terminals and a large number of models. In addition, Tencent Youtest also provides "cloud mobile phone" service, and developers can remotely control the test terminal to view the installation and running results of App in real time.

Take the extreme Speed 50 test report as an example:

4. Ali Yuntest-Mobile quality Center

Ali MQC is a mobile test platform owned by Alibaba. Provide hundreds of test terminals, support Android and iOS systems. Provide compatibility testing, functional testing, performance testing and stability testing (1 hour). The test script needs to be written using Robotium or Appium test framework, which is difficult. MQC also provides remote real machine debugging, which is similar to Tencent Youtest. It seems that Tencent and Ali really chaoxi each other.

1. Take in-depth performance testing as an example to create a test task. The first step is to upload the Android application, you can choose the performance test service item, content leakage, overflow, and jitter detection. Etc.

2. The second step of the compatibility test is to select the test terminal. You can choose from four categories: 30 selected models, TOP50, optional models, and private devices.

3. Test report preview, which is divided into four parts: test overview, terminal details, error log, performance report, all screenshots.

Testin Cloud Test | the world's leading test platform for App and mobile games

Testin is one of the earliest companies involved in the field of cloud testing in China. Testin has deployed more than 1000 test terminals in the cloud, with a comprehensive variety and number of terminals. Android and iOS systems are supported. However, at present, only a small number of services are free, and the vast majority of services are fee-based items, so the cost of using them is high. Please refer to the introduction of the official website for specific charges.

1. Take the compatibility test as an example to create a test task. The steps are very simple.

2. Test report: general situation, problem report, performance report, detail report

VI. Various cloud test platforms

1. Real phone rental: Testin Cloud Test and AWS Device Farm, both include iOS and Android. All models are recommended.

2. AWS Device Farm supports frames Appium Java JUnit, Appium Java TestNG, Appium Python, Calabash, Instrumentation, UI Automation and XCTest, and terminals support Android and iOS,web. Priority is recommended.

AWS Device Farm supports the selection of network scenarios, but not others. But its performance index is relatively few, only three items, CPU,Memroy,Threads

3. Baidu MTC supports Appium, Robotium and Uiautomator frameworks, but when creating a test task, it is too simple and the specific test content is not clear.

There is no bright spot in the in-depth performance test, and there is no obvious advantage over the performance data in the compatibility test.

4. Ali MQC supports online recording scripts, and self-written scripts support Appium and Robotium frameworks.

Test service types are clearly distributed, divided by test system, and support Android,iOS,yunos. When you create a test task, the test step type is clearly stated.

5. Tencent Pretest-Xtest tool, which supports recording scripts. The report of the in-depth testing service is very comprehensive, but the price is a little more expensive.

6. Testin is one of the earliest companies involved in the field of cloud testing in China. Testin has deployed more than 1000 test terminals in the cloud, with a comprehensive variety and number of terminals. Support Android and iOS systems, simple steps, easy to operate. ITestin recording scripts are supported, and performance tests are included in compatibility tests

This is the end of the answer to the question on how to compare App cloud testing services. I hope the above content can be of some help to you. If you still have a lot of questions to solve, you can follow the industry information channel for more related knowledge.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.