Shulou(Shulou.com)06/02 Report--

With the expansion of software scale and the dual business acceleration requirements of rapid software iteration, the pressure of software quality control is becoming more and more obvious. However, the powerlessness of black box testing and the high complexity of white box testing make software test engineers and managers very depressed, and diversified automated testing tools cannot solve fundamental problems.

At present, the precision testing technology that is popular in the industry, from the feedback of enterprise-level applications, its three most important technical characteristics, so that enterprises in software quality improvement, breakthrough the original ceiling.

1. Two-way traceability technology of test cases and code: visualize the development and testing process, achieve the data communication between software and team management, no longer flow to form and oral communication; the transparent operation mode of gray box does not change the traditional enterprise process, but can map the functional test data to the code level for accurate analysis.

2. Application value of extended test data: precision testing will generate a large amount of data during operation, based on which the value of the testing process can be extended to the entire R & D system, such as intelligent defect positioning directly through in-depth test data, code consistency modification through reverse traceability to help development analysis, etc.

3. Fully support Agile through intelligent algorithms: Fully automatic intelligent regression case selection, case clustering analysis, test vulnerability analysis, cumulative coverage and other technologies fully support quality assurance in agile scenarios.

This paper will focus on the analysis of precision testing in the R & D system after the application of overall operational efficiency and quality improvement analysis. In addition, the target product corresponding to the analysis data in this article is the ThreadingTest product of Nebula Test, which is also the precision test product with the most comprehensive precision function and the highest degree of commercialization at present (readers can read the white paper of precision test framework in advance and experience the precision test product to familiarize themselves with the overall function of precision test).

Accurate testing runs efficiently. The technical route adopted by it is a system-level gray box technology category, so the operation process of precision testing is still a black box, and it does not directly change the operation method of the use case and the composition of the team members. Its data acquisition is based on software test oscilloscope automatic acquisition, used to mark the mapping relationship between the acquired data and the use case, the original test operation efficiency interference is very small, the actual operation analysis additional workload is less than 2%. The insertion process necessary for accurate testing requires no manual intervention and the implementation cost is one-time.

Below is a graph of the operational efficiency of precision testing:

The traditional black box test method generally begins to produce a large bottleneck after the coverage rate enters the range of 40-50, which is called pesticide effect in the test profession. And the bottleneck point of the black box is precisely the power point of accurate testing. Precision testing can be correlated to code to see coverage of blocks, branches, conditions, etc., and can also identify missing points based on the various color analysis views provided by precision testing. Therefore, no matter how complex the system under test is, the operational efficiency of precision testing increases steadily at a linear 45-degree angle.

As can be seen from the above figure, at a medium coverage level beyond the bottleneck, precision testing takes only half the time and therefore costs half the cost of conventional black box testing. For enterprises, this not only greatly improves the work efficiency of testing, speeds up product release time, but also saves a lot of labor cost investment.

The core technical point of precision testing is the traceability of test cases and code. This technology is simply that when the function is executed, the corresponding overall code execution will be generated immediately, which can be understood as a powerful panoramic debugger, that is, when clicking on a test case, it will immediately trace the corresponding code and module. If you have a big enough screen, imagine how shocking the scene is…

Precision testing vulnerability analysis for agile testing. It can automatically analyze the highest risk position of software defects based on static data and dynamic running data of the program, guide the completion of coverage for high-risk modules first, and complete the coverage test of the most risky modules in a limited time. Based on intelligent defect location technology, accurate test results can directly locate defects, so accurate testing allows developers to locate defects at least 2-3 times more efficiently.

The most headache regression test maintenance, precision testing also gave a good solution. According to international authoritative statistics, on average, every 6 lines of code modification introduces an unknown defect that is difficult to predict directly. Another way to look at it is that regression testing increases the proportion of unpredictable defects as the project personnel blur their memory and the team adjusts. Because of the built-in algorithm, all kinds of information are stored in the computer completely. We actually compared the tests of 5 systems with about 1000 case sets, and the calculation case set can be controlled at about 20%. In addition, from the perspective of risk of regression test, traditional empirical judgment method, due to the change of personnel and fuzzy memory after the cycle is lengthened. The probability of discovering unknown associations caused by iteration is getting lower and lower, and risks are introduced after going online. With precision testing, as more and more data is recorded in each round of testing, the basic code covers a wider range of radiation, and its calculation accuracy continues to rise. After a certain number of version iterations, the probability of finding associated defects can reach more than 80%.

Accurate test case cluster analysis function, can effectively find "test errors." For example, a use case execution step error, its clustering results will inevitably change, managers through the results of systematic analysis can find and correct this kind of error, and before may need to be confirmed repeatedly in the field. From a management perspective, an average of 4-5 test executors in traditional architectures requires a manager, which is extremely expensive. Under the precise testing system, since the process management is automatically recorded by the computer, the manager can clearly understand the progress of the project and the work efficiency of each project participant by looking at the report. Through daily, weekly, monthly reports, etc., you can easily understand the status of each project. No matter how the follow-up team changes, it can clearly understand the overall framework structure and detailed traceability relationship through the platform under the authorized condition, so as to achieve the purpose of rapid takeover and greatly save development and maintenance costs.

According to the above analysis, accurate testing is suitable for mature systems of R & D and testing, characterized by low introduction cost, significant improvement of R & D and testing efficiency of enterprises, and excellent software risk control results. As the web says, precision testing is fast becoming mainstream technology.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.