A method and device for automated testing

Abstract

The present invention discloses a method and device for automated testing, and specifically relates to the field of computer testing technology, including automated test case numbering, automated test case monitoring, automated test case efficiency management, automated test case efficiency optimization, automated test case data security control, automated test feedback, and automated test evaluation. The present invention collects test execution capture data of each test case monitoring sub-area of ​​automated testing through a checkpoint, calculates an automated test efficiency evaluation index and an automated test data security monitoring index, and further obtains an automated test efficiency optimization index and an automated test performance comprehensive evaluation coefficient of each test case monitoring sub-area corresponding to an abnormality. Through in-depth analysis of various indicators, the intelligence level is improved, the security monitoring of test data is enhanced, and the efficiency performance of each monitoring sub-area is helpful to optimize the allocation of computing resources and improve the overall test efficiency.

Description

Technical Field

[0001] The present invention relates to the field of computer testing technology, and more specifically, to an automated testing method and device. Background Art

[0002] Automated testing is a testing task that can be automatically completed by a computer system. It automatically tests the software by executing scripts and automatically implements the software's unit testing, functional testing, load testing, and performance testing, thereby ensuring the stability and reliability of the software product.

[0003] In the current era of rapid development of information technology, automated testing is particularly important. It can improve the efficiency of software development, reduce human errors, and ensure product quality. Especially in the software development process, automated testing has become a key link in ensuring product quality and has realized the automation and efficiency of the testing process.

[0004] However, there are still some shortcomings in its actual use. For example, with the continuous expansion of software scale and increasing complexity, traditional manual testing is not only time-consuming and labor-intensive, but also easily affected by human factors, which directly affects the implementation speed and efficiency of automated testing.

[0005] In the existing automated testing process, when executing test cases, there is insufficient in-depth analysis of data security issues and a lack of comprehensive assessment and in-depth exploration of potential risks, which increases the risk of data security threats in automated operations. Summary of the invention

[0006] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a method and apparatus for automated testing, which are used to solve the problems raised in the above-mentioned background technology.

[0007] To achieve the above object, the present invention provides the following technical solution: a method for automated testing, comprising:

[0008] Step S01: Automated test case numbering: used to match automated test scripts according to automated test objectives, execute automated test scripts and set checkpoints, create test cases according to the automated tests covered by each checkpoint, and number them.

[0009] Step S02: Automated test case monitoring: used to collect test execution capture data of each test case monitoring sub-area of ​​the automated test through checkpoints, and the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit.

[0010] Step S03: Automated test case efficiency management: The automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test is calculated by the automated test case efficiency monitoring unit, and the monitoring sub-areas with abnormal automated test efficiency are screened out.

[0011] Step S04: Optimization of automated test case efficiency: used to receive each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculate the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test.

[0012] Step S05: Automated test case data security control: The automated test case data security monitoring unit calculates the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test.

[0013] Step S06: Automated test feedback: used to monitor the automated test efficiency evaluation index and automated test data security monitoring index of the sub-area according to each test case of the automated test, and analyze to obtain the automated test performance comprehensive evaluation coefficient.

[0014] Step S07: Automated test evaluation: used to obtain an automated test performance comprehensive evaluation coefficient, compare it with a preset automated test performance comprehensive evaluation coefficient, and process it.

[0015] Preferably, the automated test case number is specifically:

[0016] Match the automated test script according to the target analysis results of the automated test, use the automated test tool to execute the test script, and set checkpoints. Establish each test case monitoring sub-area according to the automated tests covered by each checkpoint, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2, ..., i, ..., n.

[0017] Preferably, the automated test case monitoring is specifically as follows: an automated test case efficiency monitoring unit: collects the test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​the automated test through a checkpoint, and marks them as , , , where i=1,2,...n, i represents the number of the i-th test case monitoring sub-area; Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

[0018] Preferably, the automated test case efficiency management is specifically as follows:

[0019] Step S001: The calculation formula of the automated test efficiency evaluation index is: in It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It represents the actual running time of the single test execution data volume of the i-th test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time. Step S002: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area. Preferably, the automated test case efficiency optimization is specifically as follows:

[0020] Step S001: Calculate the data throughput slope monitoring index: in It is represented as the data throughput slope monitoring indicator of the monitoring sub-area of ​​the i-th test case, It is represented as the test execution data volume of the i-1th test case monitoring sub-area, It is represented as the test response time of the i-1th test case monitoring sub-area, and n is represented as the number of test case monitoring sub-areas;

[0021] Step S002: Collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: in It is represented as the data test load monitoring indicator of the i-th test case monitoring sub-area, It represents the test prediction time of executing the test script of the i-th test case monitoring sub-area, represents the test waiting time of executing the test script for the monitoring sub-area of ​​the i-th test case;

[0022] Step S003: The calculation formula of the automated test efficiency optimization index is: in It is represented as the optimization index of automated testing efficiency of the i-th test case monitoring sub-area;

[0023] Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

[0024] Preferably, the automated test case data security control is specifically as follows:

[0025] Step S001: Calculate the effective defect detection rate: in It is expressed as the effective defect detection rate of the monitoring sub-area of ​​the i-th test case, It is represented as the number of defects in the monitoring sub-area of ​​the i-th test case, It is represented as the number of effective defects in the monitoring sub-area of ​​the i-th test case.

[0026] Step S002: The calculation formula of the automated test data security monitoring index is: in It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area, It is represented as the code coverage of the monitoring sub-area of ​​the i-th test case, It represents the number of test execution rounds for the i-th test case monitoring sub-area, It is represented as the predicted number of test execution rounds of the execution test script of the i-th test case monitoring sub-area, and e is represented as a natural constant.

[0027] Preferably, the calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area.

[0028] Preferably, the automated test evaluation is specifically:

[0029] Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards.

[0030] Preferably, an automated testing device comprises a memory, a processor, and a machine executable program stored in the memory and running on the processor.

[0031] Technical effects and advantages of the present invention:

[0032] The present invention provides a method and device for automated testing, which collects test execution capture data of each test case monitoring sub-area of ​​automated testing through a checkpoint, calculates an automated test efficiency evaluation index of each test case monitoring sub-area of ​​automated testing according to an automated test case efficiency monitoring unit, calculates an automated test data security monitoring index of each test case monitoring sub-area of ​​automated testing according to an automated test case data security monitoring unit, further analyzes to obtain an automated test performance comprehensive evaluation coefficient, and compares it with a preset automated test performance comprehensive evaluation coefficient. If the obtained automated test performance comprehensive evaluation coefficient is less than the preset automated test performance comprehensive evaluation coefficient, it indicates that the automated test result feedback does not meet expectations, and the management personnel should be notified to check the existing test cases. Otherwise, it indicates that the automated test result meets the expected standard. Through in-depth analysis and optimization of various technical indicators, the intelligent level of test cases is improved. Through the setting of the automated test case data security monitoring unit, the data security monitoring of test data in the automated test process is enhanced. A comprehensive and efficient automated testing method is provided. Through the refined management of the test process, the repetitive work of testers is greatly reduced and the test coverage rate is improved.

[0033] The present invention provides a method and device for automated testing, which utilizes an automated test case efficiency optimization step, based on each test case monitoring sub-area with abnormal automated test efficiency during the automated testing process, obtains a data throughput slope monitoring indicator and a data test load monitoring indicator of each test case monitoring sub-area corresponding to the abnormality, calculates an automated test efficiency optimization index of each test case monitoring sub-area with the corresponding abnormal automated test, and based on the automated test efficiency optimization index of each test case monitoring sub-area with abnormal automated test efficiency during the automated testing process, notifies management personnel to maintain computing resource matching during the automated testing process, so that management personnel can understand the resource usage and efficiency performance of each monitoring sub-area, which is helpful to optimize the allocation of computing resources, thereby avoiding resource waste and improving overall testing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a schematic diagram of the connection of the method steps of the present invention.

[0035] Figure 2 It is a schematic diagram of the automated test case monitoring structure of the present invention. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] See also Figure 1 As shown, the present invention provides a method for automated testing, including automated test case numbering, automated test case monitoring, automated test case efficiency management, automated test case efficiency optimization, automated test case data security control, automated test feedback, and automated test evaluation.

[0038] The automated test case numbering is connected with automated test case monitoring, automated test case monitoring is connected with automated test case efficiency management, automated test case efficiency management is connected with automated test case efficiency optimization, automated test case efficiency optimization is connected with automated test case data security control, automated test case data security control is connected with automated test feedback, and automated test feedback is connected with automated test evaluation.

[0039] The step S01: automated test case numbering: is used to match automated test scripts according to the goals of automated tests, execute automated test scripts and set checkpoints, establish test cases according to the automated tests covered by each checkpoint, and number them.

[0040] In a possible design, the automated test case numbers are specifically:

[0041] Match the automated test script according to the target analysis results of the automated test, use the automated test tool to execute the test script, and set checkpoints. Establish each test case monitoring sub-area according to the automated tests covered by each checkpoint, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2, ..., i, ..., n.

[0042] Step S02: Please refer to Figure 2As shown, automated test case monitoring: is used to collect test execution capture data of each test case monitoring sub-area of ​​automated testing through checkpoints, and the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit.

[0043] In a possible design, the automated test case monitoring is specifically as follows:

[0044] Automated test case efficiency monitoring unit: collects test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​automated testing through checkpoints, and marks them as , , , where i=1,2,...n, i represents the number of the monitoring sub-area of ​​the i-th test case;

[0045] Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

[0046] The step S03: automated test case efficiency management: is used to receive the test execution capture data transmitted by the automated test case monitoring step, calculate the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, and screen out the monitoring sub-areas with abnormal automated test efficiency.

[0047] In a possible design, the automated test case efficiency management is specifically as follows:

[0048] Step S001: The calculation formula of the automated test efficiency evaluation index is: in It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It represents the actual running time of the single test execution data volume of the i-th test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time;

[0049] Step S002: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area.

[0050] In this embodiment, it should be specifically noted that the automated test case efficiency management also includes:

[0051] Step S001: Calculate the expected running time of a single test data volume: in It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It is represented as the test response time of the monitoring sub-area of ​​the i-th test case, It is represented as the amount of test data in the monitoring sub-area of ​​the i-th test case;

[0052] Step S002: Calculate the actual running time of a single test execution data volume: in It represents the actual running time of the single test execution data volume of the i-th test case monitoring sub-area, It represents the test execution data volume of the monitoring sub-area of ​​the i-th test case;

[0053] Step S003: Calculate the mean of the test data volume: in It is represented as the mean value of the test data volume, and n is represented as the number of monitoring sub-areas of the test case;

[0054] Step S004: Similarly, the mean value of the test execution data volume and the mean value of the test response time are calculated.

[0055] The step S04: automated test case efficiency optimization: is used to receive each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculate the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and the data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test.

[0056] In a possible design, the automated test case efficiency optimization is specifically as follows:

[0057] Step S001: Calculate the data throughput slope monitoring index: in It is represented as the data throughput slope monitoring indicator of the monitoring sub-area of ​​the i-th test case, It is represented as the test execution data volume of the i-1th test case monitoring sub-area, It is represented as the test response time of the i-1th test case monitoring sub-area, and n is represented as the number of test case monitoring sub-areas;

[0058] Step S002: Collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: among them It is represented as the data test load monitoring indicator of the i-th test case monitoring sub-area, It represents the test prediction time of executing the test script of the i-th test case monitoring sub-area, represents the test waiting time of executing the test script for the monitoring sub-area of ​​the i-th test case;

[0059] Step S003: The calculation formula of the automated test efficiency optimization index is: in It is represented as the optimization index of automated testing efficiency of the i-th test case monitoring sub-area;

[0060] Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

[0061] The step S05: automated test case data security control: used to receive the test execution captured data transmitted by the automated test case monitoring step, and calculate the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit;

[0062] In a possible design, the automated test case data security control is specifically as follows:

[0063] Step S001: Calculate the effective defect detection rate: in It is expressed as the effective defect detection rate of the monitoring sub-area of ​​the i-th test case, It is represented as the number of defects in the monitoring sub-area of ​​the i-th test case, It is represented as the number of valid defects in the monitoring sub-area of ​​the i-th test case;

[0064] Step S002: The calculation formula of the automated test data security monitoring index is: in It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area, It is represented as the code coverage of the monitoring sub-area of ​​the i-th test case, It represents the number of test execution rounds for the i-th test case monitoring sub-area, It is represented as the predicted number of test execution rounds of the execution test script of the i-th test case monitoring sub-area, and e is represented as a natural constant.

[0065] The step S06: automated test feedback: is used to monitor the automated test efficiency evaluation index and the automated test data security monitoring index of the sub-area according to each test case of the automated test, and analyze to obtain the automated test performance comprehensive evaluation coefficient.

[0066] In a possible design, the calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area.

[0067] The step S07: automated test evaluation: is used to obtain an automated test performance comprehensive evaluation coefficient, compare it with a preset automated test performance comprehensive evaluation coefficient, and process it.

[0068] In a possible design, the automated test evaluation is specifically:

[0069] Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards.

[0070] In this embodiment, it should be specifically explained that the present invention collects test execution capture data of each test case monitoring sub-area of ​​the automated test through the checkpoint, calculates the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, calculates the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit, further analyzes to obtain the automated test performance comprehensive evaluation coefficient, and compares it with the preset automated test performance comprehensive evaluation coefficient. If the obtained automated test performance comprehensive evaluation coefficient is less than the preset automated test performance comprehensive evaluation coefficient, it indicates that the automated test result feedback does not meet expectations, and the management personnel should be notified to check the existing test cases. Otherwise, it indicates that the results of the automated test meet the expected standards. Through in-depth analysis and optimization of various technical indicators, the intelligence level of the test cases is improved. Through the setting of the automated test case data security monitoring unit, the data security monitoring of the test data in the automated testing process is enhanced, and a comprehensive and efficient automated testing method is provided. Through the refined management of the test process, the repetitive work of testers is greatly reduced and the test coverage is improved.

[0071] In the present embodiment, it should be specifically explained that the present invention utilizes an automated test case efficiency optimization step, based on each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, obtains a data throughput slope monitoring indicator and a data test load monitoring indicator for each test case monitoring sub-area corresponding to the abnormality, calculates an automated test efficiency optimization index for each test case monitoring sub-area with the corresponding abnormal automated test, and based on the automated test efficiency optimization index for each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, notifies management personnel to maintain computing resource matching during the automated test process. Management personnel can understand the resource usage and efficiency performance of each monitoring sub-area, which helps to optimize the allocation of computing resources, thereby avoiding resource waste and improving overall testing efficiency.

[0072] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for automated testing, characterized in that: include: Step S01: Automated test case numbering: used to match automated test scripts according to automated test objectives, execute automated test scripts and set checkpoints, create test cases according to the automated tests covered by each checkpoint, and number them; Step S02: Automated test case monitoring: used to collect test execution capture data of each test case monitoring sub-area of ​​the automated test through the checkpoint, wherein the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit; Step S03: Automated test case efficiency management: Calculate the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, and screen out the monitoring sub-areas with abnormal automated test efficiency; The automated test case efficiency management is specifically as follows: Step S31: The calculation formula of the automated test efficiency evaluation index is: in It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It represents the actual running time of the single test execution data volume of the i-th test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time; Step S32: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area. Step S04: Optimizing the efficiency of automated test cases: receiving each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculating the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and the data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test; Step S05: Automated test case data security control: Calculate the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit; The automated test case data security control is specifically as follows: Step S51: Calculate the effective defect detection rate: in It is expressed as the effective defect detection rate of the monitoring sub-area of ​​the i-th test case, It is represented as the number of defects in the monitoring sub-area of ​​the i-th test case, It is represented as the number of valid defects in the monitoring sub-area of ​​the i-th test case; Step S52: The calculation formula of the automated test data security monitoring index is: in It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area, It is represented as the code coverage of the monitoring sub-area of ​​the i-th test case, It represents the number of test execution rounds for the i-th test case monitoring sub-area, It is represented as the predicted number of test execution rounds of the execution test script of the i-th test case monitoring sub-area, and e is represented as a natural constant; Step S06: automated test feedback: used to monitor the automated test efficiency evaluation index and automated test data security monitoring index of the sub-area according to each test case of the automated test, and analyze and obtain the automated test performance comprehensive evaluation coefficient; Step S07: Automated test evaluation: used to obtain an automated test performance comprehensive evaluation coefficient, compare it with a preset automated test performance comprehensive evaluation coefficient, and process it.

2. The method of automated testing according to claim 1, characterized in that: The specific automated test case numbers are: Match the automated test script according to the target analysis results of the automated test, use the automated test tool to execute the test script, and set checkpoints. Establish each test case monitoring sub-area according to the automated tests covered by each checkpoint, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2, ..., i, ..., n.

3. The method of automated testing according to claim 1, characterized in that: The automated test case monitoring is specifically as follows: Automated test case efficiency monitoring unit: collects test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​automated testing through checkpoints, and marks them as , , , where i=1,2,...n, i represents the number of the monitoring sub-area of ​​the i-th test case; Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

4. The method of automated testing according to claim 1, characterized in that: The automation test case efficiency optimization is specifically as follows: Step S001: Calculate the data throughput slope monitoring index: in It is represented as the data throughput slope monitoring indicator of the monitoring sub-area of ​​the i-th test case, It is represented as the test execution data volume of the i-1th test case monitoring sub-area, It is represented as the test response time of the i-1th test case monitoring sub-area, and n is represented as the number of test case monitoring sub-areas; Step S002: Collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: in It is represented as the data test load monitoring indicator of the i-th test case monitoring sub-area, It represents the test prediction time of executing the test script of the i-th test case monitoring sub-area, represents the test waiting time of executing the test script for the monitoring sub-area of ​​the i-th test case; Step S003: The calculation formula of the automated test efficiency optimization index is: in It is represented as the optimization index of automated testing efficiency of the i-th test case monitoring sub-area; Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

5. The method of automated testing according to claim 1, characterized in that: The calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, It is represented as the automated test efficiency evaluation index of the i-th test case monitoring sub-area, It is expressed as the expected running time of a single test data volume of the i-th test case monitoring sub-area, It is represented as the automated test data security monitoring index of the i-th test case monitoring sub-area.

6. The method of automated testing according to claim 1, characterized in that: The automated test evaluation is specifically as follows: Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards.

7. An automated testing device, characterized in that: The invention comprises a memory, a processor and a machine executable program stored in the memory and running on the processor, and the processor implements an automated testing method according to any one of claims 1 to 6 when executing the machine executable program.

Images