Automatic testing method and device

Through automated test case numbering, monitoring and data security control, calculation efficiency and security index, and optimization of test processes, traditional automated test time-consuming and data security problems are solved, the test intelligence and coverage are improved, and efficient automated testing methods are realized .

CN119003378AActive Publication Date: 2024-11-22NANTONG YAKAI MASCH MFG CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411472529.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-22
Publication Date
2024-11-22
Estimated Expiration
2044-10-22

AI Technical Summary

Technical Problem

When existing automated tests expand the scale of software and increase complexity, traditional manual tests are time-consuming and labor-intensive, susceptible to human factors, and insufficient data security analysis, which increases data security threats and fails to effectively evaluate potential risks.

Method used

Provide an automated testing method, which can improve the level of test intelligence and data security control by automatically testing case numbering, monitoring, efficiency management and data security control, calculate efficiency and security index, analyze comprehensive performance evaluation coefficients, optimize the test process, and improve the level of test intelligence and data security.

Benefits of technology

Through in-depth analysis and optimization of technical indicators, the intelligence level of test cases has been improved, data security monitoring has been enhanced, duplicate labor has been reduced, test coverage and efficiency have been improved, and resource waste has been avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119003378A_ABST
    Figure CN119003378A_ABST
Patent Text Reader

Abstract

The invention discloses an automatic testing method and device, and particularly relates to the technical field of computer testing. Comprising the steps of automatic test case numbering, automatic test case monitoring, automatic test case efficiency management, automatic test case efficiency optimization, automatic test case data security control, automatic test feedback and automatic test evaluation. According to the method, the test execution capture data of each test case monitoring sub-region of the automatic test is collected through the check points, and the automatic test efficiency evaluation index and the automatic test data security monitoring index are calculated; further obtaining an automatic test efficiency optimization index and an automatic test performance comprehensive evaluation coefficient of each corresponding abnormal test case monitoring sub-region, through deep analysis of each index, improving the intelligent level, enhancing the safety monitoring of test data, and through the efficiency performance of each monitoring sub-region, improving the safety of the test data. And optimization of allocation of computing resources is facilitated, and the overall test efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer testing technology, and more specifically, to an automated testing method and device. Background Art

[0002] Automated testing is a testing task that can be automatically completed by a computer system. It automatically tests the software by executing scripts and automatically implements the software's unit testing, functional testing, load testing, and performance testing, thereby ensuring the stability and reliability of the software product.

[0003] In the current era of rapid development of information technology, automated testing is particularly important. It can improve the efficiency of software development, reduce human errors, and ensure product quality. Especially in the software development process, automated testing has become a key link in ensuring product quality and has realized the automation and efficiency of the testing process.

[0004] However, there are still some shortcomings in its actual use. For example, with the continuous expansion of software scale and increasing complexity, traditional manual testing is not only time-consuming and labor-intensive, but also easily affected by human factors, which directly affects the implementation speed and efficiency of automated testing. In the existing automated testing process, when executing test cases, there is insufficient in-depth analysis of data security issues and a lack of comprehensive assessment and in-depth exploration of potential risks, which increases the risk of data security threats in automated operations. Summary of the invention

[0005] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a method and apparatus for automated testing, which are used to solve the problems raised in the above-mentioned background technology.

[0006] To achieve the above object, the present invention provides the following technical solution: a method for automated testing, comprising: Step S01: Automated test case numbering: used to match automated test scripts according to automated test objectives, execute automated test scripts and set checkpoints, create test cases according to the automated tests covered by each checkpoint, and number them.

[0007] Step S02: Automated test case monitoring: used to collect test execution capture data of each test case monitoring sub-area of ​​the automated test through checkpoints, and the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit.

[0008] Step S03: Automated test case efficiency management: The automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test is calculated by the automated test case efficiency monitoring unit, and the monitoring sub-areas with abnormal automated test efficiency are screened out.

[0009] Step S04: Optimization of automated test case efficiency: used to receive each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculate the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test.

[0010] Step S05: Automated test case data security control: The automated test case data security monitoring unit calculates the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test.

[0011] Step S06: Automated test feedback: used to monitor the automated test efficiency evaluation index and automated test data security monitoring index of the sub-area according to each test case of the automated test, and analyze to obtain the automated test performance comprehensive evaluation coefficient.

[0012] Step S07: Automated test evaluation: used to obtain an automated test performance comprehensive evaluation coefficient, compare it with a preset automated test performance comprehensive evaluation coefficient, and process it.

[0013] Preferably, the automated test case number is specifically: According to the target analysis results of the automated test, match the automated test script, use the automated test tool to execute the test script, and set checkpoints. According to the automated tests covered by each checkpoint, establish each test case monitoring sub-area, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2,... ,... .

[0014] Preferably, the automated test case monitoring is specifically as follows: an automated test case efficiency monitoring unit: collects the test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​the automated test through a checkpoint, and marks them as , , ,in =1,2,... , Expressed as The number of the sub-area monitored by each test case; Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

[0015] Preferably, the automated test case efficiency management is specifically as follows: Step S001: The calculation formula of the automated test efficiency evaluation index is: in Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The actual running time of the single test execution data volume of each test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time; Step S002: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area.

[0016] Preferably, the automated test case efficiency optimization is specifically as follows: Step S001: Calculate the data throughput slope monitoring index: in Expressed as The data throughput slope monitoring indicator of the sub-area monitored by the test case, Expressed as The test execution data volume of each test case monitoring sub-area, Expressed as Each test case monitors the test response time of the sub-area. Represents the number of sub-areas monitored for a test case; Step S002: Collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: in Expressed as The data test load monitoring indicators of the test case monitoring sub-area, Expressed as The predicted test time of executing the test script of each test case monitoring sub-area, Expressed as Each test case monitors the test waiting time of executing the test script in the sub-area; Step S003: The calculation formula of the automated test efficiency optimization index is: in Expressed as The automated test efficiency optimization index of each test case monitoring sub-area; Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

[0017] Preferably, the automated test case data security control is specifically as follows: Step S001: Calculate the effective defect detection rate: in Expressed as The effective defect detection rate of each test case monitoring sub-area, Expressed as The number of defects in the sub-area monitored by each test case, Expressed as The number of effective defects in the test case monitoring sub-area; Step S002: The calculation formula of the automated test data security monitoring index is: in Expressed as The automated test data security monitoring index of each test case monitoring sub-area, Expressed as Test cases monitor the code coverage of sub-areas, Expressed as The number of test execution rounds per test case monitoring sub-area, Expressed as The predicted number of test execution rounds of the test script executed by each test case monitoring sub-area, Expressed as a natural constant.

[0018] Preferably, the calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The automated test data security monitoring index of each test case monitoring sub-area. Preferably, the automated test evaluation is specifically: Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards.

[0019] Preferably, an automated testing device comprises a memory, a processor, and a machine executable program stored in the memory and running on the processor.

[0020] The technical effects and advantages of the present invention are as follows: the present invention provides a method and device for automated testing, which collects test execution capture data of each test case monitoring sub-area of ​​automated testing through checkpoints, calculates the automated test efficiency evaluation index of each test case monitoring sub-area of ​​automated testing according to the automated test case efficiency monitoring unit, calculates the automated test data security monitoring index of each test case monitoring sub-area of ​​automated testing according to the automated test case data security monitoring unit, further analyzes to obtain the automated test performance comprehensive evaluation coefficient, and compares it with the preset automated test performance comprehensive evaluation coefficient. If the obtained automated test performance comprehensive evaluation coefficient is less than the preset automated test performance comprehensive evaluation coefficient, it indicates that the automated test result feedback does not meet expectations, and the management personnel should be notified to check the existing test cases. Otherwise, it indicates that the automated test result meets the expected standard. Through in-depth analysis and optimization of various technical indicators, the intelligent level of test cases is improved. Through the setting of the automated test case data security monitoring unit, the data security monitoring of test data in the automated testing process is enhanced. A comprehensive and efficient automated testing method is provided. Through the refined management of the test process, the repetitive work of testers is greatly reduced and the test coverage rate is improved. The present invention provides a method and device for automated testing, which utilizes an automated test case efficiency optimization step, based on each test case monitoring sub-area with abnormal automated test efficiency during the automated testing process, obtains a data throughput slope monitoring indicator and a data test load monitoring indicator of each test case monitoring sub-area corresponding to the abnormality, calculates an automated test efficiency optimization index of each test case monitoring sub-area with the corresponding abnormal automated test, and based on the automated test efficiency optimization index of each test case monitoring sub-area with abnormal automated test efficiency during the automated testing process, notifies management personnel to maintain computing resource matching during the automated testing process, so that management personnel can understand the resource usage and efficiency performance of each monitoring sub-area, which is helpful to optimize the allocation of computing resources, thereby avoiding resource waste and improving overall testing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of the connection of the method steps of the present invention.

[0022] Figure 2 It is a schematic diagram of the automated test case monitoring structure of the present invention. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] See also Figure 1 As shown, the present invention provides a method for automated testing, including automated test case numbering, automated test case monitoring, automated test case efficiency management, automated test case efficiency optimization, automated test case data security control, automated test feedback, and automated test evaluation.

[0025] The automated test case numbering is connected with automated test case monitoring, automated test case monitoring is connected with automated test case efficiency management, automated test case efficiency management is connected with automated test case efficiency optimization, automated test case efficiency optimization is connected with automated test case data security control, automated test case data security control is connected with automated test feedback, and automated test feedback is connected with automated test evaluation.

[0026] The step S01: automated test case numbering: is used to match automated test scripts according to the goals of automated tests, execute automated test scripts and set checkpoints, establish test cases according to the automated tests covered by each checkpoint, and number them.

[0027] In a possible design, the automated test case numbers are specifically: According to the target analysis results of the automated test, match the automated test script, use the automated test tool to execute the test script, and set checkpoints. According to the automated tests covered by each checkpoint, establish each test case monitoring sub-area, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2,... ,... .

[0028] See also Figure 2 As shown, the step S02: automated test case monitoring: is used to collect test execution capture data of each test case monitoring sub-area of ​​the automated test through checkpoints, and the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit.

[0029] In a possible design, the automated test case monitoring is specifically as follows: Automated test case efficiency monitoring unit: collects test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​automated testing through checkpoints, and marks them as , , ,in =1,2,... , Expressed as The number of the sub-area monitored by each test case; Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

[0030] The step S03: automated test case efficiency management: is used to receive the test execution capture data transmitted by the automated test case monitoring step, calculate the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, and screen out the monitoring sub-area with abnormal automated test efficiency. In a possible design, the automated test case efficiency management is specifically as follows: Step S001: The calculation formula of the automated test efficiency evaluation index is: in Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The actual running time of the single test execution data volume of each test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time; Step S002: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area.

[0031] In this embodiment, it should be specifically noted that the automated test case efficiency management also includes: Step S001: Calculate the expected running time of a single test data volume: in Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as Each test case monitors the test response time of the sub-area. Expressed as The amount of test data in each test case monitoring sub-area; Step S002: Calculate the actual running time of a single test execution data volume: in Expressed as The actual running time of the single test execution data volume of each test case monitoring sub-area, Expressed as The test execution data volume of each test case monitoring sub-area; Step S003: Calculate the mean of the test data volume: in It is expressed as the mean value of the test data. Represents the number of sub-areas monitored for a test case; Step S004: Similarly, the mean value of the test execution data volume and the mean value of the test response time are calculated. Step S04: Optimization of automated test case efficiency: used to receive each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculate the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and the data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test.

[0032] In a possible design, the automated test case efficiency optimization is specifically as follows: Step S001: Calculate the data throughput slope monitoring index: in Expressed as The data throughput slope monitoring indicator of the sub-area monitored by the test case, Expressed as The test execution data volume of each test case monitoring sub-area, Expressed as Each test case monitors the test response time of the sub-area. It is represented by the number of test case monitoring sub-areas; Step S002: collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: in Expressed as The data test load monitoring indicators of the test case monitoring sub-area, Expressed as The predicted test time of executing the test script of each test case monitoring sub-area, Expressed as Each test case monitors the test waiting time of executing the test script in the sub-area; Step S003: The calculation formula of the automated test efficiency optimization index is: in Expressed as The automated test efficiency optimization index of each test case monitoring sub-area; Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

[0033] The step S05: automated test case data security control: is used to receive the test execution captured data transmitted by the automated test case monitoring step, and calculate the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit; in a possible design, the automated test case data security control is specifically as follows: Step S001: Calculate the effective defect detection rate: in Expressed as The effective defect detection rate of each test case monitoring sub-area, Expressed as The number of defects in the sub-area monitored by each test case, Expressed as The number of effective defects in the test case monitoring sub-area; Step S002: The calculation formula of the automated test data security monitoring index is: in Expressed as The automated test data security monitoring index of each test case monitoring sub-area, Expressed as Test cases monitor the code coverage of sub-areas, Expressed as The number of test execution rounds per test case monitoring sub-area, Expressed as The predicted number of test execution rounds of the test script executed by each test case monitoring sub-area, The step S06: automated test feedback: used to analyze and obtain the automated test performance comprehensive evaluation coefficient according to the automated test efficiency evaluation index and the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test.

[0034] In a possible design, the calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The automated test data security monitoring index of each test case monitoring sub-area. The step S07: automated test evaluation: is used to obtain the automated test performance comprehensive evaluation coefficient, compare it with the preset automated test performance comprehensive evaluation coefficient, and process it.

[0035] In a possible design, the automated test evaluation is specifically: Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards. In this embodiment, it should be specifically explained that the present invention collects test execution capture data of each test case monitoring sub-area of ​​the automated test through the checkpoint, calculates the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, calculates the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit, further analyzes to obtain the automated test performance comprehensive evaluation coefficient, and compares it with the preset automated test performance comprehensive evaluation coefficient. If the obtained automated test performance comprehensive evaluation coefficient is less than the preset automated test performance comprehensive evaluation coefficient, it indicates that the automated test result feedback does not meet expectations, and the management personnel should be notified to check the existing test cases. Otherwise, it indicates that the results of the automated test meet the expected standards. Through in-depth analysis and optimization of various technical indicators, the intelligence level of the test cases is improved. Through the setting of the automated test case data security monitoring unit, the data security monitoring of the test data in the automated testing process is enhanced, and a comprehensive and efficient automated testing method is provided. Through the refined management of the test process, the repetitive work of testers is greatly reduced and the test coverage is improved.

[0036] In the present embodiment, it should be specifically explained that the present invention utilizes an automated test case efficiency optimization step, based on each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, obtains a data throughput slope monitoring indicator and a data test load monitoring indicator for each test case monitoring sub-area corresponding to the abnormality, calculates an automated test efficiency optimization index for each test case monitoring sub-area with the corresponding abnormal automated test, and based on the automated test efficiency optimization index for each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, notifies management personnel to maintain computing resource matching during the automated test process. Management personnel can understand the resource usage and efficiency performance of each monitoring sub-area, which helps to optimize the allocation of computing resources, thereby avoiding resource waste and improving overall testing efficiency.

[0037] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for automated testing, characterized in that: include: Step S01: Automated test case numbering: used to match automated test scripts according to automated test objectives, execute automated test scripts and set checkpoints, create test cases according to the automated tests covered by each checkpoint, and number them; Step S02: Automated test case monitoring: used to collect test execution capture data of each test case monitoring sub-area of ​​the automated test through the checkpoint, wherein the automated test case monitoring includes an automated test case efficiency monitoring unit and an automated test case data security monitoring unit; Step S03: Automated test case efficiency management: Calculate the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test according to the automated test case efficiency monitoring unit, and screen out the monitoring sub-areas with abnormal automated test efficiency; Step S04: Optimizing the efficiency of automated test cases: receiving each test case monitoring sub-area with abnormal automated test efficiency during the automated test process, and calculating the automated test efficiency optimization index of each test case monitoring sub-area corresponding to the abnormal automated test based on the data throughput slope monitoring index and the data test load monitoring index of each test case monitoring sub-area corresponding to the abnormal automated test; Step S05: Automated test case data security control: Calculate the automated test data security monitoring index of each test case monitoring sub-area of ​​the automated test according to the automated test case data security monitoring unit; Step S06: automated test feedback: used to monitor the automated test efficiency evaluation index and automated test data security monitoring index of the sub-area according to each test case of the automated test, and analyze and obtain the automated test performance comprehensive evaluation coefficient; Step S07: Automated test evaluation: used to obtain an automated test performance comprehensive evaluation coefficient, compare it with a preset automated test performance comprehensive evaluation coefficient, and process it.

2. The method of automated testing according to claim 1, characterized in that: The specific automated test case numbers are: According to the target analysis results of the automated test, match the automated test script, use the automated test tool to execute the test script, and set checkpoints. According to the automated tests covered by each checkpoint, establish each test case monitoring sub-area, and number each test case monitoring sub-area of ​​the automated test in sequence as 1, 2,... ,... .

3. The method of automated testing according to claim 2, characterized in that: The automated test case monitoring is specifically as follows: Automated test case efficiency monitoring unit: collects test data volume, test execution data volume, and test response time of each test case monitoring sub-area of ​​automated testing through checkpoints, and marks them as , , ,in =1,2,... , Expressed as The number of the sub-area monitored by each test case; Automated test case data security monitoring unit: collects the code coverage, test execution rounds, number of defects, and number of effective defects of each test case monitoring sub-area of ​​the automated test through checkpoints, and marks them as , , , .

4. The method of automated testing according to claim 3, characterized in that: The automated test case efficiency management is specifically as follows: Step S001: The calculation formula of the automated test efficiency evaluation index is: in Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The actual running time of the single test execution data volume of each test case monitoring sub-area, It is expressed as the mean value of the test data. It is expressed as the mean value of the test execution data. Expressed as the mean test response time; Step S002: Obtain the automated test efficiency evaluation index of each test case monitoring sub-area of ​​the automated test, and compare it with the preset automated test efficiency evaluation index. If the automated test efficiency evaluation index of a test case monitoring sub-area is less than the preset automated test efficiency evaluation index, it indicates that there is an abnormality in the automated test efficiency of the test case monitoring sub-area, and the abnormal monitoring sub-area is sent to the automated test case efficiency optimization step for optimization processing. Otherwise, it indicates that there is no abnormality in the automated test efficiency of the test case monitoring sub-area.

5. The method of automated testing according to claim 4, characterized in that: The automation test case efficiency optimization is specifically as follows: Step S001: Calculate the data throughput slope monitoring index: in Expressed as The data throughput slope monitoring indicator of the sub-area monitored by the test case, Expressed as The test execution data volume of each test case monitoring sub-area, Expressed as Each test case monitors the test response time of the sub-area. Represents the number of sub-areas monitored for a test case; Step S002: Collect the test prediction time and test waiting time of the execution test script of each test case monitoring sub-area with abnormal automated test efficiency during the automated test process through the checkpoint, and mark them as , , calculate the data test load monitoring indicators: in Expressed as The data test load monitoring indicators of the test case monitoring sub-area, Expressed as The predicted test time of executing the test script of each test case monitoring sub-area, Expressed as Each test case monitors the test waiting time of executing the test script in the sub-area; Step S003: The calculation formula of the automated test efficiency optimization index is: in Expressed as The automated test efficiency optimization index of each test case monitoring sub-area; Step S004: Based on the automated testing efficiency optimization index of each test case monitoring sub-area with abnormal automated testing efficiency during the automated testing process, the management personnel are notified to maintain the computing resource matching during the automated testing process.

6. The method of automated testing according to claim 5, characterized in that: The automated test case data security control is specifically as follows: Step S001: Calculate the effective defect detection rate: in Expressed as The effective defect detection rate of each test case monitoring sub-area, Expressed as The number of defects in the sub-area monitored by each test case, Expressed as The number of valid defects in the sub-area monitored by each test case; Step S002: The calculation formula of the automated test data security monitoring index is: in Expressed as The automated test data security monitoring index of each test case monitoring sub-area, Expressed as Test cases monitor the code coverage of sub-areas, Expressed as The number of test execution rounds per test case monitoring sub-area, Expressed as The predicted number of test execution rounds of the test script executed by each test case monitoring sub-area, Expressed as a natural constant.

7. The method of automated testing according to claim 6, characterized in that: The calculation formula of the comprehensive evaluation coefficient of the automated test performance is: in Expressed as the comprehensive evaluation coefficient of automated test performance, Expressed as The automated test efficiency evaluation index of each test case monitoring sub-area, Expressed as The expected running time of a single test data volume in each test case monitoring sub-area, Expressed as The automated test data security monitoring index for each test case monitoring sub-area.

8. The method of automated testing according to claim 7, characterized in that: The automated test evaluation is specifically as follows: Obtain the comprehensive evaluation coefficient of automated test performance and compare it with the preset comprehensive evaluation coefficient of automated test performance. If the obtained comprehensive evaluation coefficient of automated test performance is less than the preset comprehensive evaluation coefficient of automated test performance, it means that the feedback of automated test results does not meet expectations, and the management personnel should be notified to review the existing test cases. Otherwise, it means that the results of automated testing meet the expected standards.

9. An automated testing device, characterized in that: The invention comprises a memory, a processor and a machine executable program stored in the memory and running on the processor, and the processor implements an automated testing method according to any one of claims 1 to 8 when executing the machine executable program.

Citation Information

Patent Citations

  • Automatic testing method and device for improving delivery quality and efficiency

    CN116991707A

  • Automatic test case generation device based on large language model

    CN117806980A

  • Intelligent information system performance evaluation and test method and system

    CN118093434A

  • Automated supervised testing system and use thereof

    EP3598308A1

  • Integrated automated test case generation for safety-critical software

    US20160170864A1