Component test parameter optimization method, device, equipment and medium

By dynamically configuring and optimizing server test parameters, the inefficiency problem of test efficiency caused by manual intervention in the existing technology is solved, efficient and fast server testing is achieved, and high-quality product delivery is ensured.

CN118916265APending Publication Date: 2024-11-08INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410918322.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-10
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing server testing methods require manual intervention to configure test parameters, resulting in inefficient testing, and parameters need to be set repeatedly after each test, affecting efficiency.

Method used

By obtaining initial test parameters based on the project testing stage, test strategy, component type and server configuration, adjusting parameters with custom alignment criteria, generating optimization parameters in combination with automated test system data, dynamically configure component testing parameters, and optimizing the test process.

Benefits of technology

High-quality and efficient server testing is achieved, repetitive task processes are reduced, testing efficiency and coverage are improved, and high-quality product delivery is ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118916265A_ABST
    Figure CN118916265A_ABST
Patent Text Reader

Abstract

The invention discloses a component test parameter optimization method and device, equipment and a medium, and belongs to the technical field of test.The method comprises the steps that initial test parameters of any to-be-tested component are obtained; generating a first test parameter used by the to-be-tested component; acquiring a second test parameter; performing performance testing on the to-be-tested component according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of component performance testing; calculating the server test efficiency according to the test success rate and the automation rate of the component performance test; and in response to the fact that the server test efficiency reaches a preset test efficiency value of the server, optimizing the component test parameters through the correction values of the component test parameters. According to the method, the component test parameters can be dynamically configured, the component test parameters are optimized and adjusted through data correction, and high-quality, high-efficiency and rapid testing is achieved to complete delivery of the server.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of testing technology, and in particular to a component testing parameter optimization method, device, equipment and medium. Background Art

[0002] At present, with the increasing application of servers, the market demand for servers is also increasing. For the different types of components in the server, they need to be fully tested and verified before the server is put on the market to ensure the overall quality and provide customers with high-quality services. There are many combinations of various components to form a server. For example, for server M, choose 10 3T hard disks under brand A, 2 100G memory sticks under brand B, and NF5280M6 CPU; for server N, choose 40 1T hard disks under brand A, a 6T memory under brand C, NF5270M6 CPU and other combinations. There are also many types of servers, such as tower, rack, blade and micro servers. There are many uncertainties as to whether the running quality of servers with different combinations can meet customer requirements and whether there will be compatibility issues. Each combination needs to be tested, and how to quickly complete the system test of the server has become the key.

[0003] When testing the current server, the test parameters need to be manually configured, and the parameters need to be set again after each test, and the process of allocating test tasks needs to be repeated before the test can be started. However, this method will lead to low test efficiency. Summary of the invention

[0004] In order to overcome the above-mentioned technical defects, the purpose of the present application is to provide a component test parameter optimization method, device, equipment and medium, the method comprising: obtaining the initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration; adjusting the initial test parameters of the component to be tested by custom comparison criteria to generate first test parameters for the component to be tested; obtaining second test parameters according to the last test result data of the component to be tested by the automated testing system; performing a performance test on the component to be tested according to the first test parameters and the second test parameters to generate a test success rate and an automation rate of the component performance test; calculating the server test efficiency according to the test success rate and the automation rate of the component performance test; obtaining a preset test efficiency value of the server; judging whether the server test efficiency reaches the preset test efficiency value of the server; in response to the server test efficiency reaching the preset test efficiency value of the server, generating a correction value of the component test parameter according to the current server test efficiency, and optimizing the component test parameter by the correction value of the component test parameter. This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0005] The specific technical solutions provided by the embodiments of this application are as follows:

[0006] In a first aspect, the present application provides a component test parameter optimization method, the method is applied to a server, the server includes several components, and the method includes:

[0007] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0008] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0009] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0010] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0011] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0012] Obtaining a preset test efficiency value of the server;

[0013] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0014] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0015] In one embodiment, before obtaining the initial test parameters of the component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration, the process includes:

[0016] Creating a dynamic component parameter library, wherein the dynamic component parameter library includes test parameter data of each server component,

[0017] The test parameter data of the server component includes client lines, parameter data types and parameter standard sequences.

[0018] In one embodiment, the dynamic component parameter library includes a solution parameter library and a standard library, and the initial test parameters of the component to be tested are adjusted by a custom comparison criterion to generate a first test parameter for the component to be tested, including:

[0019] When the project personnel sets a custom comparison criterion, the test parameters set by the project personnel for the component to be tested according to the scheme parameter library and the standard library data are used as the first test parameters used by the component to be tested;

[0020] When the project personnel do not set a custom comparison criterion, the initial test parameters set for the component to be tested in the solution parameter library are used as the first test parameters used by the component to be tested.

[0021] In one embodiment, the obtaining of the second test parameter according to the last test result data of the component to be tested by the automated testing system includes:

[0022] Get the last test result data of each component;

[0023] Filter and classify the last test result data of each component according to the component type;

[0024] The second test parameter of the component to be tested is determined according to the last test result data of the component after screening and classification.

[0025] In one embodiment, the step of performing a performance test on the component to be tested according to the first test parameter and the second test parameter to generate a test success rate and an automation rate of the component performance test includes:

[0026] Get the number of successful test cases for a component and the number of total test cases for a component;

[0027] Calculate the test success rate of component performance tests;

[0028] Get the number of component automated test cases and the number of component total test cases;

[0029] Calculate the test automation rate of component performance testing;

[0030] The calculating the server test efficiency according to the test success rate and automation rate of the component performance test includes:

[0031] Obtain the test success rate, automation rate, test execution time, resource consumption, and test coverage of component performance tests;

[0032] Obtain the test success rate weight w1, automation rate weight w2, test execution time weight w3, resource consumption weight w4, and test coverage weight w5 of the component performance test, where w1+w2+w3+w4+w5=1;

[0033] The test success rate of the component performance test is the ratio of successful test cases to the total test cases;

[0034] The automation rate is the ratio of automated test cases to total test cases;

[0035] The test execution time is the time required to complete all tests;

[0036] The resource consumption refers to the computing resources consumed during the test process;

[0037] The test coverage is the ratio of code lines covered by test cases;

[0038]

[0039] The server test efficiency is calculated.

[0040] In one embodiment, the method comprises:

[0041] In response to the server test efficiency not reaching a preset test efficiency value of the server, retesting the component according to the first test parameter and the correction value of the component test parameter;

[0042] When the number of times the component is tested according to the first test parameter and the correction value of the component test parameter reaches a first preset value, re-determining whether the current server test efficiency reaches the preset test efficiency value of the server;

[0043] In response to the server test efficiency calculated after the retest not reaching the preset test efficiency value of the server, the current first test parameter after the retest and the correction value of the component test parameter are listed as error parameters, and an alarm is prompted.

[0044] In one embodiment, generating the correction value of the component test parameter according to the current server test efficiency, and optimizing the component test parameter by the correction value of the component test parameter, comprises:

[0045] The test parameters of each component in the dynamic component parameter library, the test success rate of each component calculated according to the component test parameters after each test, the automation rate of each component, the test execution time, the test phase type and the test efficiency of different server configurations are displayed on the client.

[0046] In a second aspect, the present application also provides a component test parameter optimization device, the device comprising:

[0047] The acquisition module is used to obtain the initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration; obtain the second test parameter according to the last test result data of the component to be tested by the automated test system; and obtain the preset test efficiency value of the server;

[0048] A generation module, used to adjust the initial test parameters of the component to be tested by customizing the comparison criteria to generate first test parameters for the component to be tested; perform a performance test on the component to be tested according to the first test parameters and the second test parameters to generate a test success rate and an automation rate of the component performance test;

[0049] A calculation module, used for calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0050] A judgment module, used to judge whether the test efficiency of the server reaches a preset test efficiency value of the server;

[0051] The optimization module is used to generate a correction value of the component test parameter according to the current server test efficiency in response to the server test efficiency reaching the preset test efficiency value of the server, and optimize the component test parameter through the correction value of the component test parameter.

[0052] In a third aspect, a component test parameter optimization device is also provided, comprising:

[0053] one or more processors;

[0054] A storage device for storing one or more programs;

[0055] When the one or more programs are executed by the one or more processors, the one or more processors implement the component test parameter optimization method as described in any one of the first aspects.

[0056] In a fourth aspect, the present application further provides a computer device, the device comprising:

[0057] A memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the component test parameter optimization method as described in any one of the first aspects.

[0058] In a fifth aspect, the present application further provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the component test parameter optimization method described in any one of the first aspects.

[0059] In a sixth aspect, the present application further provides a computer storage medium, the medium comprising:

[0060] A computer program is stored thereon, and when the computer program is executed by a processor, the steps of any component test parameter optimization method described in the first aspect are implemented.

[0061] Compared with the prior art, the method of the technical solution provided in the embodiment of the present application includes: obtaining the initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration; adjusting the initial test parameters of the component to be tested by a custom comparison criterion to generate a first test parameter for the component to be tested; obtaining a second test parameter according to the last test result data of the component to be tested by the automated testing system; performing a performance test on the component to be tested according to the first test parameter and the second test parameter to generate a test success rate and an automation rate of the component performance test; calculating the server test efficiency according to the test success rate and the automation rate of the component performance test; obtaining the preset test efficiency value of the server; judging whether the server test efficiency reaches the preset test efficiency value of the server; in response to the server test efficiency reaching the preset test efficiency value of the server, generating a correction value of the component test parameter according to the current server test efficiency, and optimizing the component test parameter by the correction value of the component test parameter. The present application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete the delivery of the server.

[0062] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0063] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0065] Figure 1 A first flow chart of a component test parameter optimization method provided in Embodiment 1 of the present application;

[0066] Figure 2A structural diagram of a component test parameter optimization system provided in Example 1 of the present application;

[0067] Figure 3 A second flow chart of the component test parameter optimization method provided in the second embodiment of the present application;

[0068] Figure 4 A flow chart of dynamic component parameter library maintenance provided in Example 2 of the present application;

[0069] Figure 5 A flow chart for generating a first test parameter by customizing a comparison criterion provided in Embodiment 2 of the present application;

[0070] Figure 6 A flowchart of component test parameter correction provided in Example 2 of the present application;

[0071] Figure 7 A flow chart showing test parameters provided in Example 2 of the present application;

[0072] Figure 8 A specific flow chart of the component test parameter optimization method provided in Example 2 of the present application;

[0073] Fig. 9 A structural diagram of a component test parameter optimization device provided in Example 3 of the present application;

[0074] Fig.10 The exemplary system provided for Embodiment 7 of the present application can be used to implement the various embodiments described in the present application. DETAILED DESCRIPTION

[0075] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0076] It should be noted that, unless the context clearly requires otherwise, words such as “include”, “including” and similar words throughout the specification and claims should be interpreted as including rather than exclusive or exhaustive; that is, the meaning is “including but not limited to”.

[0077] Furthermore, in the description of the present application, unless otherwise specified, “plurality” means two or more.

[0078] With the vigorous development of the Internet, efficient testing of server configuration verification is an important means to improve product quality and customer satisfaction, and how to conduct efficient testing on servers is of paramount importance.

[0079] Embodiment 1

[0080] The present application embodiment provides a component test parameter optimization method, such as Figure 1 As shown, the method is applied to a server, the server includes several components, and the method includes:

[0081] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0082] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0083] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0084] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0085] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0086] Obtaining a preset test efficiency value of the server;

[0087] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0088] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0089] Specifically, the present application proposes a method for improving server testing efficiency based on dynamic configuration parameters, and constructs an accurate and efficient server testing and verification system that can adapt to components of various types of configurations and multiple types of servers.

[0090] Through the maintenance of the dynamic parameter library, the data processing module normalizes the data and generates dynamic test parameters based on the custom comparison criteria. At the same time, the data is analyzed to generate standardized test result data, and correction data is generated in combination with the ideal test efficiency of the server to correct the test parameters, that is, to continuously optimize the dynamic parameter library.

[0091] The implementation data of the dynamic parameter library in the project is visualized and presented in an organized manner.

[0092] Here, if Figure 2 As shown, the present application proposes a system for improving server testing efficiency based on dynamic test parameters, which is based on Spring, SpringBoot, network communication protocol (webSocket), MyBatis framework, and uses java, programming language (javascript), and mysql database to build a dynamic test parameter library. The system mainly includes: a dynamic parameter library module, a data processing module, a data analysis module, a test task dynamic acquisition module, and a service test statistics module;

[0093] The dynamic parameter library module is used to create a dynamic component parameter library;

[0094] The data processing module is used to adjust the initial test parameters of the component to be tested by a custom comparison criterion to generate a first test parameter for the component to be tested; and obtain a second test parameter according to the last test result data of the component to be tested by the automated test system;

[0095] The data analysis module is used to perform a performance test on the component to be tested according to the first test parameter and the second test parameter, and generate a test success rate and an automation rate of the component performance test; calculate the server test efficiency according to the test success rate and the automation rate of the component performance test; obtain a preset test efficiency value of the server; determine whether the server test efficiency reaches the preset test efficiency value of the server; in response to the server test efficiency reaching the preset test efficiency value of the server, generate a correction value of the component test parameter according to the current server test efficiency, and optimize the component test parameter by using the correction value of the component test parameter;

[0096] The test task dynamic acquisition module is used to obtain the last test result data of each component; filter and classify the last test result data of each component according to the type of component; and determine the second test parameter of the component to be tested according to the last test result data of the filtered and classified component;

[0097] The service test statistics module is used to display the test parameters of each component in the dynamic component parameter library, the test success rate of each component calculated based on the component test parameters after each test, the automation rate of each component, the test execution time, the test phase type and the test efficiency of different server configurations on the client.

[0098] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0099] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0100] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0101] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products.

[0102] Embodiment 2

[0103] The present application embodiment provides a component test parameter optimization method, such as Figure 3 As shown, the method is applied to a server, the server includes several components, and the method includes:

[0104] Step S01, creating a dynamic component parameter library, wherein the dynamic component parameter library includes test parameter data of each server component, and the test parameter data of the server component includes client lines, parameter data types and parameter standard sequences.

[0105] Specifically, Figure 4 As shown, when the dynamic component parameter library is created for the first time, the test design engineer (TDE, Test Design Engineer) or the automation development engineer (ADE, Auto Develop Engineer) enters the component test parameters through the web front end. The parameters include customer lines (general, Baidu, Byte, etc.), test parameter data types (numbers, strings, etc.), parameter standard sequences (general standards, radical standards, recommended standards, conservative standards, etc.), and are saved in the database MySQL through Java processing, and provide data addition, deletion, modification and query functions.

[0106] Step S02, obtaining initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration;

[0107] The initial test parameters of the component to be tested are adjusted by using a user-defined comparison criterion to generate first test parameters for the component to be tested.

[0108] Step S02 also includes:

[0109] Step S021, when the project personnel set a custom comparison criterion, the test parameters set by the project personnel for the component to be tested according to the solution parameter library and the standard library data are used as the first test parameters used by the component to be tested;

[0110] When the project personnel do not set a custom comparison criterion, the initial test parameters set for the component to be tested in the solution parameter library are used as the first test parameters used by the component to be tested.

[0111] Specifically, Figure 5 As shown, according to the customer line to which the current project belongs, the type of the current test phase, the strategy type of the current test (parameter standard sequence), the component type and the server configuration, the initial test data is obtained from the solution parameter library and the standard library, and a set of dynamic configuration parameters (first test parameters) that can be used for the project is generated through customized rule comparison criteria; the ideal efficiency of server testing is formulated by the test manager (VM, Verify Manager), and the rule comparison criteria can be customized according to the professional suggestions of TDE or ADE and VM, which improves the accuracy of component test parameters and the accuracy of server testing.

[0112] If there is no custom criteria, the test parameter data in the solution parameter library will be used by default. If the standard library data is empty, only the parameter library data will be presented. If custom criteria are set, the data in the solution parameter library and the standard library will be integrated according to the custom criteria to obtain the first test parameter, and the first test parameter will be passed to the data analysis module.

[0113] Among them, the types of testing phases include: SDV / EVT, system design verification phase; SIT / DVT, system integration test phase; SVT / PVT, system confirmation test phase; Pre-MP, pre-maintenance phase; MP maintenance phase; EVT, DVT, and pVT are used for customer customized projects.

[0114] It can be understood that the dynamic test parameter library consists of two parts: the test standard library and the solution parameter library;

[0115] The test standard library is used to maintain customer line (general, Baidu, Byte, etc.) standards, parameter values, and parameter data types (numbers, strings, etc.);

[0116] Different customer lines correspond to different values, for example, the Loop parameter of the hard disk performance test case, the general customer corresponds to 100 loops, Baidu corresponds to 300 loops, and Byte corresponds to 300 loops; the solution parameter library is used to maintain test strategies; the test strategy type is: parameter standard sequence (extreme standard, aggressive standard, recommended standard, conservative standard), different test strategies correspond to different values, for example, the 1oop parameter of the hard disk performance test case, the extreme standard corresponds to parameter 100, the aggressive standard corresponds to parameter 300, the recommended standard corresponds to parameter 1000, and the conservative standard corresponds to parameter 2000.

[0117] If the same parameters for the same test case are maintained in both the test standard library and the solution parameter library, the data in the solution parameter library shall prevail. For example, for a hard disk performance test case, the Loop parameter is maintained in both the test standard library and the solution parameter library. If the parameter values ​​are different, the test data in the solution parameter library shall be obtained first.

[0118] Step S03: obtaining a second test parameter according to the last test result data of the component to be tested by the automated testing system.

[0119] Step S03 also includes:

[0120] Step S031, obtaining the last test result data of each component;

[0121] Filter and classify the last test result data of each component according to the component type;

[0122] The second test parameter of the component to be tested is determined according to the last test result data of the component after screening and classification.

[0123] Specifically, the test result data of the last test task is received from the automated testing system, and the last test result data of each component is screened and classified according to the component type, and the data is summarized and sent to the data analysis module, and the second test parameter of the component to be tested is determined based on the last test result data after screening and classification.

[0124] Step S04, performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0125] The server testing efficiency is calculated based on the test success rate and automation rate of the component performance test.

[0126] Step S04 also includes:

[0127] Step S041, obtaining the number of successful test cases of the component and the number of total test cases of the component;

[0128] Calculate the test success rate of component performance tests;

[0129] Get the number of component automated test cases and the number of component total test cases;

[0130] Calculate the test automation rate for component performance testing.

[0131] Specifically, assume that the component executes a total of 100 test cases;

[0132] Among them, 90 use cases were successful and 10 failed. Among these 100 use cases, 80 were executed by automated testing tools. Then, the test success rate is 90 / 100*100%=90%, and the automation rate is 80 / 100*100%=80%.

[0133] Step S042, obtaining the test success rate, automation rate, test execution time, resource consumption and test coverage of the component performance test;

[0134] Obtain the test success rate weight w1, automation rate weight w2, test execution time weight w3, resource consumption weight w4, and test coverage weight w5 of the component performance test, where w1+w2+w3+w4+w5=1;

[0135] The test success rate of the component performance test is the ratio of successful test cases to the total test cases;

[0136] The automation rate is the ratio of automated test cases to total test cases;

[0137] The test execution time is the time required to complete all tests;

[0138] The resource consumption refers to the computing resources consumed during the test process;

[0139] The test coverage is the ratio of code lines covered by test cases;

[0140]

[0141] The server test efficiency is calculated.

[0142] Specifically, for example, test success rate = 90%; automation rate = 80%; test execution time = 3 hours; resource consumption = 50% CPU usage; test coverage = 95%;

[0143] And assume the weights are as follows:

[0144] w1 = 0.3 (test success rate); w2 = 0.2 (automation rate); w3 = 0.1 (test execution time); w4 = 0.2 (resource consumption); w5 = 0.2 (test coverage);

[0145]

[0146] Step S05, as Figure 6 As shown, a preset test efficiency value of the server is obtained;

[0147] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0148] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0149] Specifically, after the system has been running for a period of time, the data analysis module combines the preset test efficiency value of the server and the test success rate and automation rate of the component performance test, and generates a set of recommended test parameter values ​​for server component types, i.e., correction data, by comparing them with the initial parameter data. The component test parameters are optimized through the correction values ​​of the component test parameters and provided to TDE and ADE engineers for reference.

[0150] The preset test efficiency value of the server, for example, when the client is Tencent, is 95%.

[0151] The test parameter source data comes from two parts, one part comes from the first test parameter after being processed by the data processing module, and the other part comes from the result data after the last test task is executed; the data analysis module combines the two source data to generate the test success rate and automation rate of the component performance test; the server test efficiency is calculated according to the test success rate and automation rate of the component performance test; finally, the ideal test efficiency of the server (the preset test efficiency value of the server) is set in combination with the project manager VM, the correction value of the component test parameter is generated, and the correction value of the component test parameter is stored in the dynamic test parameter library.

[0152] Step S06, in response to the server test efficiency not reaching the preset test efficiency value of the server, retesting the component according to the first test parameter and the correction value of the component test parameter;

[0153] When the number of times the component is tested according to the first test parameter and the correction value of the component test parameter reaches a first preset value (for example, 3 times), it is re-determined whether the current server test efficiency reaches the preset test efficiency value of the server;

[0154] In response to the server test efficiency calculated after the retest not reaching the preset test efficiency value of the server, the current first test parameter after the retest and the correction value of the component test parameter are listed as error parameters, and an alarm is prompted.

[0155] Specifically, Figure 6 As shown, if the server test efficiency does not reach the preset test efficiency value of the server, the data analysis module initiates task scheduling again based on the correction value of the component test parameter, and the test task performs component testing according to the corrected test parameter data. The test results are fed back to the data analysis module, and this is repeated three times. If the final result still does not meet the preset test efficiency value of the server, it is determined that the current first test parameter after retesting and the correction value of the component test parameter are incorrectly set, and the result is fed back to the server test efficiency statistics module, and a red warning is set.

[0156] Step S07, displaying the component test parameters of the dynamic component parameter library, the component test success rate calculated according to the component test parameters after each test, the component automation rate, the test execution time, the test phase type and the test efficiency of different server configurations on the client.

[0157] Specifically, Figure 7 As shown, the web display screen is provided to TDE and ADE engineers for viewing. Through this page, TDE and ADE engineers can view the test status of the current type of components after each test, including but not limited to displaying the server test efficiency, component automation achievement rate, automation coverage, test cycle and dynamic parameter value set used for each test task under the current project, test phase, component type and different configurations, and verify whether there is any alarm data. If so, the page will be marked in red to remind you.

[0158] like Figure 8 As shown, the technical solution of the present application proposes a method for optimizing component test parameters, and constructs an efficient server test verification system that can adapt to multiple types of components and multiple types of servers. The system can dynamically configure test parameters, and through the data analysis module, it can continuously optimize and adjust, and ultimately achieve high-quality, high-efficiency, and rapid completion of server test delivery. At the same time, it provides a visual data display web page, which provides great convenience for TDE, ADE, VM engineers, and server acceptance personnel.

[0159] In addition, the component test parameter optimization method further includes:

[0160] Optimize test parameters of server components through machine learning models;

[0161] The method of optimizing the test parameters of the server components by using the machine learning model includes:

[0162] Collecting test data, the test data including various test parameter configurations and corresponding test results;

[0163] Preprocessing the collected test data and selecting features related to the test results, wherein the features include: different test parameter combinations, environmental variables when executing the test, component running time of the server, and component test success rate;

[0164] Select a machine learning model to build a prediction model, wherein the prediction model includes a regression model and a classification model:

[0165] Training the prediction model by adjusting hyperparameters of the prediction model, wherein the hyperparameters include a maximum depth of a decision tree, a number of layers and a number of nodes of a neural network;

[0166] Optimizing hyperparameters of the predictive model using grid search, random search, or Bayesian optimization methods;

[0167] According to the prediction results of the model, an optimization algorithm is used to automatically determine the optimal test parameter configuration, wherein the optimization algorithm includes a genetic algorithm, a particle swarm optimization, and a gradient descent algorithm;

[0168] Apply the optimized test parameters to actual tests, collect new test data, form a closed-loop feedback loop, and continuously iterate and optimize the model and test parameters;

[0169] Monitor the performance and test results of the prediction model, and adjust or retrain the model as the hardware or software environment changes;

[0170] Through the above steps, the machine learning model can be used to understand and predict the impact of different test parameters on the test results, thereby guiding the optimization of server component test parameters and improving test efficiency and quality.

[0171] The method for optimizing component test parameters provided in the embodiment of the present application may be further improved and optimized without departing from the technical solution of the present application, and these improvements and optimizations should also be regarded as within the scope of protection of the present application.

[0172] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0173] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0174] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0175] Embodiment 3

[0176] The present application provides a device for optimizing component test parameters, such as Fig. 9 As shown, the device includes a creation module, an acquisition module, a generation module, a calculation module, a judgment module, an optimization module, an early warning module, and a display module.

[0177] In this embodiment, the acquisition module is used to obtain the initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration; obtain the second test parameter according to the last test result data of the component to be tested by the automated test system; obtain the preset test efficiency value of the server;

[0178] A generation module, used to adjust the initial test parameters of the component to be tested by customizing the comparison criteria to generate first test parameters for the component to be tested; perform a performance test on the component to be tested according to the first test parameters and the second test parameters to generate a test success rate and an automation rate of the component performance test;

[0179] A calculation module, used for calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0180] A judgment module, used to judge whether the test efficiency of the server reaches a preset test efficiency value of the server;

[0181] The optimization module is used to generate a correction value of the component test parameter according to the current server test efficiency in response to the server test efficiency reaching the preset test efficiency value of the server, and optimize the component test parameter through the correction value of the component test parameter.

[0182] In one embodiment, a creation module is used to create a dynamic component parameter library, wherein the dynamic component parameter library includes test parameter data of each server component.

[0183] The test parameter data of the server component includes client lines, parameter data types and parameter standard sequences.

[0184] In one embodiment, the generating module is used to use the test parameters set by the project personnel for the component to be tested according to the scheme parameter library and the standard library data as the first test parameters used by the component to be tested when the project personnel set the custom comparison criteria;

[0185] When the project personnel do not set a custom comparison criterion, the initial test parameters set for the component to be tested in the solution parameter library are used as the first test parameters used by the component to be tested.

[0186] In one of the embodiments, the acquisition module is used to obtain the last test result data of each component;

[0187] Filter and classify the last test result data of each component according to the component type;

[0188] The second test parameter of the component to be tested is determined according to the last test result data of the component after screening and classification.

[0189] In one of the embodiments, a generating module is used to obtain the number of successful test cases of a component and the number of total test cases of a component;

[0190] Calculate the test success rate of component performance tests;

[0191] Get the number of component automated test cases and the number of component total test cases;

[0192] Calculate the test automation rate for component performance testing.

[0193] In one of the embodiments, a calculation module is used to obtain a test success rate, an automation rate, a test execution time, resource consumption, and a test coverage of a component performance test;

[0194] Obtain the test success rate weight w1, automation rate weight w2, test execution time weight w3, resource consumption weight w4, and test coverage weight w5 of the component performance test, where w1+w2+w3+w4+w5=1;

[0195] The test success rate of the component performance test is the ratio of successful test cases to the total test cases;

[0196] The automation rate is the ratio of automated test cases to total test cases;

[0197] The test execution time is the time required to complete all tests;

[0198] The resource consumption refers to the computing resources consumed during the test process;

[0199] The test coverage is the ratio of code lines covered by test cases;

[0200]

[0201] The server test efficiency is calculated.

[0202] In one embodiment, the early warning module is used to retest the component according to the first test parameter and the correction value of the component test parameter in response to the server test efficiency not reaching the preset test efficiency value of the server;

[0203] When the number of times the component is tested according to the first test parameter and the correction value of the component test parameter reaches a first preset value, re-determining whether the current server test efficiency reaches the preset test efficiency value of the server;

[0204] In response to the server test efficiency calculated after the retest not reaching the preset test efficiency value of the server, the current first test parameter after the retest and the correction value of the component test parameter are listed as error parameters, and an alarm is prompted.

[0205] In one of the embodiments, a display module is used to display on the client the test parameters of each component in the dynamic component parameter library, the test success rate of each component calculated based on the component test parameters after each test, the automation rate of each component, the test execution time, the test phase type, and the test efficiency of different server configurations.

[0206] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0207] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0208] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0209] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products.

[0210] Embodiment 4

[0211] The present invention also provides a component test parameter optimization device, comprising:

[0212] one or more processors;

[0213] A storage device for storing one or more programs;

[0214] When the one or more programs are executed by the one or more processors, the one or more processors execute the component test parameter optimization method described below:

[0215] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0216] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0217] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0218] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0219] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0220] Obtaining a preset test efficiency value of the server;

[0221] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0222] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0223] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0224] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0225] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products.

[0226] Embodiment 5

[0227] The present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following component test parameter optimization method can be executed:

[0228] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0229] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0230] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0231] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0232] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0233] Obtaining a preset test efficiency value of the server;

[0234] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0235] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0236] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0237] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0238] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products.

[0239] Embodiment 6

[0240] The present application also provides a computer program product, including a computer program, which, when executed by a processor, can implement the following component test parameter optimization method:

[0241] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0242] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0243] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0244] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0245] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0246] Obtaining a preset test efficiency value of the server;

[0247] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0248] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0249] The beneficial effects of the technical solution provided by the embodiment of the present application are:

[0250] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0251] The technical solution provided in the embodiment of the present application can obtain dynamic parameters for testing various components of servers that make up servers of different types, and different test parameters can be dynamically obtained before each test for components of different types and configurations. The test parameters can be adjusted and corrected after the test, that is, there is no need to go through the task allocation process again, and the adjusted test parameters can be directly obtained dynamically and the test task can be re-run, thereby further improving the testing efficiency of the server.

[0252] The method for improving server testing efficiency based on dynamic parameters of the technical solution provided in the embodiment of the present application can accurately perform planned and efficient testing on various types of components and multiple types of servers, ensuring test coverage and test integrity, and ultimately achieving the goal of high-quality products.

[0253] Embodiment 7

[0254] The present application provides a computer storage medium, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

[0255] Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration;

[0256] Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested;

[0257] Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system;

[0258] Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test;

[0259] Calculating the server test efficiency according to the test success rate and automation rate of the component performance test;

[0260] Obtaining a preset test efficiency value of the server;

[0261] Determining whether the server test efficiency reaches a preset test efficiency value of the server;

[0262] In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

[0263] In one embodiment, before obtaining the initial test parameters of the component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration, the process includes:

[0264] Creating a dynamic component parameter library, wherein the dynamic component parameter library includes test parameter data of each server component,

[0265] The test parameter data of the server component includes client lines, parameter data types and parameter standard sequences.

[0266] In one embodiment, the dynamic component parameter library includes a solution parameter library and a standard library, and the initial test parameters of the component to be tested are adjusted by a custom comparison criterion to generate a first test parameter for the component to be tested, including:

[0267] When the project personnel sets a custom comparison criterion, the test parameters set by the project personnel for the component to be tested according to the scheme parameter library and the standard library data are used as the first test parameters used by the component to be tested;

[0268] When the project personnel do not set a custom comparison criterion, the initial test parameters set for the component to be tested in the solution parameter library are used as the first test parameters used by the component to be tested.

[0269] In one embodiment, the obtaining of the second test parameter according to the last test result data of the component to be tested by the automated testing system includes:

[0270] Get the last test result data of each component;

[0271] Filter and classify the last test result data of each component according to the component type;

[0272] The second test parameter of the component to be tested is determined according to the last test result data of the component after screening and classification.

[0273] In one embodiment, the step of performing a performance test on the component to be tested according to the first test parameter and the second test parameter to generate a test success rate and an automation rate of the component performance test includes:

[0274] Get the number of successful test cases for a component and the number of total test cases for a component;

[0275] Calculate the test success rate of component performance tests;

[0276] Get the number of component automated test cases and the number of component total test cases;

[0277] Calculate the test automation rate of component performance testing;

[0278] The calculating the server test efficiency according to the test success rate and automation rate of the component performance test includes:

[0279] Obtain the test success rate, automation rate, test execution time, resource consumption, and test coverage of component performance tests;

[0280] Obtain the test success rate weight w1, automation rate weight w2, test execution time weight w3, resource consumption weight w4, and test coverage weight w5 of the component performance test, where w1+w2+w3+w4+w5=1;

[0281] The test success rate of the component performance test is the ratio of successful test cases to the total test cases;

[0282] The automation rate is the ratio of automated test cases to total test cases;

[0283] The test execution time is the time required to complete all tests;

[0284] The resource consumption refers to the computing resources consumed during the test process;

[0285] The test coverage is the ratio of code lines covered by test cases;

[0286]

[0287] The server test efficiency is calculated.

[0288] In one embodiment, the method comprises:

[0289] In response to the server test efficiency not reaching a preset test efficiency value of the server, retesting the component according to the first test parameter and the correction value of the component test parameter;

[0290] When the number of times the component is tested according to the first test parameter and the correction value of the component test parameter reaches a first preset value, re-determining whether the current server test efficiency reaches the preset test efficiency value of the server;

[0291] In response to the server test efficiency calculated after the retest not reaching the preset test efficiency value of the server, the current first test parameter after the retest and the correction value of the component test parameter are listed as error parameters, and an alarm is prompted.

[0292] In one embodiment, generating the correction value of the component test parameter according to the current server test efficiency, and optimizing the component test parameter by the correction value of the component test parameter, comprises:

[0293] The test parameters of each component in the dynamic component parameter library, the test success rate of each component calculated according to the component test parameters after each test, the automation rate of each component, the test execution time, the test phase type and the test efficiency of different server configurations are displayed on the client.

[0294] This application can dynamically configure component test parameters, optimize and adjust component test parameters through data correction, and achieve high-quality, high-efficiency and fast testing to complete server delivery.

[0295] Fig.10 An exemplary system provided for Embodiment 7 of the present application that can be used to implement various embodiments described in the present application;

[0296] like Fig.10 As shown, in some embodiments, the system can be used as any of the above-mentioned devices for component test parameter optimization in each of the described embodiments. In some embodiments, the system may include one or more computer-readable media (e.g., system memory or NVM / storage device) having results and one or more processors (e.g., (one or more) processors) coupled to the one or more computer-readable media and configured to execute the results to implement the module to perform the actions described in the present application.

[0297] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0298] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0299] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A component test parameter optimization method, the method is applied to a server, the server includes several components, It is characterized in that The method comprises: Obtain initial test parameters of any component to be tested according to the type of the current project test phase, test strategy type, component type and server configuration; Adjusting the initial test parameters of the component to be tested by using a custom comparison criterion to generate first test parameters for the component to be tested; Acquire a second test parameter according to the last test result data of the component to be tested by the automated testing system; Performing a performance test on the component to be tested according to the first test parameter and the second test parameter, and generating a test success rate and an automation rate of the component performance test; Calculating the server test efficiency according to the test success rate and automation rate of the component performance test; Obtaining a preset test efficiency value of the server; Determining whether the server test efficiency reaches a preset test efficiency value of the server; In response to the server test efficiency reaching the preset test efficiency value of the server, a correction value of the component test parameter is generated according to the current server test efficiency, and the component test parameter is optimized by the correction value of the component test parameter.

2. The component test parameter optimization method according to claim 1, It is characterized in that Before obtaining the initial test parameters of the component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration, it includes: Creating a dynamic component parameter library, wherein the dynamic component parameter library includes test parameter data of each server component, The test parameter data of the server component includes client lines, parameter data types and parameter standard sequences.

3. The component test parameter optimization method according to claim 2, It is characterized in that The dynamic component parameter library includes a solution parameter library and a standard library. The initial test parameters of the component to be tested are adjusted by a custom comparison criterion to generate a first test parameter for the component to be tested, including: When the project personnel sets a custom comparison criterion, the test parameters set by the project personnel for the component to be tested according to the scheme parameter library and the standard library data are used as the first test parameters used by the component to be tested; When the project personnel do not set a custom comparison criterion, the initial test parameters set for the component to be tested in the solution parameter library are used as the first test parameters used by the component to be tested.

4. The component test parameter optimization method according to claim 1, It is characterized in that The obtaining of the second test parameter according to the last test result data of the component to be tested by the automated testing system comprises: Get the last test result data of each component; Filter and classify the last test result data of each component according to the component type; The second test parameter of the component to be tested is determined according to the last test result data of the component after screening and classification.

5. The component test parameter optimization method according to claim 1, It is characterized in that The step of performing a performance test on the component to be tested according to the first test parameter and the second test parameter to generate a test success rate and an automation rate of the component performance test includes: Get the number of successful test cases for a component and the number of total test cases for a component; Calculate the test success rate of component performance tests; Get the number of component automated test cases and the number of component total test cases; Calculate the test automation rate of component performance testing; The calculating the server test efficiency according to the test success rate and automation rate of the component performance test includes: Obtain the test success rate, automation rate, test execution time, resource consumption, and test coverage of component performance tests; Obtain the test success rate weight w1, automation rate weight w2, test execution time weight w3, resource consumption weight w4, and test coverage weight w5 of the component performance test, where w1+w2+w3+w4+w5=1; The test success rate of the component performance test is the ratio of successful test cases to the total test cases; The automation rate is the ratio of automated test cases to total test cases; The test execution time is the time required to complete all tests; The resource consumption refers to the computing resources consumed during the test process; The test coverage is the ratio of code lines covered by test cases; The server test efficiency is calculated.

6. The component test parameter optimization method according to claim 1, It is characterized in that The method comprises: In response to the server test efficiency not reaching a preset test efficiency value of the server, retesting the component according to the first test parameter and the correction value of the component test parameter; When the number of times the component is tested according to the first test parameter and the correction value of the component test parameter reaches a first preset value, re-determining whether the current server test efficiency reaches the preset test efficiency value of the server; In response to the server test efficiency calculated after the retest not reaching the preset test efficiency value of the server, the current first test parameter after the retest and the correction value of the component test parameter are listed as error parameters, and an alarm is prompted.

7. The component test parameter optimization method according to claim 2, It is characterized in that Generating the correction value of the component test parameter according to the current server test efficiency, and optimizing the component test parameter by the correction value of the component test parameter, comprises: The test parameters of each component in the dynamic component parameter library, the test success rate of each component calculated according to the component test parameters after each test, the automation rate of each component, the test execution time, the test phase type and the test efficiency of different server configurations are displayed on the client.

8. A component test parameter optimization device, It is characterized in that The device comprises: The acquisition module is used to obtain the initial test parameters of any component to be tested according to the type of the current project test phase, the test strategy type, the component type and the server configuration; obtain the second test parameter according to the last test result data of the component to be tested by the automated test system; and obtain the preset test efficiency value of the server; A generation module, used to adjust the initial test parameters of the component to be tested by customizing the comparison criteria to generate first test parameters for the component to be tested; perform a performance test on the component to be tested according to the first test parameters and the second test parameters to generate a test success rate and an automation rate of the component performance test; A calculation module, used to calculate the server test efficiency according to the test success rate and automation rate of the component performance test; a judgment module, used to judge whether the server test efficiency reaches the preset test efficiency value of the server; The optimization module is used to generate a correction value of the component test parameter according to the current server test efficiency in response to the server test efficiency reaching the preset test efficiency value of the server, and optimize the component test parameter through the correction value of the component test parameter.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the steps of the component test parameter optimization method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the component test parameter optimization method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Component verification method and device, storage medium and program product

    CN120743364A