Parameter configuration method, device, computer equipment and storage medium
By filtering and configuring test parameters, the problem of poor performance of SPEC jbb test suite on the current operating system is solved, and the optimal testing effect of server performance is achieved.
Patent Information
- Application Number
- CN202311262440.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-27
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2043-09-27
AI Technical Summary
The existing SPEC jbb test suite parameter configuration method cannot enable the server to perform best on the current operating system, affecting the test effect.
By obtaining the configuration instructions entered by the user on the test interface, filter out a set of test parameters that meet preset conditions, and configure the test suite, operating system and development tools based on this parameter to ensure that the test suite runs optimally on the current operating system. .
The best performance of the test suite on the current operating system is achieved, the test results are improved, and the labor and time cost of the performance testing team is saved.
Smart Images

Figure CN117376114B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of server performance testing, and in particular to a parameter configuration method, apparatus, computer equipment and storage medium. Background Art
[0002] SPEC jbb (Standard Performance Evaluation Corporation Java Business Benchmark) is a test suite used to evaluate the performance of a server when processing Java application loads. SPEC jbb can be run on different operating systems for testing.
[0003] Currently, before using the SPEC jbb test suite to test the Java running performance of a server, it is necessary to optimally configure the parameters of the SPEC jbb test suite before conducting an effective test.
[0004] However, the above parameter configuration method cannot enable SPEC jbb to exert the best test performance on the current operating system, thus affecting the test effect. Summary of the invention
[0005] Based on this, it is necessary to provide a parameter configuration method, device, computer equipment and storage medium to address the above technical problems. The parameter configuration method can enable SPEC jbb to perform best test performance on the current operating system and achieve the best test effect.
[0006] In a first aspect, the present application provides a parameter configuration method, the method comprising:
[0007] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0008] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0009] Configure test suites, operating systems, and development tools based on target test parameters.
[0010] The parameter configuration method provided in the embodiment of the present application obtains a target parameter set by responding to the configuration instruction input by the user on the test interface, and screens the target parameter set, screens out a set of test parameters that meet the preset screening conditions as the target test parameters, and then configures the test suite, the operating system and the development tool according to the target test parameters, wherein the target parameter set includes multiple groups of test parameters, and each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool. In the process of configuring the test suite, the above method configures the test suite through the performance parameters of the test suite, the performance parameters of the operating system and the performance parameters of the development tool, which can solve the problem of poor test effect of the test suite caused by the mutual influence between the test suite, the operating system and the development tool to a certain extent. In addition, in the above configuration process, the three parameters of multiple groups are screened to obtain the best set of test parameters, so the use of the best test parameters for parameter configuration can make the test suite play the best test performance on the current operating system, so as to achieve the best test effect.
[0011] In one embodiment, the target parameter set is screened to select a set of test parameters that meet preset screening conditions as target test parameters, including:
[0012] Each group of test parameters in the target parameter set is sequentially loaded into the target test case for testing, and the test results corresponding to each group of test parameters are obtained;
[0013] A set of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters.
[0014] The parameter configuration method provided in the embodiment of the present application can ensure that the target test parameters screened out are the test parameters corresponding to the optimal server performance by screening the target test parameters by testing each group of test parameters.
[0015] In one embodiment, the method further comprises:
[0016] Scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result;
[0017] A set of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters, including:
[0018] A set of test parameters corresponding to the test result with the highest score value is used as the target test parameters.
[0019] In the embodiment of the present application, after the computer device obtains the score values corresponding to each test result, it sorts the score values and uses a group of test parameters corresponding to the test result with the highest score value as the target test parameter. The parameter configuration method provided in the embodiment of the present application selects the target test parameter by scoring the test results corresponding to each group of test parameters, and can ensure that the target test parameter selected is the test parameter corresponding to the optimal server performance.
[0020] In one embodiment, obtaining a target parameter set includes:
[0021] Obtain a first test parameter set, a second test parameter set, and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool;
[0022] According to the preset matching rule, the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set are matched to obtain a target parameter set.
[0023] In one embodiment, according to a preset matching rule, matching parameters in the first test parameter set, parameters in the second test parameter set, and parameters in the third test parameter set to obtain a target parameter set includes:
[0024] For each parameter in the first test parameter set, all parameters in the second test parameter set are matched respectively, and all parameters in the third test parameter set are matched respectively to obtain a target parameter set; the target parameter set includes parameters of multiple groups of test suites, operating system parameters and development tool parameters after matching.
[0025] The parameter configuration method provided in the embodiment of the present application can quickly obtain all parameter combinations by automatically matching the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set, thereby improving the efficiency of parameter screening.
[0026] In one embodiment, the method further comprises:
[0027] Display target parameter set;
[0028] The target parameter set is screened to select a set of test parameters that meet the preset screening conditions as target test parameters, including:
[0029] In response to a screening instruction input by a user in a test interface, a group of test parameters determined by the screening instruction is used as target test parameters.
[0030] The parameter configuration method provided in the embodiment of the present application realizes the screening of target test parameters through human-computer interaction.
[0031] In a second aspect, the present application also provides a parameter configuration device, the device comprising:
[0032] An acquisition module, used to respond to the configuration instructions input by the user on the test interface and acquire a target parameter set; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0033] A screening module is used to screen the target parameter set and select a set of test parameters that meet the preset screening conditions as target test parameters;
[0034] Configuration module, used to configure test suites, operating systems, and development tools according to target test parameters.
[0035] In a third aspect, the present application further provides a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:
[0036] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0037] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0038] Configure test suites, operating systems, and development tools based on target test parameters.
[0039] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0040] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0041] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0042] Configure test suites, operating systems, and development tools based on target test parameters.
[0043] In a fifth aspect, the present application further provides a computer program product, the computer program product comprising a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0044] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0045] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0046] Configure test suites, operating systems, and development tools based on target test parameters.
[0047] The above parameter configuration method, device, computer equipment and storage medium, the method obtains the target parameter set by responding to the configuration instruction input by the user on the test interface, and screens the target parameter set, screens out a set of test parameters that meet the preset screening conditions as the target test parameters, and then configures the test suite, operating system and development tool according to the target test parameters, wherein the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool. In the process of configuring the test suite, the above method configures the test suite through the performance parameters of the test suite, the performance parameters of the operating system and the performance parameters of the development tool, which can solve the problem of poor test effect of the test suite caused by the mutual influence between the test suite, the operating system and the development tool to a certain extent. In addition, in the above configuration process, the three parameters of multiple groups are screened to obtain the best set of test parameters, so the use of the best test parameters for parameter configuration can make the test suite play the best test performance on the current operating system, so as to achieve the best test effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 is an internal structure diagram of a computer device in one embodiment;
[0049] Figure 2 A schematic diagram of a flow chart of a parameter configuration method in an embodiment;
[0050] Figure 3 A schematic flow chart of a parameter configuration method in another embodiment;
[0051] Figure 4 A schematic flow chart of a parameter configuration method in another embodiment;
[0052] Figure 5A schematic flow chart of a parameter configuration method in another embodiment;
[0053] Figure 6 A schematic flow chart of a parameter configuration method in another embodiment;
[0054] Figure 7 A schematic flow chart of a parameter configuration method in another embodiment;
[0055] Figure 8 It is a structural block diagram of a parameter configuration device in one embodiment;
[0056] Fig. 9 It is a structural block diagram of a parameter configuration device in another embodiment;
[0057] Fig.10 It is a structural block diagram of a parameter configuration device in another embodiment;
[0058] Fig.11 It is a structural block diagram of a parameter configuration device in another embodiment;
[0059] Fig.12 It is a structural block diagram of a parameter configuration device in another embodiment. DETAILED DESCRIPTION
[0060] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0061] SPEC jbb (Standard Performance Evaluation Corporation Java Business Benchmark) is a test suite used to evaluate the performance of a server when processing Java application loads. SPEC jbb can be run on different operating systems for testing. Currently, before using the SPEC jbb test suite to test the Java running performance of a server, it is necessary to optimally configure the parameters of the SPEC jbb test suite before conducting effective testing. However, the above parameter configuration method cannot enable SPEC jbb to perform optimal test performance on the current operating system, thus affecting the test results.
[0062] The present application provides a parameter configuration method, aiming to solve the above technical problems. The following embodiments will specifically illustrate the parameter configuration method described in the present application.
[0063] The parameter configuration method provided in the embodiment of the present application can be applied to Figure 1In the computer device shown in the figure, the computer device can be a terminal or a server, and its internal structure diagram can be as shown in FIG. Figure 1 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a parameter configuration method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.
[0064] Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0065] In one embodiment, Figure 2 As shown, a parameter configuration method is provided, which is applied to Figure 1 The computer device in the example is used to illustrate, including the following steps:
[0066] S101, responding to a configuration instruction input by a user on a test interface, and acquiring a target parameter set.
[0067] Among them, the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool. The test suite is a test suite for testing server performance, such as the SPEC jbb test suite, and the test interface is the application interface of the test suite; the operating system can be a Linux operating system or a Windows operating system; the development tool can be a Java development tool or a C language development tool. The parameters of the test suite include at least one of the test parameters such as the number of concurrent threads, the size of the data set, the number of iterations, resource limitations, and the data generation method. The parameters of the operating system include at least one of the process scheduler parameters, the memory management parameters, the file system parameters, the network stack parameters, the device driver parameters, etc. The parameters of the development tool include at least one of the heap-related parameters, the thread-related parameters, the garbage collector-related parameters, the just-in-time compiler-related parameters, and the log-related parameters of the garbage collector. The target parameter set can be input by the user in advance on the test interface, or the user can import a file containing the target parameters in advance. The configuration instruction is used to configure the target parameters of the test suite, the operating system, and the development tool.
[0068] In an embodiment of the present application, a computer device is pre-installed with a test suite and development tools for performance testing of a server. When the computer device starts the test suite, a test interface can be displayed on the current display screen of the computer device, and the user can enter configuration instructions on the test interface to enable the computer device to configure the test suite, the operating system, and the development tools. Specifically, when the computer device receives a configuration instruction entered by the user on the test interface, the target parameter set can be obtained by accessing a database or reading a file. Optionally, several parameters of the test suite can be obtained from the configuration file of the test suite, several parameters of the operating system can be obtained from the relevant configuration files of the local operating system, and several parameters of the development tool can be obtained from the development tool, and then these parameters are arranged and combined, and a target parameter set is generated according to the multiple sets of parameters after the arrangement and combination.
[0069] S102, screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters.
[0070] The preset screening conditions are set to achieve the best test performance of the test suite on the current operating system. The target test parameters are the best set of test suite parameters, operating system parameters, and development tool parameters. These three parameters are used to configure the test suite, operating system, and development tool respectively, so that the performance of the test suite on the server can reach the best state when running large applications under the current operating system.
[0071] In an embodiment of the present application, after the computer device obtains the target parameter set, it can further determine whether each group of parameters in the target parameter set meets the preset filtering conditions. If a group of test parameters in the target parameter set meets the preset filtering conditions, in this scenario, it means that after the test suite, operating system and development tools on the server are configured using the group of test parameters, when the computer device runs the test suite to test the performance of the server, the performance of the server reaches the best. Optionally, when the computer device determines that there are no test parameters in the target parameter set that meet the preset filtering conditions, the computer device can re-acquire the target parameter set, or re-acquire several parameters of the test suite from the configuration file of the test suite, obtain several parameters of the operating system from the relevant configuration file of the local operating system, and obtain several parameters of the development tool, and then arrange and combine these parameters, and generate the target parameter set based on the multiple groups of parameters after the arrangement and combination.
[0072] S103, configuring the test suite, operating system and development tools according to the target test parameters.
[0073] In the embodiment of the present application, after the computer device obtains the target test parameters, it can configure the test suite using the parameters of the test suite, configure the operating system using the parameters of the operating system, and configure the development tool using the parameters of the development tool. Optionally, after the computer device has configured the test suite, the operating system, and the development tool, the computer device can use the test suite to run on the operating system to test the performance of the server.
[0074] The parameter configuration method provided in the embodiment of the present application obtains a target parameter set by responding to the configuration instruction input by the user on the test interface, and screens the target parameter set, screens out a set of test parameters that meet the preset screening conditions as the target test parameters, and then configures the test suite, the operating system and the development tool according to the target test parameters, wherein the target parameter set includes multiple groups of test parameters, and each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool. In the process of configuring the test suite, the above method configures the test suite through the performance parameters of the test suite, the performance parameters of the operating system and the performance parameters of the development tool, which can solve the problem of poor test effect of the test suite caused by the mutual influence between the test suite, the operating system and the development tool to a certain extent. In addition, in the above configuration process, the three parameters of multiple groups are screened to obtain the best set of test parameters, so the use of the best test parameters for parameter configuration can make the test suite play the best test performance on the current operating system, so as to achieve the best test effect.
[0075] In one embodiment, a specific implementation method for obtaining target test parameters is also provided, such as Figure 3 As shown, the above step S102 of "screening the target parameter set to screen out a set of test parameters that meet the preset screening conditions as target test parameters" includes:
[0076] S201, loading each group of test parameters in the target parameter set into the target test case in sequence for testing, and obtaining the test results corresponding to each group of test parameters.
[0077] The target test case is a test case that matches the current test suite, the current operating system, and the current development tool. The test result is at least one of CPU throughput, response time, CPU occupancy, etc., and can also be a score after scoring the server performance.
[0078] In an embodiment of the present application, after the computer device obtains the target parameter set, the parameters of the test suite in each group of test parameters are loaded into the parameter configuration position corresponding to the test suite in the target test case, the parameters of the operating system in each group of test parameters are loaded into the parameter configuration position corresponding to the operating system in the target test case, and the parameters of the development tool in each group of test parameters are loaded into the parameter configuration position corresponding to the development tool in the target test case. After the loading is completed, the server can be tested to obtain the test results.
[0079] S202: A group of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters.
[0080] The preset screening condition may be at least one of a preset CPU throughput threshold, a preset response time threshold, a preset CPU occupancy threshold, etc., or may be a preset score threshold after scoring the server performance.
[0081] In the embodiment of the present application, the computer device determines the preset screening condition in advance according to at least one of CPU throughput, response time, CPU occupancy rate, etc., or according to the score after the server performance is scored according to CPU throughput, response time, and CPU occupancy rate. After obtaining multiple test results, the computer device further determines whether the CPU throughput in the test result meets the preset CPU throughput threshold, whether the response time meets the preset response time threshold, and whether the CPU occupancy rate meets the preset CPU occupancy rate threshold, and uses one or more groups of test parameters corresponding to the test result that meets the preset screening condition as the target test parameter. Optionally, the performance of the server can also be scored according to CPU throughput, response time, and CPU occupancy rate to obtain a score value, and then determine whether the score meets the preset score threshold, and use one or more groups of test parameters corresponding to the test result that meets the preset score threshold as the target test parameter. The parameter configuration method provided in the embodiment of the present application screens the target test parameter by testing each group of test parameters, and can ensure that the target test parameter is screened out as the test parameter corresponding to the optimal server performance.
[0082] In one embodiment, a specific implementation method for scoring the test results to obtain the target test parameters is also provided, such as Figure 4 As shown, Figure 2 The method described in the embodiment also includes:
[0083] S203, scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result.
[0084] In an embodiment of the present application, the computer device scores the test results corresponding to each group of test parameters according to the degree of proximity to the target test results, and obtains the score value corresponding to each test result. Specifically, the CPU throughput, response time, and CPU occupancy rate corresponding to each group of test parameters are compared with the target CPU throughput, target response time, and target CPU occupancy rate, respectively, and the CPU throughput is scored according to the degree of proximity to the CPU throughput, the response time is scored according to the degree of proximity to the target response time, and the CPU occupancy rate is scored according to the degree of proximity to the target CPU occupancy rate, and the score value corresponding to each test result is obtained. For example, when the CPU occupancy rate is equal to the target CPU throughput, the response time is equal to the target response time, and the CPU occupancy rate is equal to the target CPU occupancy rate, the score value of the test result corresponding to the group of test parameters is 100 points.
[0085] Correspondingly, when the computer device executes step S202 "using a set of test parameters corresponding to the test results that meet the preset screening conditions as target test parameters", the specific execution steps are: using a set of test parameters corresponding to the test result with the highest score value as the target test parameters.
[0086] In the embodiment of the present application, after the computer device obtains the score values corresponding to each test result, it sorts the score values and uses a group of test parameters corresponding to the test result with the highest score value as the target test parameter. The parameter configuration method provided in the embodiment of the present application selects the target test parameter by scoring the test results corresponding to each group of test parameters, and can ensure that the target test parameter selected is the test parameter corresponding to the optimal server performance.
[0087] In one embodiment, a specific implementation method for obtaining a target parameter set is also provided, such as Figure 5 As shown, the "obtaining a target parameter set" in the above step S101 includes:
[0088] S301, obtain a first test parameter set, a second test parameter set and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool.
[0089] Among them, the first test parameter set includes at least one of the test parameters such as the number of concurrent threads, the size of the data set, the number of iterations, the resource limit, and the data generation method. For example, the first test parameter set: the number of concurrent threads is 1, or the number of concurrent threads is 2, or the number of concurrent threads is 3; the data set size is the data set size 1, or the data set size 2, or the data set size 3; the number of iterations is the number of iterations 1, or the number of iterations 2; the resource limit is the resource limit 1, or the resource limit 2; the data generation method is the data generation method 1, or the data generation method 2. The second test parameter set includes at least one of the process scheduler parameters, memory management parameters, file system parameters, network stack parameters, device driver parameters, etc. For example, the second test parameter set: process scheduler parameter A, or process scheduler parameter B; memory management parameter A, or memory management parameter B, or memory management parameter C; file system parameter A, or file system parameter B; network stack parameter A, or network stack parameter B; device driver parameter A, or device driver parameter B, or device driver parameter C. The third test parameter set includes at least one of heap-related parameters, thread-related parameters, garbage collector-related parameters, just-in-time compiler-related parameters, and log-related parameters of the garbage collector, etc. For example, the third test parameter set includes: heap-related parameter a, or heap-related parameter b; thread-related parameter a, or thread-related parameter b, or thread-related parameter c; garbage collector-related parameter a, or garbage collector-related parameter b; just-in-time compiler-related parameter a, or just-in-time compiler-related parameter b; and log-related parameter a of the garbage collector.
[0090] In an embodiment of the present application, a computer device obtains a first test parameter set, a second test parameter set, and a third test parameter set input by a user, or obtains a file imported by a user containing the first test parameter set, the second test parameter set, and the third test parameter set, and then parses the file to obtain the first test parameter set, the second test parameter set, and the third test parameter set.
[0091] S302: According to a preset matching rule, parameters in the first test parameter set, parameters in the second test parameter set, and parameters in the third test parameter set are matched to obtain a target parameter set.
[0092] Among them, the preset matching rules may include a rule for matching any one parameter in the first test parameter set, the second test parameter set and the third test parameter set, or may include a rule for matching each parameter in the first test parameter set, the second test parameter set and the third test parameter set in sequence.
[0093] In an embodiment of the present application, the computer device can match parameters in the same row in the first test parameter set as a group of test parameters, match parameters in the same row in the second test parameter set as a group of test parameters, and match parameters in the same row in the third test parameter set as a group of test parameters, and generate a target parameter set based on all matched groups of test parameters.
[0094] Optionally, the above-mentioned preset matching rules may be permutation and combination rules. Accordingly, when the computer device executes the above-mentioned step S302 of "matching the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set according to the preset matching rules to obtain the target parameter set", the specific execution steps are: for each parameter in the first test parameter set, all the parameters in the second test parameter set are matched respectively, and all the parameters in the third test parameter set are matched respectively to obtain the target parameter set; the target parameter set includes the parameters of the multiple groups of test suites, the parameters of the operating system, and the parameters of the development tools after matching.
[0095] In the embodiment of the present application, after the computer device obtains the first test parameter set, the second test parameter set and the third test parameter set, it can arrange and combine the first test parameter set, the second test parameter set and the third test parameter set according to the preset matching rule to obtain multiple sets of target parameter sets. Specifically, a set of parameters is selected from the multiple sets of parameter combinations in the first test parameter set, a set of parameters is selected from the multiple sets of parameter combinations in the second test parameter set, and then a set of parameters is selected from the multiple sets of parameter combinations in the third test parameter set, and then the set of parameters is recombined to obtain the target parameter set. For example, the first test parameter set is the number of concurrent threads 1, data set size 2, number of iterations 1, resource limit 1, and data generation method 2; the second test parameter set is process scheduler parameter B, memory management parameter A, file system parameter A, network stack parameter B, and device driver parameter C; the third test parameter set is heap-related parameter a, thread-related parameter a, garbage collector-related parameter a, just-in-time compiler-related parameter a, and garbage collector log-related parameter a. Then, the target parameter set is the number of concurrent threads 1, data set size 2, number of iterations 1, resource limit 1, data generation method 2, process scheduler parameter B, memory management parameter A, file system parameter A, network stack parameter B, device driver parameter C, heap-related parameter a, thread-related parameter a, garbage collector-related parameter a, just-in-time compiler-related parameter a, and garbage collector log-related parameter a.
[0096] The parameter configuration method provided in the embodiment of the present application can quickly obtain all parameter combinations by automatically matching the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set, thereby improving the efficiency of parameter screening.
[0097] In one embodiment, a specific implementation method for determining target test parameters according to the screening instruction is also provided, such as Figure 6 As shown, Figure 2 The method described in the embodiment also includes:
[0098] S104, displaying a target parameter set.
[0099] In an embodiment of the present application, after obtaining multiple sets of target parameter sets, the computer device can display each set of target parameter sets on a test interface to facilitate the user to select the test parameters.
[0100] Correspondingly, when the computer device executes step S102 "filtering the target parameter set to filter out a set of test parameters that meet the preset filtering conditions as target test parameters", the specific execution steps are: responding to the filtering instructions input by the user in the test interface, and using the set of test parameters determined by the filtering instructions as the target test parameters.
[0101] The filtering instruction refers to the filtering operation instruction performed by the user on the test parameters.
[0102] In the embodiment of the present application, after the computer device receives the screening instruction input by the user in the test interface and obtains the test parameters selected by the user in the target parameter set, the computer device uses the set of test parameters as the target test parameters to configure the test suite, operating system and development tools. The parameter configuration method provided in the embodiment of the present application realizes the screening of target test parameters through human-computer interaction.
[0103] Based on all the above embodiments, a parameter configuration method is also provided. Figure 7 As shown, the method includes:
[0104] S401, in response to a configuration instruction input by a user on a test interface, a first test parameter set, a second test parameter set, and a third test parameter set are obtained. The first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool.
[0105] S402, for each parameter in the first test parameter set, respectively match all parameters in the second test parameter set, and respectively match all parameters in the third test parameter set, to obtain a target parameter set. The target parameter set includes parameters of multiple groups of test suites, operating system parameters, and development tool parameters after matching;
[0106] S403, loading each group of test parameters in the target parameter set into the target test case in sequence for testing, and obtaining the test results corresponding to each group of test parameters.
[0107] S404, scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result.
[0108] S405: Use a group of test parameters corresponding to the test result with the highest score as target test parameters.
[0109] S406, displaying a target parameter set;
[0110] S407, responding to the screening instruction input by the user in the test interface, taking a group of test parameters determined by the screening instruction as target test parameters.
[0111] S408, configuring the test suite, operating system and development tools according to the target test parameters.
[0112] The methods described in the above steps are all described in the above embodiments. Please refer to the above description for details and will not be repeated here.
[0113] The parameter configuration method provided in the embodiment of the present application automatically screens out the best performance parameters corresponding to the current server performance test, thereby saving the manpower and time costs of the performance test team and improving work efficiency. In addition, the above method makes up for the deficiency of the single test parameter verification in the original SPEC jbb test, and provides a variety of performance parameter combinations for the performance test of the server, so as to find the optimal performance parameters and achieve the optimal configuration.
[0114] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0115] Based on the same inventive concept, the embodiment of the present application also provides a parameter configuration device for implementing the parameter configuration method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more parameter configuration device embodiments provided below can refer to the limitations on the parameter configuration method above, and will not be repeated here.
[0116] In one embodiment, Figure 8 As shown, a parameter configuration device is provided, comprising:
[0117] The acquisition module 10 is used to respond to the configuration instructions input by the user on the test interface and acquire a target parameter set; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0118] A screening module 11 is used to screen the target parameter set and select a set of test parameters that meet preset screening conditions as target test parameters;
[0119] The configuration module 12 is used to configure the test suite, operating system and development tools according to the target test parameters.
[0120] In one embodiment, Fig. 9 As shown, the screening module 11 includes:
[0121] The testing unit 110 is used to load each group of test parameters in the target parameter set into the target test case in sequence for testing, and obtain the test results corresponding to each group of test parameters.
[0122] The determination unit 111 is configured to use a group of test parameters corresponding to the test results that meet the preset screening conditions as target test parameters.
[0123] In one embodiment, Fig.10 As shown, the above screening module 11 further includes:
[0124] The scoring unit 112 is used to score the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result.
[0125] Correspondingly, the determination unit 111 is specifically configured to use a group of test parameters corresponding to the test result with the highest score value as the target test parameters.
[0126] In one embodiment, Fig.11 As shown, the acquisition module 10 includes:
[0127] The acquisition unit 100 is used to acquire a first test parameter set, a second test parameter set and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool.
[0128] The matching unit 101 is used to match the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set according to a preset matching rule to obtain a target parameter set.
[0129] In one embodiment, the above-mentioned matching unit 101 is specifically used to match all parameters in the second test parameter set and all parameters in the third test parameter set for each parameter in the first test parameter set to obtain a target parameter set; the target parameter set includes parameters of multiple groups of test suites, operating system parameters and development tool parameters after matching.
[0130] In one embodiment, Fig.12 As shown, the above parameter configuration device also includes:
[0131] The display module 13 is used to display the target parameter set.
[0132] Correspondingly, the above-mentioned screening module 11 is specifically used to respond to the screening instruction input by the user in the test interface, and use a group of test parameters determined by the screening instruction as the target test parameters.
[0133] Each module in the above parameter configuration device can be implemented in whole or in part by software, hardware and a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.
[0134] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:
[0135] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0136] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0137] Configure test suites, operating systems, and development tools based on target test parameters.
[0138] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0139] Each group of test parameters in the target parameter set is sequentially loaded into the target test case for testing, and the test results corresponding to each group of test parameters are obtained;
[0140] A set of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters.
[0141] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0142] Scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result;
[0143] A set of test parameters corresponding to the test result with the highest score value is used as the target test parameters.
[0144] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0145] Obtain a first test parameter set, a second test parameter set, and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool;
[0146] According to the preset matching rule, the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set are matched to obtain a target parameter set.
[0147] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0148] For each parameter in the first test parameter set, all parameters in the second test parameter set are matched respectively, and all parameters in the third test parameter set are matched respectively to obtain a target parameter set; the target parameter set includes parameters of multiple groups of test suites, operating system parameters and development tool parameters after matching.
[0149] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0150] Display target parameter set;
[0151] The target parameter set is screened to select a set of test parameters that meet the preset screening conditions as target test parameters, including:
[0152] In response to a screening instruction input by a user in a test interface, a group of test parameters determined by the screening instruction is used as target test parameters.
[0153] The above embodiment provides a computer device, whose implementation principle and technical effect are similar to those of the above method embodiment, and will not be repeated here.
[0154] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0155] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0156] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0157] Configure test suites, operating systems, and development tools based on target test parameters.
[0158] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0159] Each group of test parameters in the target parameter set is sequentially loaded into the target test case for testing, and the test results corresponding to each group of test parameters are obtained;
[0160] A set of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters.
[0161] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0162] Scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result;
[0163] A set of test parameters corresponding to the test result with the highest score value is used as the target test parameters.
[0164] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0165] Obtain a first test parameter set, a second test parameter set, and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool;
[0166] According to the preset matching rule, the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set are matched to obtain a target parameter set.
[0167] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0168] For each parameter in the first test parameter set, all parameters in the second test parameter set are matched respectively, and all parameters in the third test parameter set are matched respectively to obtain a target parameter set; the target parameter set includes parameters of multiple groups of test suites, operating system parameters and development tool parameters after matching.
[0169] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0170] Display target parameter set;
[0171] The target parameter set is screened to select a set of test parameters that meet the preset screening conditions as target test parameters, including:
[0172] In response to a screening instruction input by a user in a test interface, a group of test parameters determined by the screening instruction is used as target test parameters.
[0173] The above embodiment provides a computer-readable storage medium, whose implementation principle and technical effect are similar to those of the above method embodiment, and will not be repeated here.
[0174] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:
[0175] In response to the configuration instructions input by the user on the test interface, a target parameter set is obtained; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool;
[0176] Screening the target parameter set to select a set of test parameters that meet preset screening conditions as target test parameters;
[0177] Configure test suites, operating systems, and development tools based on target test parameters.
[0178] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0179] Each group of test parameters in the target parameter set is sequentially loaded into the target test case for testing, and the test results corresponding to each group of test parameters are obtained;
[0180] A set of test parameters corresponding to the test results that meet the preset screening conditions are used as target test parameters.
[0181] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0182] Scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result;
[0183] A set of test parameters corresponding to the test result with the highest score value is used as the target test parameters.
[0184] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0185] Obtain a first test parameter set, a second test parameter set, and a third test parameter set; the first test parameter set is a test parameter set of a test suite, the second test parameter set is a test parameter set of an operating system, and the third test parameter set is a test parameter set of a development tool;
[0186] According to the preset matching rule, the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set are matched to obtain a target parameter set.
[0187] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0188] For each parameter in the first test parameter set, all parameters in the second test parameter set are matched respectively, and all parameters in the third test parameter set are matched respectively to obtain a target parameter set; the target parameter set includes parameters of multiple groups of test suites, operating system parameters and development tool parameters after matching.
[0189] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0190] Display target parameter set;
[0191] The target parameter set is screened to select a set of test parameters that meet the preset screening conditions as target test parameters, including:
[0192] In response to a screening instruction input by a user in a test interface, a group of test parameters determined by the screening instruction is used as target test parameters.
[0193] The above embodiment provides a computer program product, whose implementation principle and technical effect are similar to those of the above method embodiment, and will not be repeated here.
[0194] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0195] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0196] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A parameter configuration method, characterized in that: The method comprises: In response to a configuration instruction input by a user on a test interface, a plurality of parameters of the test suite are obtained from a configuration file of the test suite, a plurality of parameters of the operating system are obtained from a related configuration file of the local operating system, and a plurality of parameters of the development tool are obtained from the development tool, so as to obtain a target parameter set; the target parameter set includes a plurality of groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system and parameters of the development tool; By testing the multiple groups of test parameters and screening the test parameters of all groups in the target parameter set according to the test results, a group of test parameters that meet the preset screening conditions are screened out as target test parameters; the preset screening conditions are set with the goal of achieving the best test performance of the test suite on the current operating system; the preset screening conditions are determined according to CPU throughput, response time, and CPU occupancy; The test suite is configured according to the parameters of the test suite in the target test parameters, the operating system is configured according to the parameters of the operating system in the target test parameters, and the development tool is configured according to the parameters of the development tool in the target test parameters to obtain a configured test suite, a configured operating system and a configured development tool, and the configured test suite is used to run on the configured operating system to test the performance of the server; the performance of the server is the server performance corresponding to the configured development tool.
2. The method according to claim 1, characterized in that The screening process of the target parameter set to screen out a set of test parameters that meet preset screening conditions as target test parameters includes: Loading each group of test parameters in the target parameter set into the target test case in turn for testing, and obtaining the test results corresponding to each group of test parameters; A set of test parameters corresponding to the test results that meet the preset screening conditions is used as the target test parameters.
3. The method according to claim 2, characterized in that The method further comprises: Scoring the test results corresponding to each group of test parameters to obtain a score value corresponding to each test result; The step of taking a set of test parameters corresponding to the test results that meet the preset screening conditions as the target test parameters includes: A set of test parameters corresponding to the test result with the highest score value is used as the target test parameters.
4. The method according to any one of claims 1 to 3, characterized in that: The obtaining of the target parameter set includes: Acquire a first test parameter set, a second test parameter set, and a third test parameter set; the first test parameter set is a test parameter set of the test suite, the second test parameter set is a test parameter set of the operating system, and the third test parameter set is a test parameter set of the development tool; According to a preset matching rule, the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set are matched to obtain the target parameter set.
5. The method according to claim 4, characterized in that The matching of the parameters in the first test parameter set, the parameters in the second test parameter set, and the parameters in the third test parameter set according to the preset matching rule to obtain the target parameter set includes: For each parameter in the first test parameter set, all parameters in the second test parameter set are matched respectively, and all parameters in the third test parameter set are matched respectively to obtain the target parameter set; the target parameter set includes the parameters of multiple groups of test suites after matching, the parameters of the operating system and the parameters of the development tool.
6. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: displaying the target parameter set; The screening process of the target parameter set to screen out a set of test parameters that meet preset screening conditions as target test parameters includes: In response to a screening instruction input by the user in the test interface, a group of test parameters determined by the screening instruction is used as the target test parameters.
7. A parameter configuration device, characterized in that: The device comprises: an acquisition module, for responding to a configuration instruction input by a user on a test interface, acquiring multiple parameters of the test suite from a configuration file of the test suite, acquiring multiple parameters of the operating system from a related configuration file of the local operating system, and acquiring multiple parameters of the development tool from the development tool, so as to acquire a target parameter set; the target parameter set includes multiple groups of test parameters, each group of test parameters includes parameters of the test suite, parameters of the operating system, and parameters of the development tool; A screening module is used to test the multiple groups of test parameters and screen the test parameters of all groups in the target parameter set according to the test results, and screen out a group of test parameters that meet preset screening conditions as target test parameters; the preset screening conditions are conditions set with the goal of achieving the best test performance of the test suite on the current operating system; the preset screening conditions are determined according to CPU throughput, response time and CPU occupancy; A configuration module is used to configure the test suite according to the parameters of the test suite in the target test parameters, configure the operating system according to the parameters of the operating system in the target test parameters, and configure the development tool according to the parameters of the development tool in the target test parameters, to obtain a configured test suite, a configured operating system and a configured development tool, and use the configured test suite to run on the configured operating system to test the performance of the server; the performance of the server is the server performance corresponding to the configured development tool.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Method and device for determining operation parameters of application program, terminal and storage medium
CN109710330A
Operating system performance tuning device and method, equipment and storage medium
CN114138597A
JVM parameter testing method and device and electronic equipment
CN115495333A
Low-cost high-dimensional multi-target software configuration parameter tuning method and system
CN116107664A
Optimizing cache efficiency within application software
US20040205307A1
