Component performance statistical methods, devices, systems, electronic equipment and storage media
By using an automated component performance statistics method and filtering server performance test data using performance parameter attribute tables and configuration information, the problem of low accuracy and efficiency caused by large data volume is solved, and fast and accurate performance test results are generated.
Patent Information
- Application Number
- CN202211711018.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-29
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-12-29
AI Technical Summary
Existing technologies involve large amounts of server performance test data, which reduces the accuracy and efficiency of performance testing and relies too heavily on subjective human judgment.
A component performance statistics method is provided, which obtains component operation data under the target storage path corresponding to the target project, filters the actual performance test data using performance parameter attribute table and configuration information, performs automated performance test result statistics and comparison, and generates performance test results.
It improves the accuracy and efficiency of performance testing, enabling quick identification of the performance of test components under specific configurations without manual screening, and supports rapid reference for other test items.
Smart Images

Figure CN116126614B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of server integration testing technology, and in particular to a component performance statistics method, apparatus, system, electronic device, and storage medium. Background Technology
[0002] The demand for server products is becoming increasingly diversified. General-purpose server products are being configured with more and more features, supporting more and more components, and each component has many models. Moreover, as the application of servers becomes more and more widespread, server performance is closely related to server configuration, which also presents new challenges for server performance testing and the statistical analysis of performance test results.
[0003] Currently, server performance testing is generally conducted by manually or automatically executing performance test scripts. The data generated by the tests is stored in a designated folder or file on the server. Then, the data in the folder is manually sorted and organized according to the server's test configuration and various performance tests.
[0004] Because the processing of server performance test data involves many test configurations, components, and performance data of various types, as well as performance differences between configurations, the workload of manually processing the raw performance data is enormous. Moreover, relying too much on subjective human judgment can easily lead to a decrease in the accuracy and efficiency of performance testing. Summary of the Invention
[0005] This invention provides a component performance statistics method, apparatus, system, electronic device, and storage medium to address the shortcomings of existing technologies where large amounts of data during testing lead to reduced accuracy and efficiency in performance testing.
[0006] This invention provides a method for statistical analysis of component performance, comprising:
[0007] If it is determined that the component to be tested matches at least one target project component list, the first component running data is obtained from the target storage path corresponding to each target project.
[0008] For the same target project, the performance test result of the component to be tested is determined based on the operating data of the first component corresponding to the target project;
[0009] For different target projects, the performance test results of the component under test are determined based on the operating data of the first component corresponding to each target project.
[0010] The target project component list is determined based on the server's test projects; the target storage path is the data storage address generated by each component under the target project component list during performance testing.
[0011] According to a component performance statistics method provided by the present invention, determining the performance test result of the component under test based on the first component operating data corresponding to the target project for the same target project includes:
[0012] Based on the performance parameter attribute table and configuration information, the first performance test data is filtered out from the first component's operating data;
[0013] The first performance test data is statistically analyzed to obtain the first performance test results;
[0014] The first performance test result includes actual performance test data of the test components with different configurations under the same target project; the configuration information is determined based on the server configuration; the performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information; and the performance parameter information is determined based on the performance test fields corresponding to the components.
[0015] According to a component performance statistics method provided by the present invention, determining the performance test result of the component under test based on the first component operating data corresponding to the target project for the same target project includes:
[0016] Based on the performance parameter attribute table and configuration information, the second performance test data is filtered out from the first component's operating data;
[0017] The second performance test results are obtained by comparing the performance reference values with the second performance measured data.
[0018] Wherein, the performance reference value is generated by the target project under the current configuration; the second performance test result includes the actual performance test data of the target project regarding the component under test under the current configuration; the configuration information is determined according to the server configuration; the performance parameter attribute table is determined according to the correspondence between performance parameter information and configuration information; the performance parameter information is determined according to the performance test field corresponding to the component.
[0019] According to a component performance statistical method provided by the present invention, the step of determining the performance test result of the component under test based on the first component operating data corresponding to each of the different target projects includes:
[0020] Based on the performance parameter attribute table and configuration information, the third performance test data is filtered out from the first component's operating data;
[0021] The measured data of the third performance are statistically analyzed to obtain the third performance test results;
[0022] The third performance test result includes actual performance data of the tested components with the same configuration under different test items; the configuration information is determined based on the server configuration; the performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information; and the performance parameter information is determined based on the performance test fields corresponding to the components.
[0023] According to a component performance statistics method provided by the present invention, before obtaining the first component operation data from the target storage path corresponding to each of the target items, the method further includes:
[0024] Use the execution log to retrieve the configuration information corresponding to the target project;
[0025] Based on the configuration information corresponding to the target project, the nested folders constructed for all components contained under the target project will be used as the storage path;
[0026] The target storage path is one or more nested folders within the storage path.
[0027] According to a component performance statistics method provided by the present invention, before matching the component under test to at least one target item component list, the method further includes:
[0028] Organize the names of the test fields for each component and generate a performance table;
[0029] Associate the performance configurations involved in each performance parameter in the performance table with their corresponding performance reference values to generate a performance parameter attribute table;
[0030] The performance table and the performance parameter attribute table are decomposed and correlated to statistically determine the performance judgment strategy for each performance parameter under the corresponding performance configuration.
[0031] The component performance statistical method provided by the present invention further includes:
[0032] If it is determined that the component to be tested does not match the target project component list corresponding to the target project, the system receives the second component operation data corresponding to the component to be tested sent by the user terminal.
[0033] Based on the operating data of the second component, the performance test results of the component under test are determined.
[0034] According to a component performance statistical method provided by the present invention, after determining the performance test results of the component under test, the method further includes:
[0035] The performance test results of the component under test are updated to the target project component list, or plotted as a visual curve.
[0036] The present invention also provides a component performance statistics device, comprising:
[0037] The data acquisition module is used to acquire the first component's running data from the target storage path corresponding to each target project when it is determined that the component to be tested matches at least one target project's corresponding target project component list;
[0038] The first performance testing module is used to determine the performance test results of the component to be tested based on the running data of the first component corresponding to the target project for the same target project.
[0039] The second performance testing module is used to determine the performance test results of the component under test based on the running data of the first component corresponding to each of the target projects for different target projects.
[0040] The target project component list is determined based on the server's test projects; the target storage path is the data storage address generated by each component under the target project component list during performance testing.
[0041] The present invention also provides a component performance statistics system, including a remote terminal and a server, wherein the remote terminal is used to execute the component performance statistics method as described in any of the preceding claims.
[0042] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the program, implements the component performance statistics method as described above.
[0043] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the component performance statistics method as described above.
[0044] The component performance statistics method, apparatus, system, electronic device, and storage medium provided by this invention utilize the component under test to quickly identify its performance testing environment and extract the first component's operating data from the target storage path corresponding to that testing environment, thereby obtaining the component's performance test results under the corresponding configuration. This allows for rapid identification of the component's performance in a specific test configuration, eliminating the need for manual sifting of test results from a large number of test reports. It facilitates the tracking of component performance and provides rapid data support for other test projects. Attached Figure Description
[0045] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0046] Figure 1 This is a flowchart illustrating the component performance statistical method provided by the present invention;
[0047] Figure 2 This is a schematic diagram of the component performance statistics device provided by the present invention;
[0048] Figure 3 This is a schematic diagram of the component performance statistics system provided by the present invention;
[0049] Figure 4 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation
[0050] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0051] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more.
[0052] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used herein, unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “the” are intended to include the plural forms.
[0053] The terms “comprising” and “including” indicate the presence of the described feature, whole, step, operation, element and / or component, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or collections thereof.
[0054] Figure 1This is a flowchart illustrating the component performance statistical method provided by the present invention. Figure 1 As shown, the component performance statistics method provided in this embodiment of the invention includes: step 101, in the case that the component to be tested matches at least one target item corresponding to the target item component list, obtaining the first component running data from the target storage path corresponding to each target item.
[0055] The target project component list is determined based on the server's test projects. The target storage path is the data storage address for each component under the target project component list corresponding to the target project during performance testing.
[0056] It should be noted that the execution subject of the component performance statistics method provided in this embodiment of the invention is the electronic device on which the component performance statistics device relies.
[0057] The application scenario of the component performance statistics method provided in this embodiment of the invention is to collect performance data, analyze performance data, analyze performance differences, automatically output performance test reports, reflect the performance differences in different test configurations, and provide analysis results of performance differences from the differences in test configurations.
[0058] It should be noted that the target project component list refers to a list generated by summarizing all components involved in the test project corresponding to the server.
[0059] During performance testing of the test project, the files or data generated under the test project are stored in a fixed folder corresponding to the project. Within this folder, nested folders are used to assign corresponding target storage paths to each component in the target project component list for the storage of the corresponding component's running data.
[0060] Specifically, in step 101, the component performance statistics device uses the name of the component to be tested to perform a query.
[0061] If the query is successful, it means that the component to be tested is recorded in the target project component list corresponding to the test project of at least one server. Then, the first component running data of the component can be obtained from the folder of the test project corresponding to the target project component list, through the target storage path corresponding to the component to be tested.
[0062] If the query fails, it means that the component to be tested is not recorded in the target component list of any server's test project, and there is no need to perform subsequent performance statistics.
[0063] Step 102-1: For the same target project, determine the performance test result of the component to be tested based on the first component operation data corresponding to the target project.
[0064] Specifically, in step 102-1, the component performance statistics device associates the configuration information of a single target project with the first component's operating data to obtain the relevant performance data of the component to be tested with the specified configuration in the test project corresponding to the server, so as to integrate it into the performance test result output.
[0065] Step 102-2: For different target projects, determine the performance test results of the component to be tested based on the operating data of the first component corresponding to each target project.
[0066] Specifically, in step 102-2, the component performance statistics device associates the configuration information corresponding to each of the multiple target items with the first component operation data to obtain the relevant performance data of the component under test with the specified configuration in the multiple test items corresponding to the server, and performs a performance comparison between the multiple items regarding the component under test, so as to integrate it into the performance test result output.
[0067] This invention utilizes the component under test to quickly identify its performance testing environment and extracts the component's runtime data from the target storage path corresponding to that testing environment, thus obtaining the component's performance test results under the corresponding configuration. This allows for rapid identification of the component's performance in a specific test configuration, eliminating the need for manual sifting of test results from a large number of test reports. It facilitates tracking the performance of the tested component and provides rapid data support for other test projects.
[0068] Based on any of the above embodiments, determining the performance test result of the component to be tested based on the first component's operating data corresponding to the same target project includes: filtering first performance test data from the first component's operating data based on the performance parameter attribute table and configuration information.
[0069] The first performance test result includes measured performance data of the tested components with different configurations under the same target project. The configuration information is determined based on the server configuration. The performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information. The performance parameter information is determined based on the performance test fields corresponding to the components.
[0070] It should be noted that before step 102-1, the performance reference values and performance parameter attribute tables of each component need to be determined, and these performance reference values and performance parameter attribute tables of the components need to be uploaded to the database built into the component performance statistics device, so as to determine the relevant configuration requirements of the component to be tested by means of the correspondence between the performance parameter information and configuration information recorded in the performance parameter attribute table.
[0071] The performance parameter information involves sorting out the key performance fields involved in the performance testing of server components (including but not limited to CPU, memory, network card, hard drive, RAID card, GPU, HCA card, NVMe disk, SAS card, graphics card, backplane, USB, PCIe slot, etc.) and matching the sorted performance parameter information with the corresponding key performance fields.
[0072] Specifically, in step 102-1, the component performance statistics device filters out performance data from the first component operation data under the corresponding test item obtained from the fixed folder based on the performance parameter information recorded in the performance parameter attribute table. Then, it extracts the key performance fields of the performance data in combination with the configuration information, and outputs the actual performance values under different configurations of the generated project as the first actual performance data.
[0073] The first performance test data is statistically analyzed to obtain the first performance test results.
[0074] Specifically, the component performance statistics device statistically analyzes the first performance measured data that changes over time, and obtains the statistical results of the performance measured data of a certain component under a single test item as the first performance test result output.
[0075] The embodiments of the present invention do not specifically limit the output format of the first performance test results.
[0076] For example, the first performance test data obtained by comparing the performance parameters of the same CPU with different memory in the same project can be fitted into a corresponding performance change curve for front-end display.
[0077] This invention utilizes performance parameter attribute tables and configuration information to quickly extract the first measured performance data of a single test item under a corresponding configuration, and statistically analyzes the first performance test results over time. This improves the accuracy and efficiency of performance testing while also quickly compiling performance test results for components with different configurations under the same project. Furthermore, it allows for horizontal comparison of performance test results for components with different configurations under the same project, effectively addressing the deficiency of being unable to track the performance testing status of test components due to redundancy in performance test results.
[0078] Based on any of the above embodiments, determining the performance test result of the component to be tested based on the first component operation data corresponding to the same target project includes: filtering out second performance test data from the first component operation data based on the performance parameter attribute table and configuration information.
[0079] The second performance test result includes measured performance data of the target project for the tested component under the current configuration. The configuration information is determined based on the server configuration. The performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information. The performance parameter information is determined based on the performance test fields corresponding to the component.
[0080] Specifically, in step 102-1, the component performance statistics device filters out the performance data from the first component operation data obtained from the fixed folders corresponding to different projects based on the performance parameter information recorded in the performance parameter attribute table. Then, it extracts the key performance fields of the performance data in combination with the specified configuration information, and outputs the generated actual performance values under the same configuration on different projects as the second actual performance data.
[0081] The second performance test results are obtained by comparing the second performance test data with the performance reference value.
[0082] The performance reference value is generated by the target project under the current configuration;
[0083] Specifically, the component performance statistics device compares the performance reference value of the component under test with the performance judgment standard corresponding to the configuration information, and the selected second performance test data. The performance test data of the component under test with the same configuration under different test items obtained by comparison is output as the second performance test result.
[0084] The embodiments of the present invention do not specifically limit the output format of the second performance test results.
[0085] For example, the second performance test data obtained by comparing the performance parameters of the same CPU model and the same memory on motherboards of different projects can be fitted into a corresponding table for front-end display.
[0086] This invention utilizes performance parameter attribute tables and configuration information to quickly extract second performance test data for test items composed of different components under the same configuration. It then performs a longitudinal comparison with performance reference values to obtain second performance test results for the same configuration under different test items. This improves the accuracy and efficiency of performance testing while quickly compiling performance test results for components with the same configuration under different items. Furthermore, it enables longitudinal comparison of these results, effectively addressing the deficiency of being unable to track the performance test status of test components due to redundancy in performance test results.
[0087] Based on any of the above embodiments, the step of determining the performance test results of the component to be tested based on the first component operation data corresponding to each of the target projects includes: filtering out third performance test data from the first component operation data based on the performance parameter attribute table and configuration information.
[0088] The third performance test results include measured performance data of the tested components with the same configuration under different test items. The configuration information is determined based on the server configuration. The performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information. The performance parameter information is determined based on the performance test fields corresponding to the components.
[0089] Specifically, in step 102-2, the component performance statistics device filters out performance data from the first component operation data under multiple different test items obtained from a fixed folder based on the performance parameter information recorded in the performance parameter attribute table. Then, it extracts key performance fields from the performance data in combination with the configuration information, and outputs the actual performance values of the test components with the same configuration in different projects as the third performance test data.
[0090] The measured data of the third performance were statistically analyzed to obtain the third performance test results.
[0091] Specifically, the component performance statistics device will statistically analyze the measured data of the third performance that changes over time, and obtain the statistical results of the measured performance data of a certain component under multiple test items as the output of the third performance test results.
[0092] This invention utilizes performance parameter attribute tables and configuration information to quickly extract third-party performance test data for multiple test items under corresponding configurations, and statistically analyzes the third-party performance test results over time. This improves the accuracy and efficiency of performance testing while rapidly compiling performance test results for components with the same configuration under different projects. It also enables horizontal comparison of performance test results for components with the same configuration under different projects, effectively addressing the deficiency of being unable to track the performance testing status of test components due to redundancy in performance test results.
[0093] Based on any of the above embodiments, before obtaining the first component running data from the target storage path corresponding to each of the target projects, the method further includes: querying the configuration information corresponding to the target project using the execution log.
[0094] Specifically, before step 101, the component performance statistics device queries the execution log of the performance test cases to find the configuration information corresponding to the target item in the server.
[0095] The configuration information includes, but is not limited to, the server's CPU model and quantity, memory model and quantity, firmware version information, corresponding board information, and external card model and quantity.
[0096] Based on the configuration information corresponding to the target project, the nested folders constructed for all components contained under the target project will be used as the storage path;
[0097] The target storage path is one or more nested folders within the storage path.
[0098] Specifically, the component performance statistics device will pre-create corresponding folders as storage paths for the components under the corresponding topology according to the component composition of the target project and its hardware topology. Finally, the nested folders constitute the target storage path corresponding to the entire target project.
[0099] This invention utilizes execution logs to retrieve configuration information corresponding to the target project, and pre-creates corresponding folders layer by layer using the hardware topology under the corresponding configuration information, providing conditions for automated execution of subsequent component selection data. This improves the accuracy and efficiency of performance testing.
[0100] Based on any of the above embodiments, before matching the target project component list corresponding to at least one target project using the component to be tested, the method further includes: sorting out the names of the test fields of each component and generating a performance table.
[0101] Specifically, the component performance statistics device sorts out the key performance fields in the performance test results of CPU, memory, network card, hard drive, RAID card, GPU, HCA card, NVMe disk, SAS card, graphics card, backplane, USB, and PCIe slot, sorts out the performance parameter names that need to be tested for each component, and matches the corresponding performance fields of these components to generate a performance table.
[0102] The performance configurations involved in each performance parameter in the performance table and their corresponding performance reference values are associated to generate a performance parameter attribute table.
[0103] Specifically, the component performance statistics device collects the performance reference values of the performance parameters of each component recorded in the performance table under different configurations, and associates the performance reference values of these components with the performance table to form a performance parameter attribute table, so as to clarify the requirements of other test configurations of the component under test through the performance parameter attribute table.
[0104] The performance table and the performance parameter attribute table are decomposed and correlated to statistically determine the performance judgment strategy for each performance parameter under the corresponding performance configuration. Specifically, the component performance statistics device needs to clarify the performance standards under different test configurations, that is, it needs to identify the factors or principles that affect performance related to the test configurations and statistically determine the performance judgment strategy under different test configurations.
[0105] This invention utilizes the differences in testing tools and performance parameters used for each component to compile the names and strategies of performance parameters for each component. Based on the data such as performance parameter names, performance parameter strategies, and performance standard principles, the invention analyzes and statistically processes the component's operating data. Through data analysis and parameter strategy determination, it enables automatic analysis of the performance test results of different configurations of server components under the same project, as well as the performance test results of the same configuration under different projects, thereby improving the accuracy and efficiency of performance testing.
[0106] Based on any of the above embodiments, the method further includes: if it is determined that the component to be tested does not match the target project component list corresponding to the target project, receiving second component operation data corresponding to the component to be tested sent by the user terminal.
[0107] Specifically, in step 101, the component performance statistics device performs a query using the name of the component to be tested. If the query fails, it means that the component to be tested is not recorded in the target component list corresponding to any server's test item, and then the device can receive the second component operation data corresponding to the component to be tested sent by the user terminal.
[0108] Based on the operating data of the second component, the performance test results of the component under test are determined.
[0109] Specifically, the component performance statistics device directly uses the second component's operating data and target configuration information to automatically analyze the corresponding component's performance data and provide the component's performance reference value, so as to determine the performance test result of the component under test.
[0110] This invention combines the second component's operational data directly provided by an external source with the target configuration information of the server to obtain the component's performance test results under the corresponding configuration. It can deduce the performance of a specific component in the test project based on performance test data of an unknown component provided by an external data source.
[0111] Based on any of the above embodiments, after determining the performance test results of the component to be tested, the method further includes: updating the performance test results of the component to be tested to the target project component list, or plotting them as a visual curve.
[0112] Specifically, after step 102-1 or 102-2, the component performance statistics device can also fill back the target project component list corresponding to the test item according to the performance test results of the component to be tested, so as to update the performance data of the component in the test configuration and represent the performance coverage of the component in the form of a visual curve on the front-end display project.
[0113] This invention updates the target project component list promptly based on the performance test results after performance testing is completed. This allows for quick identification of the performance of tested components within specific test configurations, avoiding the need for manual sifting through a vast number of test reports. It effectively solves the problem of tracking component performance and facilitates reference for other projects.
[0114] Figure 2 This is a schematic diagram of the component performance statistical device provided by the present invention. Based on any of the above embodiments, such as... Figure 2 As shown, the device includes: a data acquisition module 210, a first performance testing module 220-1, and a second performance testing module 220-2, wherein:
[0115] The data acquisition module 210 is used to acquire the first component's running data from the target storage path corresponding to each target project when it is determined that the component to be tested matches at least one target project's corresponding target project component list.
[0116] The first performance testing module 220-1 is used to determine the performance test result of the component to be tested based on the running data of the first component corresponding to the target project for the same target project.
[0117] The second performance testing module 220-2 is used to determine the performance test results of the component under test based on the running data of the first component corresponding to each of the target projects for different target projects.
[0118] The target project component list is determined based on the server's test projects; the target storage path is the data storage address generated by each component under the target project component list during performance testing.
[0119] Specifically, the data acquisition module 210 is electrically connected to the first performance test module 220-1 and the second performance test module 220-2 in sequence.
[0120] The data acquisition module 210 uses the name of the component to be tested to perform a query.
[0121] If the query is successful, it means that the component to be tested is recorded in the target project component list corresponding to the test project of at least one server. Then, the first component running data of the component can be obtained from the folder of the test project corresponding to the target project component list, through the target storage path corresponding to the component to be tested.
[0122] If the query fails, it means that the component to be tested is not recorded in the target component list of any server's test project, and there is no need to perform subsequent performance statistics.
[0123] The first performance testing module 220-1 associates the configuration information of a single target project with the running data of the first component to obtain the relevant performance data of the component to be tested with the specified configuration in the test project corresponding to the server, so as to integrate it into the performance test result output.
[0124] The second performance testing module 220-2 associates the configuration information corresponding to each of the multiple target projects with the running data of the first component, obtains the relevant performance data of the component under test with the specified configuration in the multiple test projects corresponding to the server, and performs performance comparison between multiple projects regarding the component under test, so as to integrate and output the performance test results.
[0125] Optionally, the first performance testing module 220-1 includes a first data filtering unit and a first statistical unit, wherein:
[0126] The first data filtering unit is used to filter out the first performance test data from the first component's operating data based on the performance parameter attribute table and configuration information.
[0127] The first statistical unit is used to perform statistics on the first performance test data and obtain the first performance test results.
[0128] The first performance test result includes actual performance test data of the test components with different configurations under the same target project; the configuration information is determined based on the server configuration; the performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information; and the performance parameter information is determined based on the performance test fields corresponding to the components.
[0129] Optionally, the first performance testing module 220-1 includes a second data filtering unit and a second statistical unit, wherein:
[0130] The second data filtering unit is used to filter out the second performance test data from the first component's operating data based on the performance parameter attribute table and configuration information.
[0131] The second statistical unit is used to compare the second performance measured data with the performance reference value to obtain the second performance test result.
[0132] Wherein, the performance reference value is generated by the target project under the current configuration; the second performance test result includes the actual performance test data of the target project regarding the component under test under the current configuration; the configuration information is determined according to the server configuration; the performance parameter attribute table is determined according to the correspondence between performance parameter information and configuration information; the performance parameter information is determined according to the performance test field corresponding to the component.
[0133] Optionally, the second performance testing module 220-2 includes a third data filtering unit and a third statistical unit, wherein:
[0134] The third data filtering unit is used to filter out the third performance test data from the first component's operating data based on the performance parameter attribute table and configuration information.
[0135] The third statistical unit is used to perform statistics on the third performance measured data and obtain the third performance test results.
[0136] The third performance test results include measured performance data of the tested components with the same configuration under different test items. The configuration information is determined based on the server configuration. The performance parameter attribute table is determined based on the correspondence between performance parameter information and configuration information. The performance parameter information is determined based on the performance test fields corresponding to the components.
[0137] Optionally, the device also includes a log query module and a path building module, wherein:
[0138] The log query module is used to query the configuration information corresponding to the target project using the execution log.
[0139] The path building module is used to use the nested folders constructed for all components contained under the target project as storage paths based on the configuration information corresponding to the target project.
[0140] The target storage path is one or more nested folders within the storage path.
[0141] Optionally, the device further includes a performance table generation module, a performance parameter attribute table generation module, and a performance judgment strategy generation module, wherein:
[0142] The performance table generation module is used to organize the names of the test fields for each component and generate a performance table.
[0143] The performance parameter attribute table generation module is used to associate the performance configurations involved in each performance parameter in the performance table with their corresponding performance reference values to generate the performance parameter attribute table.
[0144] The performance judgment strategy generation module is used to decompose and associate the performance table and the performance parameter attribute table, and to statistically determine the performance judgment strategy for each performance parameter under the corresponding performance configuration.
[0145] Optionally, the device further includes a data receiving module and a performance testing module, wherein:
[0146] The data receiving module is used to receive second component operation data corresponding to the component under test sent by the user terminal when it is determined that the component under test does not match the target project component list corresponding to the target project.
[0147] The performance testing module is used to determine the performance test results of the component under test based on the operating data of the second component.
[0148] Optionally, the device also includes a list update module, wherein:
[0149] The list update module is used to update the performance test results of the component to be tested to the target project component list, or to plot it as a visual curve.
[0150] This invention utilizes the component under test to quickly identify its performance testing environment and extracts the component's runtime data from the target storage path corresponding to that testing environment, thus obtaining the component's performance test results under the corresponding configuration. This allows for rapid identification of the component's performance in a specific test configuration, eliminating the need for manual sifting of test results from a large number of test reports. It facilitates tracking the performance of the tested component and provides rapid data support for other test projects.
[0151] Figure 3 This is a schematic diagram of the component performance statistics system provided by the present invention. Based on any of the above embodiments, such as... Figure 3 As shown, the system includes a remote terminal 310 and a server 320, wherein the remote terminal 310 is used to execute the component performance statistics method as described above.
[0152] Specifically, the component performance statistics system consists of a remote terminal 310 and a server 320.
[0153] Among them, server 320 serves as the test object of remote terminal 310, and a communication connection can be established between the two through wireless communication technology or wired communication technology.
[0154] In remote terminal 310, the performance parameter information and corresponding performance testing strategies for each component are compiled in advance, taking advantage of the differences in testing tools and performance parameters used for each component in server 320. Related checks and logs for test configurations are added to the performance test cases, and the performance test results are fixed in a designated folder.
[0155] During application, remote terminal 310 executes component performance statistics methods, which can quickly generate performance test reports for different components under test items for server 320, and can perform horizontal comparisons of performance test results for components with different configurations under the same project. It can also compare performance tests under the same configuration for multiple test projects corresponding to server 320, enriching the performance test reports and making the performance test data more convincing.
[0156] The component performance statistics device provided in this embodiment of the invention is used to execute the component performance statistics method of the present invention. Its implementation method is the same as that of the component performance statistics method provided by the present invention, and it can achieve the same beneficial effects. It will not be described again here.
[0157] This invention utilizes the component under test to quickly identify its performance testing environment and extracts the component's runtime data from the target storage path corresponding to that testing environment, thus obtaining the component's performance test results under the corresponding configuration. This allows for rapid identification of the component's performance in a specific test configuration, eliminating the need for manual sifting of test results from a large number of test reports. It facilitates tracking the performance of the tested component and provides rapid data support for other test projects.
[0158] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4 As shown, the electronic device may include: a processor 410, a communication interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call logical instructions in the memory 430 to execute a component performance statistics method. This method includes: when it is determined that the component under test matches a target project component list corresponding to at least one target project, obtaining first component running data from a target storage path corresponding to each target project; for the same target project, determining the performance test result of the component under test based on the first component running data corresponding to the target project; for different target projects, determining the performance test result of the component under test based on the first component running data corresponding to each target project respectively; wherein the target project component list is determined according to the test projects of the server; and the target storage path is the data storage address of each component in the target project component list corresponding to the target project during performance testing.
[0159] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0160] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to execute the component performance statistics method provided by the above methods. The method includes: when it is determined that the component to be tested matches a target project component list corresponding to at least one target project, obtaining first component running data from a target storage path corresponding to each target project; for the same target project, determining the performance test result of the component to be tested based on the first component running data corresponding to the target project; for different target projects, determining the performance test result of the component to be tested based on the first component running data corresponding to each target project respectively; wherein, the target project component list is determined according to the test project of the server; the target storage path is the data storage address generated by each component in the target project component list corresponding to the target project during the performance test.
[0161] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, is implemented to perform the component performance statistics method provided by the methods described above. This method includes: when it is determined that a component under test matches a target project component list corresponding to at least one target project, obtaining first component running data from a target storage path corresponding to each target project; for the same target project, determining a performance test result of the component under test based on the first component running data corresponding to the target project; for different target projects, determining a performance test result of the component under test based on the first component running data corresponding to each target project respectively; wherein the target project component list is determined according to the test projects of the server; and the target storage path is the data storage address generated by each component in the target project component list corresponding to the target project during performance testing.
[0162] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0163] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.
[0164] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method of component performance statistics, characterized by, include: If it is determined that the component to be tested matches at least one target project component list, the first component running data is obtained from the target storage path corresponding to each target project. For the same target project, a first performance test result is obtained based on the operating data of the first component corresponding to the target project; The first performance test results include measured performance data of the test components with different configurations under the same target project; For different target projects, a third performance test result is obtained based on the operating data of the first component corresponding to each target project; The third performance test results include measured performance data of the tested components with the same configuration under different test items; The target project component list is determined based on the server's test projects. The target project component list refers to a list of all components involved in the test projects corresponding to the server. The target storage path is the data storage address generated by each component in the target project component list during performance testing; the configuration information includes the server's CPU model and quantity, memory model and quantity, firmware version information, corresponding board information, and external card model and quantity.
2. The method of claim 1, wherein, The step of obtaining a first performance test result based on the operating data of the first component corresponding to the same target project includes: Based on the performance parameter attribute table and configuration information, the first performance test data is filtered out from the first component's operating data; The first performance test data is statistically analyzed to obtain the first performance test results; The configuration information is determined based on the server configuration; the performance parameter attribute table is determined based on the correspondence between the performance parameter information and the configuration information; and the performance parameter information is determined based on the performance test fields corresponding to the components.
3. The method of claim 1, wherein, The process of determining the performance test results of the component under test based on the operating data of the first component corresponding to the same target project includes: Based on the performance parameter attribute table and configuration information, the second performance test data is filtered out from the first component's operating data; The second performance test results are obtained by comparing the performance reference values with the second performance measured data. Wherein, the performance reference value is generated by the target project under the current configuration; the second performance test result includes the actual performance test data of the target project regarding the component under test under the current configuration; the configuration information is determined according to the server configuration; the performance parameter attribute table is determined according to the correspondence between performance parameter information and configuration information; the performance parameter information is determined according to the performance test field corresponding to the component.
4. The method of claim 1, wherein, The process of obtaining a third performance test result based on the operating data of the first component corresponding to each of the different target projects includes: Based on the performance parameter attribute table and configuration information, the third performance test data is filtered out from the first component's operating data; The measured data of the third performance are statistically analyzed to obtain the third performance test results; The configuration information is determined based on the server configuration; the performance parameter attribute table is determined based on the correspondence between the performance parameter information and the configuration information; and the performance parameter information is determined based on the performance test fields corresponding to the components.
5. The method of claim 1, wherein, Before obtaining the first component's runtime data from the target storage path corresponding to each of the target projects, the method further includes: Use the execution log to retrieve the configuration information corresponding to the target project; Based on the configuration information corresponding to the target project, the nested folders constructed for all components contained under the target project will be used as the storage path; The target storage path is one or more nested folders within the storage path.
6. The method of claim 3, wherein, Before matching the component under test to at least one target item's component list, the process also includes: Organize the names of the test fields for each component and generate a performance table; Associate the performance configurations involved in each performance parameter in the performance table with their corresponding performance reference values to generate a performance parameter attribute table; The performance table and the performance parameter attribute table are decomposed and correlated to statistically determine the performance judgment strategy for each performance parameter under the corresponding performance configuration.
7. The component performance statistical method according to any one of claims 1-6, characterized in that, Also includes: If it is determined that the component to be tested does not match the target project component list corresponding to the target project, the system receives the second component operation data corresponding to the component to be tested sent by the user terminal. Based on the operating data of the second component, the performance test results of the component under test are determined.
8. The component performance statistical method according to any one of claims 1-6, characterized in that, After determining the performance test results of the component under test, the process also includes: The performance test results of the component under test are updated to the target project component list, or plotted as a visual curve.
9. A component performance statistical device, characterized in that, include: The data acquisition module is used to acquire the first component's running data from the target storage path corresponding to each target project when it is determined that the component to be tested matches at least one target project's corresponding target project component list; The first performance testing module is used to obtain a first performance test result for the same target project based on the running data of the first component corresponding to the target project. The first performance test results include measured performance data of the test components with different configurations under the same target project; The second performance testing module is used to obtain a third performance test result based on the running data of the first component corresponding to each of the target projects for different target projects. The third performance test results include measured performance data of the tested components with the same configuration under different test items; The target project component list is determined based on the server's test projects. The target project component list refers to a list of all components involved in the test projects corresponding to the server. The target storage path is the data storage address generated by each component in the target project component list during performance testing; the configuration information includes the server's CPU model and quantity, memory model and quantity, firmware version information, corresponding board information, and external card model and quantity.
10. A component performance statistics system, comprising a remote terminal and a server, characterized in that, The remote terminal is used to execute the component performance statistics method as described in any one of claims 1 to 8.
11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the component performance statistics method as described in any one of claims 1 to 8.
12. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the component performance statistics method as described in any one of claims 1 to 8.
Citation Information
Patent Citations
Network card performance test method and device based on USB network card and electronic device
CN112653600A
Testing hardware configurations
WO2009021620A1
