Excel-based CosBench performance test result analysis method

Abstract

The invention discloses an Excel-based CosBench performance test result analysis method, which comprises the following steps of: acquiring a CosBench performance test result file stored in a specified path, extracting correlation values for measuring system performance, generating an Excel table according to the correlation values, extracting two correlation values in the table, and importing the two correlation values into a pre-formulated Excel template file. And acquiring specified data in the Excel template file, and generating a broken line graph according to the specified data. According to the method, the automatic script is combined with the CosBench tool to automatically extract and analyze the test result under the condition of different workloads, the Excel tool is combined to automatically draw the performance line graph of different workload test data of the CosBench tool, the whole process is automatically processed, manual operation is reduced, operation time is shortened, and efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a CosBench performance test result analysis method based on Excel. Background Art

[0002] CosBench is an open source platform developed by the Intel Cloud Team, specifically for testing and verifying the performance and stability of cloud storage systems. CosBench provides a flexible test workload model that can simulate a variety of user scenarios to help developers, operators, and researchers fully understand the capabilities of their cloud storage solutions. However, most existing CosBench test processes require manual configuration of test parameters, test initiation, data collection, and data analysis, which is cumbersome and time-consuming.

[0003] Currently, the CosBench interface can intuitively display the test results of multiple directories and the corresponding performance curves. Although the existing solution supports the display of the performance curves of the current operation, when performing performance statistics and analysis, users still need to manually extract the performance data of multiple tests, and then use third-party software (such as Excel) to summarize and draw graphs.

[0004] In addition, CosBench can currently only display the performance curve of a single workload, while the performance test results of an IO model often contain a large amount of data. For example, when performing a 4K write test, it is necessary to test under different concurrency. Therefore, in order to obtain the 4K write performance curve, the data of each workload can only be manually extracted and then summarized for graphing and analysis. When there are too many IO models to test, this manual statistical method is time-consuming and prone to errors. Summary of the invention

[0005] To this end, the present application provides a CosBench performance test result analysis method based on Excel to solve the problem that the prior art requires manual data extraction when processing CosBench performance test results and has low processing efficiency when facing large amounts of data.

[0006] In order to achieve the above objectives, this application provides the following technical solutions:

[0007] In a first aspect, a CosBench performance test result analysis method based on Excel includes:

[0008] Step 1: Get the CosBench performance test result file saved in the specified path;

[0009] Step 2: extracting relevant values ​​used to measure system performance in the CosBench performance test result file;

[0010] Step 3: Generate an Excel table according to the relevant values;

[0011] Step 4: extracting two related values ​​from the Excel table and importing them into a pre-defined Excel template file;

[0012] Step 5: Obtain the specified data in the Excel template file, and generate a line chart according to the specified data.

[0013] Preferably, in step 1, the CosBench performance test result file is saved and named as workLoads.csv file.

[0014] Preferably, after step 1, the method further includes: obtaining the total number of each workload from the CosBench performance test result file, and calculating the sum of the relevant values ​​of each workload for measuring system performance.

[0015] Preferably, in step 2, if the CosBench performance test is a read-only or write-only performance test, the relevant values ​​include concurrency value, latency value, IOPS value, and bandwidth value; if the CosBench performance test is a mixed read-write performance test, the relevant values ​​include concurrency value, model value, latency value, IOPS value, bandwidth value, total latency value, total IOPS value, and total bandwidth value.

[0016] Preferably, in step 4, when extracting two related values ​​in the Excel table, the two related values ​​extracted are concurrency and IOPS values.

[0017] In a second aspect, a CosBench performance test result analysis device based on Excel comprises:

[0018] The data acquisition module is used to obtain the CosBench performance test result file saved in the specified path;

[0019] A correlation value extraction module, used to extract the correlation value used to measure system performance in the CosBench performance test result file;

[0020] A table generation module, used to generate an Excel table according to the relevant values;

[0021] A data import module, used for extracting two related values ​​in the Excel table and importing them into a pre-defined Excel template file;

[0022] The line chart generation module is used to obtain the specified data in the Excel template file and generate a line chart according to the specified data.

[0023] As a preference, it also includes:

[0024] The calculation module is used to obtain the total number of each workload from the CosBench performance test result file and calculate the sum of the relevant values ​​of each workload for measuring system performance.

[0025] In a third aspect, a computer device includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of a CosBench performance test result analysis method based on Excel when executing the computer program.

[0026] In a fourth aspect, a computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of a CosBench performance test result analysis method based on Excel.

[0027] In a fifth aspect, a computer program product includes a computer program or instructions, which, when executed by a processor, implements the steps of a CosBench performance test result analysis method based on Excel.

[0028] Compared with the prior art, this application has at least the following beneficial effects:

[0029] The present application provides a CosBench performance test result analysis method based on Excel, which obtains the CosBench performance test result file saved in a specified path, extracts the relevant values ​​in the CosBench performance test result file for measuring system performance, generates an Excel table based on the relevant values, extracts two relevant values ​​in the Excel table, and imports them into a pre-defined Excel template file, obtains the specified data in the Excel template file, and generates a line chart based on the specified data. The CosBench performance test result analysis method based on Excel provided in the present application utilizes an automated script combined with the CosBench tool to automatically extract and analyze the test results under different workloads, and automatically draws a performance line chart of the CosBench tool's different workload test data in combination with the Excel tool, with full automation processing, which reduces manual operations, shortens operation time, and improves efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more intuitively illustrate the prior art and the present application, exemplary drawings are given below. It should be understood that the specific shapes and structures shown in the drawings should not generally be regarded as limiting conditions for implementing the present application; for example, those skilled in the art are capable of easily making conventional adjustments or further optimizations to the addition / reduction / attribution division, specific shapes, positional relationships, connection methods, dimensional ratios, etc. of certain units (components) based on the technical concepts and exemplary drawings disclosed in the present application.

[0031] Figure 1 A basic flow chart of the CosBench performance test result analysis method based on Excel provided in this application;

[0032] Figure 2 A data processing flow chart of a CosBench performance test result analysis method based on Excel provided in this application;

[0033] Figure 3 A line chart of CosBench performance test results generated for Example 1 of the present application;

[0034] Figure 4 This is a line chart of the CosBench performance test results generated for Example 2 of the present application. DETAILED DESCRIPTION

[0035] The present application is further described below in detail through specific embodiments in conjunction with the accompanying drawings.

[0036] In the description of this application: unless otherwise specified, the meaning of "plurality" is two or more. The terms "first", "second", "third", etc. in this application are intended to distinguish the objects referred to, and do not have special meanings in terms of technical connotations (for example, they should not be understood as emphasizing the importance or order, etc.). Expressions such as "including", "comprising", "having", etc. also mean "not limited to" (certain units, components, materials, steps, etc.).

[0037] The terms such as "upper", "lower", "left", "right", "middle", etc. cited in this application are usually used to indicate the general relative position relationship for the purpose of intuitive understanding by referring to the drawings, and are not absolute limitations on the position relationship in the actual product.

[0038] See also Figure 1 and Figure 2 , the present application provides a CosBench performance test result analysis method based on Excel, including:

[0039] S1: Get the CosBench performance test result file saved in the specified path;

[0040] Specifically, when performing CosBench performance testing: first put the prepared 4K read and write XML files covering multiple concurrent operations into the specified path, and automatically run the specified XML files in the background through the script. After each XML file is run, a CosBench performance test result file is obtained. Each CosBench performance test result file is backed up and renamed to workloads.csv file in the specified path, and then the file is cleared.

[0041] S2: extract relevant values ​​used to measure system performance in the CosBench performance test result file;

[0042] Specifically, if the CosBench performance test is a read-only or write-only performance test, the relevant values ​​include concurrency value, latency value, IOPS value, bandwidth value, throughput (Throughput), bandwidth (Bandwidth) and average processing time (Avg-ProcTime) and other values.

[0043] If the CosBench performance test is a mixed read-write performance test, the relevant values ​​include concurrency value, model (i.e. IO type, read or write) value, latency value, IOPS value, bandwidth value, throughput (Throughput), bandwidth (Bandwidth), average processing time (Avg-ProcTime), total latency value, total IOPS value and total bandwidth value.

[0044] S3: Generate an Excel table based on the relevant values;

[0045] S4: extracting two related values ​​from the Excel table and importing them into a pre-defined Excel template file;

[0046] Specifically, when extracting two related values ​​in the Excel table, the two related values ​​extracted are a concurrency value and an IOPS value, a concurrency value and a bandwidth value, or an IOPS value and a latency value, and the like.

[0047] S5: Obtain specified data in the Excel template file, and generate a line chart according to the specified data.

[0048] Specifically, after the line graph is generated, the generated Excel chart and the line graph are stored in a specified path.

[0049] The present application provides an Excel-based CosBench performance test result analysis method, which further includes after S1: obtaining the total number of each workload from the CosBench performance test result file, and calculating the sum of the relevant values ​​of each workload for measuring system performance.

[0050] This application provides a CosBench performance test result analysis method based on Excel. By extracting the relevant values ​​used to measure system performance in the CosBench performance test result file, and using the Excel tool to first draw a table, and then drawing according to the data in the table, the performance test results can be displayed more intuitively and reliably, solving the problem of statistical performance test results of different workloads. This method can process data from multiple different workloads, summarize all data test results and analyze them through Excel drawing, and can automatically process data and draw pictures.

[0051] The present application provides an Excel-based CosBench performance test result analysis method that utilizes an automated script in combination with the CosBench tool to automatically extract and analyze test results under different workloads, and combines the Excel tool to automatically draw a performance line chart of the CosBench tool's different workload test data. The entire process is automated, which reduces manual operations, shortens operation time, and improves efficiency.

[0052] Embodiment 1

[0053] The CosBench performance test result analysis method based on Excel provided in this application is used in only read or write performance test scenarios, specifically including:

[0054] S1: Get the workloads.csv file saved in the specified path;

[0055] S2: Extract the concurrency, latency, IOPS, and bandwidth values ​​from each workloads.csv file;

[0056] S3: Generate an Excel table based on the data concurrency, latency, IOPS, and bandwidth values, as shown in Table 1:

[0057] Table 1

[0058] concurrent Latency iops bandwidth 60 270.57 2651.94 10.36 300 389.32 9224.6 36.88 600 463.72 15493.75 61.98 1200 554.56 25919.62 103.68 1800 710.76 30349.04 121.41 2100 828.46 30389.87 121.56 2400 963.19 29880.68 119.52

[0059] S4: Extract the concurrency value and IOPS in Table 1 to a specified table and store it in a specified path. The table content is shown in Table 2:

[0060] Table 2

[0061] 60 300 600 1200 1800 2100 2400 4K Write 2651.94 9224.6 15493.75 25919.62 30349.04 30389.87 29880.68 4K Read 15097.76 46298.11 45819.46 45162.79 44894.14 44455.41 44373.72

[0062] S5: The data in the specified chart area in Table 2 above will be specified in advance in Excel to generate a line chart (concurrency as the horizontal axis and IOPS as the vertical axis). The above data is extracted to the area through S4 to generate a line chart, such as Figure 3As shown, finally the generated Excel chart and line chart are stored in the specified path.

[0063] In this embodiment, when only read or write performance is tested, a chart is generated to summarize values ​​such as concurrency, latency, IOPS, and bandwidth, and then concurrency (concurrency and bandwidth plots, IOPS and latency plots, etc. can be selected) and IOPS for plotting, so that the performance test results can be displayed more intuitively and reliably.

[0064] Embodiment 2

[0065] The CosBench performance test result analysis method based on Excel provided in this application is used in a mixed read-write performance test scenario, specifically including:

[0066] S1: Get the workloads.csv file saved in the specified path;

[0067] S2: Extract the values ​​of concurrency, model, latency, IOPS, bandwidth, total latency, total IOPS, and total bandwidth from each workloads.csv file.

[0068] S3: Generate an Excel table based on the values ​​of concurrency, model, latency, IOPS, bandwidth, total latency, total IOPS, and total bandwidth, as shown in Table 3:

[0069] Table 3

[0070]

[0071] S4: Extract the concurrency value and IOPS in Table 3 to a specified table and store them in a specified path. The table content is shown in Table 4:

[0072] Table 4

[0073] 100 300 900 1200 1500 1800 2000 4KB_MIX 8884.94 19864.71 22907.71 22287.46 21309.48 21021.97 21063.32 16KB_MIX 8775.22 20007.83 22078.89 21495.58 21152.39 21770.28 20645.07 64KB_MIX 5743.1 12398.24 16128.44 19179.73 20129.85 19775.87 20142.39 256KB_MIX 3701.47 6561.95 8465.22 10271.16 11359.31 12330.85 11951.9 1M_MIX 1639.19 3093.6 3821.32 3966.25 3857.92 4172.03 3960.55

[0074] S5: The data in the specified chart area in Table 4 above will be specified in advance in Excel to generate a line chart (concurrency as the horizontal axis and IOPS as the vertical axis). The above data is extracted to the area through S4 to generate a line chart, such as Figure 4 As shown, finally the generated Excel chart and line chart are stored in the specified path.

[0075] This embodiment is for the hybrid read and write performance test. It generates a chart to summarize the IO type, concurrency, latency, IOPS, bandwidth, total hybrid read and write latency, total hybrid read and write IOPS and total hybrid read and write bandwidth. Then, it filters the concurrency and total IOPS data and displays them intuitively in the form of a line chart. Finally, it displays a performance trend chart of total IOPS following concurrency changes, which can display the performance test results more intuitively and reliably.

[0076] The present application also provides a CosBench performance test result analysis device based on Excel, comprising:

[0077] The data acquisition module is used to obtain the CosBench performance test result file saved in the specified path;

[0078] A correlation value extraction module, used to extract the correlation value used to measure system performance in the CosBench performance test result file;

[0079] A table generation module, used to generate an Excel table according to the relevant values;

[0080] A data import module, used for extracting two related values ​​in the Excel table and importing them into a pre-defined Excel template file;

[0081] The line chart generation module is used to obtain the specified data in the Excel template file and generate a line chart according to the specified data.

[0082] The CosBench performance test result analysis device based on Excel provided by the present application also includes:

[0083] The calculation module is used to obtain the total number of each workload from the CosBench performance test result file and calculate the sum of the relevant values ​​of each workload for measuring system performance.

[0084] For the specific implementation content of each module in a CosBench performance test result analysis device based on Excel, please refer to the definition of a CosBench performance test result analysis method based on Excel above, which will not be repeated here.

[0085] The present application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of a CosBench performance test result analysis method based on Excel are implemented.

[0086] The present application also provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of a CosBench performance test result analysis method based on Excel are implemented.

[0087] The present application also provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements the steps of a CosBench performance test result analysis method based on Excel.

[0088] The technical features of the above embodiments may be arbitrarily combined (as long as there is no contradiction in the combination of these technical features). To make the description concise, not all possible combinations of the technical features in the above embodiments are described; these embodiments that are not explicitly written should also be considered to be within the scope of this specification.

Claims

1. A CosBench performance test result analysis method based on Excel, characterized in that: include: Step 1: Get the CosBench performance test result file saved in the specified path; Step 2: extracting relevant values ​​used to measure system performance in the CosBench performance test result file; Step 3: Generate an Excel table according to the relevant values; Step 4: extracting two related values ​​from the Excel table and importing them into a pre-defined Excel template file; Step 5: Obtain the specified data in the Excel template file, and generate a line chart according to the specified data.

2. The CosBench performance test result analysis method based on Excel according to claim 1, characterized in that: In step 1, the CosBench performance test result file is saved and named as workLoads.csv file.

3. The CosBench performance test result analysis method based on Excel according to claim 1, characterized in that: Step 1 also includes: obtaining the total number of each workload from the CosBench performance test result file, and calculating the sum of the relevant values ​​of each workload for measuring system performance.

4. The CosBench performance test result analysis method based on Excel according to claim 3, characterized in that: In step 2, if the CosBench performance test is a read-only or write-only performance test, the relevant values ​​include concurrency value, latency value, IOPS value, and bandwidth value; if the CosBench performance test is a mixed read-write performance test, the relevant values ​​include concurrency value, model value, latency value, IOPS value, bandwidth value, total latency value, total IOPS value, and total bandwidth value.

5. The CosBench performance test result analysis method based on Excel according to claim 1, characterized in that: In step 4, when extracting two related values ​​in the Excel table, the two related values ​​extracted are concurrency and IOPS values.

6. A CosBench performance test result analysis device based on Excel, characterized in that: include: The data acquisition module is used to obtain the CosBench performance test result file saved in the specified path; A correlation value extraction module, used to extract the correlation value used to measure system performance in the CosBench performance test result file; A table generation module, used to generate an Excel table according to the relevant values; A data import module, used for extracting two related values ​​in the Excel table and importing them into a pre-defined Excel template file; The line chart generation module is used to obtain the specified data in the Excel template file and generate a line chart according to the specified data.

7. The CosBench performance test result analysis device based on Excel according to claim 6, characterized in that: Also includes: The calculation module is used to obtain the total number of each workload from the CosBench performance test result file and calculate the sum of the relevant values ​​of each workload for measuring system performance.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

10. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images