Method and device for testing cache breakdown of storage system

By simulating cache breakdown scenarios, the performance parameters of the storage system are tested, and the performance degradation and data inconsistency caused by cache breakdown are solved, the stability and reliability of the system are improved, and the risk of failure is reduced.

CN119088630APending Publication Date: 2024-12-06CHINA TELECOM DIGITAL INTELLIGENCE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411314141.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-20
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In storage systems, cache space is constrained and cache policy is inappropriate, which may lead to cache breakdown, resulting in sharp decline in performance and inconsistent data, affecting the system's business continuity.

Method used

By simulating the cache breakdown scenario, the test state of the storage system from cache idle to storage exhaustion is obtained, and a cluster test environment is built, including storage cluster information and client information, and data is pre-buried based on the attribute information of the test volume and background volume, and the test is tested. The performance parameters of the storage system include IOPS, bandwidth and delay.

Benefits of technology

This method can comprehensively evaluate and improve the performance and robustness of the storage system, discover potential problems in advance, improve the stability and reliability of the system, and reduce the risk of failure.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088630A_ABST
    Figure CN119088630A_ABST
Patent Text Reader

Abstract

The invention relates to a method and device for testing cache breakdown of a storage system, and belongs to the technical field of computers.The method comprises the steps that the test state of the storage system is obtained, and the test state is the state of the storage system from cache idle to storage depletion; in the test state, a cluster test environment is obtained, the cluster test environment comprises storage cluster information and client information, the storage cluster information comprises storage nodes, the number of the storage nodes is the same as that of the test volumes, the client information comprises client nodes, and each client mounts one test volume; determining attribute information of a background volume according to the attribute information of the test volume; and testing the test volume under the condition of pre-burying the data based on the attribute information of the test volume and the attribute information of the background volume to obtain performance parameters after the cache of the storage system is broken down. According to the method, the performance of the storage system and the robustness performance under high concurrency can be comprehensively evaluated and improved, and possible problems in the storage system can be found and solved in advance.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of computer technology, and in particular relates to a method and device for testing cache breakdown of a storage system. Background Art

[0002] In related technologies, storage systems include distributed storage and centralized storage, etc. SSD solid state disk cache is generally used to improve system performance, such as IOPS, bandwidth and latency. However, when cache space is limited, cache strategy is improper, and massive data is highly concurrent, cache breakdown may occur. Once cache breakdown occurs, storage system performance will drop sharply, resulting in a large number of slow requests and inconsistent data, and users' business continuity will be at risk. Therefore, how to better implement storage system cache breakdown testing has become an urgent problem to be solved. Summary of the invention

[0003] In view of the above shortcomings of the prior art, the purpose of the invention is to provide a storage system cache breakdown test method and device. The method can comprehensively evaluate and improve the performance of the storage system and the robustness under high concurrency, and can discover and solve possible problems in the storage system in advance.

[0004] According to a first aspect of the present invention, a method for testing cache breakdown of a storage system is proposed, comprising: S1, obtaining a test state of the storage system, wherein the test state is a state in which the storage system changes from cache idle to storage exhausted; S2, in the test state, obtaining a cluster test environment, wherein the cluster test environment includes storage cluster information and client information, wherein the storage cluster information includes storage nodes, wherein the number of the storage nodes is the same as the number of test volumes, and the client information includes client nodes, wherein each client mounts one of the test volumes; S3, determining attribute information of a background volume according to the attribute information of the test volume; and S4, testing the test volume in the case where data is pre-embedded based on the attribute information of the test volume and the attribute information of the background volume, to obtain performance parameters of the storage system after cache breakdown.

[0005] Furthermore, the number of the storage nodes is the same as the number of the client nodes, and the size of the test volume is the size of the solid-state disks constituting the cache pool.

[0006] Furthermore, the attribute information includes quantity and size, wherein the size of the test volume is the same as the size of the background volume, and the number of the test volumes is the same as the number of the background volumes.

[0007] Furthermore, data is pre-embedded based on the attribute information of the test volume and the attribute information of the background volume, including: pre-embedding the test volume based on a preset IO size and the attribute information of the test volume; and after pre-embedding the test volume, pre-embedding the background volume again based on the preset IO size and the attribute information of the background volume.

[0008] Furthermore, it also includes: defining a preset amount of hot data areas in each of the test volumes.

[0009] Furthermore, the test volume is tested to obtain performance parameters of the storage system cache after breakdown, including: obtaining a target read-write ratio; based on the target read-write ratio and a preset IO size, performing random small-block IO read and write on all logical blocks of the test volume until the test data volume is a preset multiple of the capacity size of the test volume; when the test data volume is a preset multiple of the capacity size of the test volume, statistics are collected on the performance parameters of the storage system cache after breakdown.

[0010] Furthermore, the performance parameters include the number of read and write operations per second (IOPS), bandwidth, latency, and jitter.

[0011] According to a second aspect of the present invention, a storage system cache breakdown test device is proposed, comprising: a first acquisition module, used to acquire a test state of the storage system, the test state being a state of the storage system from cache idle to storage exhausted; a second acquisition module, used to acquire a cluster test environment under the test state, the cluster test environment comprising storage cluster information and client information, the storage cluster information comprising storage nodes, the number of the storage nodes being the same as the number of test volumes, the client information comprising client nodes, each client mounting one of the test volumes; a determination module, used to determine attribute information of a background volume according to the attribute information of the test volume; a test module, used to test the test volume under the condition of pre-embedding data based on the attribute information of the test volume and the attribute information of the background volume, and obtain performance parameters of the storage system after cache breakdown.

[0012] According to a third aspect of the present invention, an electronic device is proposed, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any of the methods described in the first aspect of the present invention.

[0013] According to a fourth aspect of the present invention, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute any one of the methods according to the first aspect of the present invention.

[0014] The beneficial effects of the present invention are as follows:

[0015] The storage system cache breakdown test method and device described in the present invention obtain the test state of the storage system, the test state is the state of the storage system from cache idle to storage exhaustion; in the test state, obtain the cluster test environment, the cluster test environment includes storage cluster information and client information, the storage cluster information includes storage nodes, the number of storage nodes is the same as the number of test volumes, the client information includes client nodes, each client mounts a test volume; determine the attribute information of the background volume according to the attribute information of the test volume; based on the attribute information of the test volume and the attribute information of the background volume, test the test volume in the case of data pre-embedded, and obtain the performance parameters of the storage system cache after breakdown. By simulating the cache breakdown scenario and performing performance testing, the method can comprehensively evaluate and improve the performance of the storage system and the robustness performance under high concurrency, and can discover and solve possible problems in the storage system in advance. This preventive testing method helps to improve the stability and reliability of the system and reduce the risk of failure in actual operation of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are only used to illustrate specific embodiments and are not considered to limit the present invention. In the entire drawings, the same reference symbols represent the same components. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.

[0017] Figure 1 is a flow chart of a method for testing cache breakdown of a storage system according to an embodiment of the present invention;

[0018] Figure 2 is a flow chart of a method for testing cache breakdown of a storage system according to a specific embodiment of the present invention;

[0019] Figure 3 is a structural block diagram of a storage system cache breakdown test device according to an embodiment of the present invention;

[0020] Figure 4 It is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making creative work should fall within the scope of protection of the present invention.

[0022] Furthermore, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concepts disclosed in the present invention.

[0023] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the orientation or position relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. The terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be a connection between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0024] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of methods and systems consistent with some aspects of the present invention as detailed in the appended claims.

[0025] The present invention proposes a storage system cache breakdown test method, device and related equipment. Specifically, the storage system cache breakdown test method, device and related equipment of an embodiment of the present invention are described below with reference to the accompanying drawings.

[0026] Figure 1This is a flow chart of a method for testing a storage system cache breakdown according to an embodiment of the present invention. It should be noted that the method for testing a storage system cache breakdown according to an embodiment of the present invention can be applied to a test device for testing a storage system cache breakdown according to an embodiment of the present invention. The test device for testing a storage system cache breakdown can be configured on an electronic device or in a server. This embodiment of the present application does not limit this.

[0027] like Figure 1 As shown, the test method for storage system cache breakdown includes:

[0028] S110, obtaining a test status of the storage system, where the test status is a status of the storage system from cache idle to storage exhausted.

[0029] In the embodiment of the present invention, during the test of the storage system cache breakdown, it is necessary to ensure that the test state is the state of the storage system from cache free to storage exhaustion. It can be seen that by ensuring that the test state is the state of the storage system from cache free to storage exhaustion, the cache breakdown scenario can be accurately simulated. This is crucial for evaluating the performance of the storage system under extreme loads, helping developers or operation and maintenance personnel to better understand the behavioral limits of the system.

[0030] S120, in the test state, obtain a cluster test environment, the cluster test environment includes storage cluster information and client information, the storage cluster information includes storage nodes, the number of storage nodes is the same as the number of test volumes, the client information includes client nodes, and each client mounts a test volume.

[0031] In an embodiment of the present invention, the number of storage nodes is the same as the number of client nodes, and the size of the test volume is the size of the solid-state disks that make up the cache pool.

[0032] For example, the storage cluster information consists of 4 storage nodes, the number of client nodes is 4, the number of test volumes is 4, each client mounts 1 test volume, and the size of a single volume is 1.6T (that is, the size of a single SSD that makes up the cache pool is 1.6T).

[0033] In the embodiment of the present invention, an efficient cluster test environment is constructed by setting the number of storage nodes to be the same as the number of test volumes and mounting a test volume on each client. This configuration simplifies the process of setting up the test environment and ensures the authenticity and repeatability of the test environment, making the test results more valuable for reference.

[0034] S130, determining the attribute information of the background volume according to the attribute information of the test volume.

[0035] In an embodiment of the present invention, the attribute information includes quantity and size, wherein the size of the test volume is the same as the size of the background volume, and the number of the test volumes is the same as the number of the background volumes.

[0036] S140, based on the attribute information of the test volume and the attribute information of the background volume, in the case of pre-embedding data, testing the test volume to obtain performance parameters after the storage system cache is broken down.

[0037] In the embodiment of the present invention, when the attribute information of the test volume and the attribute information of the background volume are determined, the data of the test volume can be pre-embedded first, and then the data of the background volume can be pre-embedded. When the data pre-embedding is completed, the test volume is tested to obtain the performance parameters after the storage system cache is broken down. The specific implementation method can refer to the subsequent embodiments.

[0038] The purpose of pre-embedded data is to prevent non-zero reading and writing during testing. By pre-embedded data, the impact of non-zero reading and writing on test results is effectively prevented. The accuracy and reliability of the test results are ensured, making the test results closer to the system performance in the real environment.

[0039] Among them, performance parameters include the number of read and write operations per second (IOPS), bandwidth, latency, and jitter.

[0040] In the embodiments of the present invention, the basic principles of storage system cache tiering are as follows: (1) Cache technology is mainly used to coordinate data transmission between devices with large differences in throughput speed. (2) Cache solutions have always played an important role in storage systems. They not only have the effect of shaving peaks and filling valleys for IO write requests, but can also coordinate the smooth transmission of data between storage devices with large differences in throughput capabilities. They also have the effect of improving hits for IO read requests, and can organize frequently accessed data to be stored in high-performance storage media, and ensure that requests are responded to quickly. In recent years, SSDs have been gradually eroding and trying to replace the market position of HDDs with their continuously falling prices and consistently excellent performance. However, at the current stage, the cost of SSDs with the same capacity specifications is still much higher than that of HDDs. Therefore, in order to efficiently organize SSDs and HDDs and achieve a balance between performance and cost in storage systems, it is necessary to rely on intelligent data tiered storage solutions, namely cache solutions. The cache solution has excellent performance when data is first written, but as data is continuously written, or due to improper cache policy settings, insufficient cache space, and many other reasons, cache breakdown will occur, leading to performance degradation, data consistency damage, and increased system stability risks.

[0041] According to the test method of storage system cache breakdown of an embodiment of the present invention, the test state of the storage system is obtained, and the test state is the state of the storage system from cache idle to storage exhaustion; in the test state, the cluster test environment is obtained, and the cluster test environment includes storage cluster information and client information, the storage cluster information includes storage nodes, the number of storage nodes is the same as the number of test volumes, and the client information includes client nodes, and each client mounts a test volume; the attribute information of the background volume is determined according to the attribute information of the test volume; based on the attribute information of the test volume and the attribute information of the background volume, the test volume is tested in the case of data pre-embedded, and the performance parameters of the storage system cache after breakdown are obtained. By simulating the cache breakdown scenario and performing performance testing, this method can comprehensively evaluate and improve the performance of the storage system and the robustness performance under high concurrency, and can discover and solve possible problems in the storage system in advance. This preventive testing method helps to improve the stability and reliability of the system and reduce the risk of failure in actual operation of the system.

[0042] In order to make it easier for those skilled in the art to understand the present invention, Figure 2 A method for testing cache breakdown of a storage system according to a specific embodiment of the present invention is as follows: Figure 2 As shown, the storage system cache breakdown test method includes:

[0043] S210, obtaining a test status of the storage system, where the test status is a status of the storage system from cache idle to storage exhausted.

[0044] S220, in the test state, obtain a cluster test environment, the cluster test environment includes storage cluster information and client information, the storage cluster information includes storage nodes, the number of storage nodes is the same as the number of test volumes, the client information includes client nodes, and each client mounts a test volume.

[0045] S230: Determine the attribute information of the background volume according to the attribute information of the test volume.

[0046] In the embodiment of the present invention, the implementation of step S210 to step S230 may refer to the above-mentioned step S110 to step S130, and the present invention will not elaborate on this.

[0047] S240, pre-embedding data based on the attribute information of the test volume and the attribute information of the background volume.

[0048] In an embodiment of the present invention, the test volume is pre-embedded based on a preset IO size and attribute information of the test volume. After the test volume is pre-embedded, the background volume is pre-embedded again based on the preset IO size and attribute information of the background volume.

[0049] That is to say, in order to evict the data in the cache of each component in the storage system (mainly the test volume data) before the test to prevent the test results from being affected, the test volume data can be pre-buried first, and then the background volume can be pre-buried. For example, the test volume or background volume can be pre-buried with an IO size of 1M or 4M.

[0050] In one embodiment of the present invention, after pre-embedding the data, a preset amount of hot data area can be defined in each test volume, for example, a hot data area of ​​1G or more can be defined for each test volume to simulate a scenario with hot data in a real business.

[0051] S250, based on the attribute information of the test volume and the attribute information of the background volume, in the case of pre-embedding data, testing the test volume to obtain performance parameters after the storage system cache is penetrated.

[0052] In an embodiment of the present invention, a target read-write ratio is obtained; based on the target read-write ratio and a preset IO size, random small-block IO reading and writing are performed on all logical blocks of the test volume until the test data volume is a preset multiple of the capacity size of the test volume; when the test data volume is a preset multiple of the capacity size of the test volume, performance parameters of the storage system after cache breakdown are counted.

[0053] For example, vdbench is used to perform read and write operations on random small blocks of all logical blocks of four test volumes with an IO of 8K and 7 reads and 3 writes or 7 writes and 3 reads. For example, the total cache disk capacity (that is, the capacity of the test volume) includes N nodes, M blocks per node, and 1.6T cache disk per block. When the test data volume is N*M*1.6*1.5 times, the number of read and write operations per second IOPS, bandwidth, latency, jitter and other information after the storage system cache is penetrated are counted.

[0054] Among them, 8KB random read and write with 100% LBA in the test volume data set will cause frequent data migration between the cache layer data and the base layer data, so it is relatively easy to obtain the overall performance and stability of the storage system after cache breakdown.

[0055] In the embodiments of the present invention, the application scenarios of the present invention include: 1. The application scenarios are as follows: cloud storage systems, including performance stress testing, bottleneck analysis, etc. of distributed storage and centralized storage. 2. High-concurrency application scenarios with extremely high read-write ratios, such as data cache scenarios in Internet applications, where the storage system carries scenarios such as flash sales, popular marketing activities, 618 and Double 1 promotions, where the proportion of hot data is low but the amount of stored data is large. 3. Hot data expiration simulation: simulate the expiration of hot data in the cache, and then observe and test the load of the database and the responsiveness of the system. 4. Cache consistency test: verify the data consistency of the cache, application, and base pool, and check whether the data can be correctly provided and updated in the cache after the cache is penetrated. 5. Cache preheating test: test whether the cache preheating mechanism can preload hot data into the cache during the startup or low load period of the system to prevent cache penetration. 6. Cache update strategy test: evaluate whether the cache update strategy is effective after the cache is penetrated, such as whether a locking mechanism or an asynchronous update mechanism is used to prevent data overload. 7. Fuse and current limiting mechanism test: Test whether the storage system has a fuse and current limiting mechanism to prevent excessive requests from directly accessing block devices in the case of cache breakdown. 8. Abnormal traffic test: Simulate possible malicious attacks or abnormal traffic to test the system's defense capabilities against these situations and ensure that cache breakdown will not cause system crashes. 9. Disaster recovery test: In the case of excessive pressure on the storage system due to cache breakdown, test the system's disaster recovery capabilities, such as backup and rapid recovery mechanisms.

[0056] The storage system cache breakdown test method according to the embodiment of the present invention can comprehensively evaluate and improve the performance of the storage system (including distributed storage and centralized storage) and the robustness performance under high concurrency, provide value in cache optimization, high concurrency and disaster recovery, and help improve the performance, data management capabilities, system stability and business continuity of the distributed storage cluster, including: (1) Risk assessment: By simulating the high-concurrency reading and writing of massive small files (4K / 8K, etc.), the performance of the storage system under the extreme condition of cache breakdown is evaluated, and the possible risks and problems of the storage system are predicted. (2) Performance optimization: The solution can quickly identify system bottlenecks and provide data support for performance optimization (such as cache strategy adjustment and distributed lock optimization), thereby improving the overall performance of the system. (3) Fault prevention: Through testing, potential fault points are discovered, measures are taken in advance, the probability of system failure is reduced, the stability of the system is ensured when facing a large number of requests, service interruptions caused by cache breakdown are avoided, the stability and response speed of the system are improved, and the end-user experience is indirectly improved. (4) Disaster recovery plan: A disaster recovery plan is formulated through the solution to ensure that there is a quick recovery plan when cache breakdown occurs.

[0057] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0058] According to one aspect of an embodiment of the present invention, a storage system cache breakdown test device is also provided. Figure 3 is a structural block diagram of a test device for memory system cache breakdown according to an embodiment of the present invention; Figure 3 As shown, including:

[0059] A first acquisition module 310 is used to acquire a test state of the storage system, where the test state is a state of the storage system from cache idle to storage exhausted;

[0060] A second acquisition module 320 is used to acquire a cluster test environment in the test state, wherein the cluster test environment includes storage cluster information and client information, wherein the storage cluster information includes storage nodes, the number of which is the same as the number of test volumes, and the client information includes client nodes, and each client mounts one of the test volumes;

[0061] A determination module 330, configured to determine attribute information of a background volume according to the attribute information of the test volume;

[0062] The testing module 340 is used to test the test volume in the case where data is pre-embedded based on the attribute information of the test volume and the attribute information of the background volume, so as to obtain the performance parameters of the storage system after the cache is broken down.

[0063] According to the storage system cache breakdown test device of the embodiment of the present invention, the test state of the storage system is obtained, and the test state is the state of the storage system from cache idle to storage exhaustion; in the test state, the cluster test environment is obtained, and the cluster test environment includes storage cluster information and client information, the storage cluster information includes storage nodes, the number of storage nodes is the same as the number of test volumes, and the client information includes client nodes, and each client mounts a test volume; the attribute information of the background volume is determined according to the attribute information of the test volume; based on the attribute information of the test volume and the attribute information of the background volume, the test volume is tested in the case of data pre-embedded, and the performance parameters of the storage system after the cache breakdown are obtained. Therefore, by simulating the cache breakdown scenario and performing performance testing, the performance of the storage system and the robustness performance under high concurrency can be comprehensively evaluated and improved, and possible problems in the storage system can be discovered and solved in advance. This preventive testing method helps to improve the stability and reliability of the system and reduce the risk of failure in actual operation of the system.

[0064] Optionally, the number of the storage nodes is the same as the number of the client nodes, and the size of the test volume is the size of the solid-state disks constituting the cache pool.

[0065] Optionally, the attribute information includes quantity and size, wherein the size of the test volume is the same as the size of the background volume, and the number of the test volumes is the same as the number of the background volumes.

[0066] Optionally, the test module 340 is specifically used to pre-embed the test volume based on a preset IO size and attribute information of the test volume; after pre-embedding the test volume, the background volume is pre-embedded again based on the preset IO size and attribute information of the background volume.

[0067] Optionally, a definition module is also included, which is used to define a preset amount of hot data areas in each of the test volumes.

[0068] Optionally, the test module 340 is specifically used to obtain a target read-write ratio; based on the target read-write ratio and a preset IO size, perform random small-block IO read and write on all logical blocks of the test volume until the test data volume is a preset multiple of the capacity size of the test volume; when the test data volume is a preset multiple of the capacity size of the test volume, statistics are generated on the performance parameters of the storage system after cache breakdown.

[0069] Optionally, the performance parameters include the number of read and write operations per second (IOPS), bandwidth, latency, and jitter.

[0070] According to one aspect of an embodiment of the present invention, an electronic device is provided.

[0071] Figure 4Schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 4 As shown, the electronic device may include one or more ( Figure 4 Only one is shown in the figure) processor 102 (processor 102 may include but is not limited to a microprocessor (Microprocessor Unit, referred to as MPU) or a programmable logic device (Programmable logic device, referred to as PLD)) and a memory 104 for storing data. In an exemplary embodiment, the electronic device may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 4 The structure shown is for illustration only and does not limit the structure of the above terminal device. Figure 4 More or fewer components as shown, or with Figure 4 Equivalent functions or comparisons shown Figure 4 A different configuration with more features is shown.

[0072] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the test method for cache breakdown of the storage system in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0073] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the switching device. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0074] The present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute a test method for cache breakdown of a storage system.

[0075] The applicant of the present invention has made a detailed explanation and description of the implementation examples of the present invention in conjunction with the drawings in the specification. However, those skilled in the art should understand that the above implementation examples are only preferred implementation schemes of the present invention, and the detailed description is only to help readers better understand the spirit of the present invention, but not to limit the scope of protection of the present invention. On the contrary, any improvements or modifications based on the inventive spirit of the present invention should fall within the scope of protection of the present invention.

[0076] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0077] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

[0078] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or replace some of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or replacements that can be easily thought of by those skilled in the art within the technical scope disclosed in the present invention should be covered within the protection scope of the present invention.

Claims

1. A method for testing cache breakdown of a storage system, characterized in that: include: S1, obtaining a test state of a storage system, wherein the test state is a state of the storage system from cache idle to storage exhausted; S2, in the test state, obtaining a cluster test environment, the cluster test environment including storage cluster information and client information, the storage cluster information including storage nodes, the number of the storage nodes being the same as the number of test volumes, the client information including client nodes, and each client mounting one of the test volumes; S3, determining the attribute information of the background volume according to the attribute information of the test volume; S4, in the case where data is pre-embedded based on the attribute information of the test volume and the attribute information of the background volume, the test volume is tested to obtain performance parameters of the storage system after cache breakdown.

2. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: The number of the storage nodes is the same as the number of the client nodes, and the size of the test volume is the size of the solid-state disks that make up the cache pool.

3. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: The attribute information includes quantity and size, wherein the size of the test volume is the same as the size of the background volume, and the number of the test volumes is the same as the number of the background volumes.

4. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: Pre-embedding data based on the attribute information of the test volume and the attribute information of the background volume, including: Pre-embedding the test volume based on a preset IO size and attribute information of the test volume; When the test volume is pre-embedded, the background volume is pre-embedded based on the preset IO size and the attribute information of the background volume.

5. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: Also includes: A preset amount of hot data areas are defined in each of the test volumes.

6. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: The test volume is tested to obtain performance parameters of the storage system after cache breakdown, including: Get the target read-write ratio; Based on the target read-write ratio and the preset IO size, all logical blocks of the test volume are randomly read and written in small blocks until the test data volume reaches a preset multiple of the capacity of the test volume; When the amount of test data is a preset multiple of the capacity of the test volume, statistics are collected on performance parameters of the storage system after cache breakdown.

7. The method for testing cache breakdown of a storage system according to claim 1, characterized in that: The performance parameters include the number of read and write operations per second (IOPS), bandwidth, latency, and jitter.

8. A storage system cache breakdown test device, characterized in that: include: A first acquisition module is used to acquire a test state of the storage system, where the test state is a state of the storage system from cache idle to storage exhausted; A second acquisition module is used to acquire a cluster test environment in the test state, wherein the cluster test environment includes storage cluster information and client information, wherein the storage cluster information includes storage nodes, the number of the storage nodes is the same as the number of test volumes, and the client information includes client nodes, and each client mounts one of the test volumes; A determination module, used to determine the attribute information of the background volume according to the attribute information of the test volume; The test module is used to test the test volume in the case where data is pre-embedded based on the attribute information of the test volume and the attribute information of the background volume, so as to obtain the performance parameters of the storage system after the cache is broken down.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 7.