Fast metadata storage method and device based on difference update, applied to ssd performance test, electronic equipment and storage medium

Abstract

The application belongs to the technical field of solid state disk testing, and particularly relates to a fast metadata storage method and device based on difference updating and applied to SSD performance testing, electronic equipment and a storage medium, which only stores changed metadata, and by opening A storage space and B storage space in the memory, in the process of reading and writing test on the test disk, the generated metadata is first filled into the A storage space, once the A storage space is full, the metadata of the A storage space is updated to the metadata storage disk, and a merging operation is performed with the reference metadata in the metadata storage disk, in the process, the B storage space is switched to, and the generated metadata is filled into the B storage space, so that the A storage space and the B storage space are cyclically and alternately switched, compared with the storage of the whole disk metadata, the A storage space and the B storage space only occupy a small part, the storage amount of the metadata and the end time of the test can be reduced, the test efficiency is improved, and the service life of the storage device is increased.

Description

Technical Field

[0001] This invention belongs to the field of solid-state drive testing technology, specifically relating to a fast metadata storage method, device, electronic device, and storage medium for SSD performance testing based on differential updates. Background Technology

[0002] SSD (Solid State Drive) read / write performance testing is an indispensable and crucial step in verifying SSD performance. Multi-scenario read / write tests are used to verify different aspects of SSD performance. With the evolution of the PCIe protocol and the increase in NAND access speed, the nominal read / write performance of SSDs based on the PCIe protocol and NAND is constantly improving. Meanwhile, the storage capacity of a single SSD has already reached the terabyte level, and a single test platform now provides multiple SSD slots, supporting parallel read / write tests of multiple SSDs. This places higher demands on read / write performance testing tools, requiring them to maintain speed even with multiple concurrent drives while also improving testing efficiency.

[0003] The data read / write engine is a tool for testing SSD read / write performance. While providing speed tests, it also needs to support data verification. To support data verification, metadata for data blocks needs to be stored. High-capacity SSDs require high-capacity metadata, and in multi-disk concurrent scenarios, metadata for multiple disks needs to be stored. Currently, metadata storage mainly suffers from the following inefficiencies: First, storing the entire disk's metadata in memory simultaneously causes redundant storage, increasing storage time and impacting test efficiency; second, redundant storage wastes space and reduces the lifespan of the storage disk; and third, redundant storage increases energy consumption. Summary of the Invention

[0004] The present invention aims to provide a fast metadata storage method, apparatus, electronic device and storage medium based on differential update for SSD performance testing, so as to improve the efficiency of SSD performance testing, slow down the life wear of storage disks and reduce test energy consumption.

[0005] To achieve the above objectives, the present invention adopts the following technical solution:

[0006] A fast metadata storage method based on difference updates for SSD performance testing is provided, the method comprising:

[0007] Two memory segments, A and B, are allocated in memory to alternately store metadata.

[0008] SSD performance testing tools load full disk metadata of test data;

[0009] The SSD performance testing tool is used to perform read and write tests on the test disk. During the data read and write process, the metadata generated by the data read and write is stored in the A storage space and the B storage space in a cyclical alternation, and the stored metadata is updated to the metadata storage disk until the test ends.

[0010] The generated metadata is first filled into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata in storage space A is updated to the metadata storage disk and merged with the existing base metadata in the metadata storage disk.

[0011] After the metadata storage task is switched to storage space B, the metadata generated by data reading and writing is filled into storage space B until storage space B is full. Then the metadata storage task is switched to storage space A, and the metadata of storage space B is updated to the storage disk and merged with the existing base metadata of the metadata storage disk.

[0012] At the end of the test, the latest metadata stored in either storage space A or storage space B will be updated to the metadata storage disk.

[0013] Preferably, the size of storage space A and storage space B is determined based on the data read rate of the test disk and the metadata storage disk.

[0014] The present invention also provides a fast metadata storage device for SSD performance testing based on difference updates, comprising:

[0015] Storage space allocation unit: used to allocate two storage spaces in memory for alternating storage of metadata, namely storage space A and storage space B;

[0016] Metadata Loading Unit: Used to load full-disk metadata for test data using SSD performance testing tools;

[0017] SSD performance testing unit: used to perform read and write tests on the test disk using the SSD performance testing tool. During the data read and write process, the metadata generated by the data read and write is stored through the A storage space and the B storage space in a cyclical alternation, and the stored metadata is updated to the metadata storage disk until the test ends.

[0018] Storage space difference update unit A: It is used to first fill the generated metadata into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata of storage space A is updated to the metadata storage disk. Then, a merging operation is performed with the existing baseline metadata in the metadata storage disk.

[0019] B storage space difference update unit: After the metadata storage task is switched to the B storage space, the metadata generated by data reading and writing is filled into the B storage space until the B storage space is full. Then the metadata storage task is switched to the A storage space, and the metadata of the B storage space is updated to the storage disk and merged with the existing base metadata of the metadata storage disk.

[0020] Test End Difference Update Unit: Used to update the metadata storage disk with the latest metadata stored in storage space A or storage space B when the test ends.

[0021] Preferably, it also includes a storage space calculation unit, which is used to determine the size of the A storage space and the B storage space based on the data read rate of the test disk and the metadata storage disk.

[0022] The present invention also provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the fast metadata storage method for SSD performance testing based on interpolation updates as described in any of the preceding claims.

[0023] The present invention also provides a computer storage medium storing computer-executable instructions, the computer-executable instructions being used to execute the fast metadata storage method for SSD performance testing based on difference updates as described in any of the preceding claims.

[0024] Compared with existing technologies, the beneficial effects of this invention are as follows: This fast metadata storage method for SSD performance testing based on differential updates only stores changing metadata. It allocates two storage spaces, A and B, in memory, the sizes of which are determined by the speed of the test disk and the main storage disk. During read / write tests on the test disk, the generated metadata is first filled into storage space A. Once storage space A is full, the metadata in storage space A needs to be updated to the metadata storage disk and merged with the baseline metadata in the metadata storage disk. During this process, to avoid affecting the storage of metadata generated during normal data read / write operations, it is necessary to switch to storage space B, and the generated metadata is then filled into storage space B. Until storage space B is full, update the metadata of storage space B to the metadata storage disk and merge it with the baseline metadata of the metadata storage disk. At the same time, switch to storage space A, and fill storage space A with the metadata generated by data reading and writing. In this way, storage space A and storage space B alternate in a cycle, updating metadata while ensuring normal test read and write and maintaining test speed. At the end of the test, there is no need to store the metadata of the entire disk. Only the latest version of storage space A and storage space B needs to be updated. Compared with storing the metadata of the entire disk, storage space A and storage space B only occupy a small part. This solution can reduce the amount of metadata stored and the test end time, improve test efficiency, and increase the lifespan of storage devices. Attached Figure Description

[0025] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0026] Figure 1 This is a flowchart illustrating the testing process of an embodiment of the fast metadata storage method for SSD performance testing based on difference updates according to the present invention.

[0027] Figure 2 This is a flowchart at the end of a test in an embodiment of the fast metadata storage method for SSD performance testing based on difference updates according to the present invention.

[0028] Figure 3 This is a schematic diagram of data transmission in an embodiment of the fast metadata storage method for SSD performance testing based on difference updates according to the present invention.

[0029] Figure 4 This is an architecture diagram of an embodiment of the fast metadata storage device for SSD performance testing based on difference updates according to the present invention.

[0030] Figure 5 This is a schematic diagram of the structure of an embodiment of the electronic device of the present invention. Detailed Implementation

[0031] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0032] In one embodiment, a fast metadata storage method based on difference updates for SSD performance testing is provided, such as... Figures 1-3 As shown, this fast metadata storage method for SSD performance testing based on differential updates includes the following steps:

[0033] (1) Two storage spaces are allocated in memory for alternating storage of metadata, namely storage space A and storage space B.

[0034] By allocating storage spaces A and B in the memory of the computer used to perform read and write tests on the test disk, metadata is prepared for subsequent testing.

[0035] (2) The SSD performance testing tool loads the full disk metadata of the test data.

[0036] SSD performance testing tools can be testing software installed on the computer that performs read and write tests on the test disk. The test data is stored in external storage and is retrieved during the read and write tests on the test disk.

[0037] (3) The test disk is read and written using an SSD performance testing tool. During the data read and write process, the metadata generated by data read and write is stored by alternating between storage space A and storage space B, and the stored metadata is updated to the metadata storage disk until the test ends.

[0038] A metadata storage disk is a storage space on the computer's external memory used for reading and writing tests of the test disk. It can be a separate storage space or a separate disk. The test disk is the SSD installed in the SSD slot during performance testing, and multiple SSDs can be tested simultaneously.

[0039] First, the generated metadata is filled into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata in storage space A is updated to the metadata storage disk. Then, a merge operation is performed with the existing base metadata in the metadata storage disk.

[0040] When reading and writing tests are performed on the test disk, new metadata is generated. This metadata is stored for data verification. The baseline metadata in the metadata storage disk has been present since the first storage space A or storage space B was first stored. Updating the metadata of storage space A to the metadata storage disk is called data difference update, which makes the metadata stored in the metadata storage disk consistent with the metadata generated by reading and writing data in the test disk.

[0041] Similarly, when the metadata storage task is switched to storage space B, the metadata generated by data reading and writing is filled into storage space B until storage space B is full. Then, the metadata storage task is switched back to storage space A, and the metadata in storage space B is updated to the storage disk and merged with the existing base metadata on the metadata storage disk.

[0042] (4) At the end of the test, update the latest metadata stored in storage space A or storage space B to the metadata storage disk.

[0043] The update at the end of the test ensures that the metadata stored on the metadata storage disk is consistent with the metadata ultimately generated from reading and writing data on the test disk.

[0044] In step (1) above, the size of storage space A and storage space B in memory is determined by the data read rate of the test disk and the metadata storage disk. If the read rate of the test disk and the metadata storage disk is fast, storage space A and storage space B need to be set to a larger size.

[0045] Compared to current testing methods, the core of this fast metadata storage method for SSD performance testing based on differential updates is to eliminate the storage of duplicate metadata. For example, in current methods, the metadata generated during the read and write tests of the test disk is stored in memory and then repeatedly stored on the external storage disk, instead of using differential update storage. This results in the memory and storage disk storing the entire disk's metadata at the same time, causing duplicate storage, increasing storage time, affecting testing efficiency, and repeatedly storing data wastes space, reduces the lifespan of the storage disk, and increases energy consumption.

[0046] This method stores only changed metadata. It allocates two memory storage spaces, A and B, whose sizes are determined by the speeds of the test disk and the main storage disk. During read / write tests on the test disk, generated metadata is first filled into storage space A. Once storage space A is full, the metadata in storage space A is updated to the metadata storage disk, and a merge operation is performed with the baseline metadata in the metadata storage disk. During this process, to avoid affecting the storage of metadata generated during normal data read / write operations, it is necessary to switch to storage space B, and the generated metadata is filled into storage space B until storage space B is full, at which point the metadata in storage space B is updated. The data is updated to the metadata storage disk and merged with the baseline metadata on the metadata storage disk. At the same time, the system switches to storage space A, and the metadata generated by data reading and writing is filled into storage space A. In this way, storage space A and storage space B alternate in a cycle, updating the metadata while ensuring the normal operation of test read and write and maintaining the test speed. At the end of the test, there is no need to store the metadata of the entire disk. Only the latest version of storage space A and storage space B needs to be updated. Compared with storing the metadata of the entire disk, storage space A and storage space B only occupy a small part. This solution can reduce the amount of metadata stored, the test end time, and increase the lifespan of storage devices.

[0047] This method is relatively simple to implement and has a straightforward processing logic. It exhibits significantly superior performance in some test scenarios, especially when performing read / write tests on large-capacity SSDs with small LBA ranges. It can significantly reduce the amount of metadata written, shorten the test completion time, and improve test efficiency.

[0048] In one embodiment, a fast metadata storage device based on differential updates for SSD performance testing is provided. This device has the functionality to perform the method example described above; the functionality can be implemented by hardware executing corresponding software. Figure 4As shown, the device includes a storage space allocation unit 11, a metadata loading unit 12, an SSD performance testing unit 13, an A storage space difference update unit 14, a B storage space difference update unit 15, and a test end difference update unit 16. The storage space allocation unit 11 allocates two storage spaces in memory for alternately storing metadata, namely storage space A and storage space B. The metadata loading unit 12 loads the full-disk metadata of the test data using an SSD performance testing tool. The SSD performance testing unit 13 performs read / write tests on the test disk using an SSD performance testing tool. During data read / write operations, it alternately stores the metadata generated by data read / write operations in storage space A and storage space B, and updates the stored metadata to the metadata storage disk until the test ends. Storage space A... The difference update unit 14 is used to first fill the generated metadata into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata in storage space A is updated to the metadata storage disk. Then, a merge operation is performed with the existing baseline metadata in the metadata storage disk. The difference update unit 15 in storage space B is used to fill the metadata generated by data reading and writing into storage space B after the metadata storage task is switched to storage space B, until storage space B is full. Then, the metadata storage task is switched back to storage space A, and the metadata in storage space B is updated to the storage disk. Then, a merge operation is performed with the existing baseline metadata in the metadata storage disk. The difference update unit 16 at the end of the test is used to update the latest metadata stored in storage space A or storage space B to the metadata storage disk at the end of the test.

[0049] In addition, the device includes a storage space calculation unit, which determines the size of storage space A and storage space B based on the data read rates of the test disk and the metadata storage disk. If the read rates of the test disk and the metadata storage disk are high, storage space A and storage space B need to be set to a larger size.

[0050] When this device is used by a computer for SSD performance testing, it only stores changing metadata. It allocates two memory spaces, A and B, whose sizes are determined by the speed of the test disk and the main storage disk. During read / write tests on the test disk, the generated metadata is first filled into memory space A. Once memory space A is full, the metadata in memory space A is updated and merged with the baseline metadata in the metadata storage disk. During this process, to avoid affecting the storage of metadata generated during normal data read / write operations, the system switches to memory space B, and the generated metadata is filled into memory space B until memory space B is full. Update the metadata of storage space B to the metadata storage disk and merge it with the baseline metadata of the metadata storage disk. At the same time, switch to storage space A, and fill the metadata generated by data read and write into storage space A. In this way, storage space A and storage space B alternate in a cycle, updating the metadata while ensuring the normal operation of test read and write and maintaining the test speed. At the end of the test, there is no need to store the metadata of the entire disk. Only the latest version of storage space A and storage space B needs to be updated. Compared with storing the metadata of the entire disk, storage space A and storage space B only occupy a small part. This solution can reduce the amount of metadata storage, the end time of the test, and increase the lifespan of the storage device.

[0051] When this device is used by a computer for SSD performance testing, it exhibits significantly superior performance in certain test scenarios. In particular, when performing read and write tests on large-capacity SSDs with small LBA ranges, it can significantly reduce the amount of metadata written, shorten the test completion time, and improve test efficiency.

[0052] In one embodiment, an electronic device is provided, in conjunction with Figure 5 As shown, it includes a processor 21 and a memory, which includes main memory 22 and secondary memory 23, and is connected via a bus. The memory stores at least one instruction, at least one program, code set, or instruction set. The processor loads and executes the at least one instruction, at least one program, code set, or instruction set to implement the fast metadata storage method for SSD performance testing based on difference updates as described in the previous embodiment.

[0053] In one embodiment, a computer storage medium is provided that stores computer-executable instructions for executing the fast metadata storage method for SSD performance testing based on interpolation updates described in the preceding embodiment. The storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0054] It should be noted that, in this document, relational terms such as A and B are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0055] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A fast metadata storage method based on differential updates for SSD performance testing, characterized in that, The method includes: Two memory segments, A and B, are allocated in memory to alternately store metadata. SSD performance testing tools load full disk metadata of test data; The SSD performance testing tool is used to perform read and write tests on the test disk. During the data read and write process, the metadata generated by the data read and write is stored in the A storage space and the B storage space in a cyclical alternation, and the stored metadata is updated to the metadata storage disk until the test ends. The generated metadata is first filled into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata in storage space A is updated to the metadata storage disk and merged with the existing base metadata in the metadata storage disk. After the metadata storage task is switched to storage space B, the metadata generated by data reading and writing is filled into storage space B until storage space B is full. Then the metadata storage task is switched to storage space A, and the metadata of storage space B is updated to the storage disk and merged with the existing base metadata of the metadata storage disk. At the end of the test, the latest metadata stored in either storage space A or storage space B will be updated to the metadata storage disk.

2. The fast metadata storage method for SSD performance testing based on difference updates according to claim 1, characterized in that: The size of storage space A and storage space B is determined based on the data read rates of the test disk and the metadata storage disk.

3. A fast metadata storage device based on differential updates for SSD performance testing, characterized in that, include: Storage space allocation unit: used to allocate two storage spaces in memory for alternating storage of metadata, namely storage space A and storage space B; Metadata Loading Unit: Used to load full-disk metadata for test data using SSD performance testing tools; SSD performance testing unit: used to perform read and write tests on the test disk using the SSD performance testing tool. During the data read and write process, the metadata generated by the data read and write is stored through the A storage space and the B storage space in a cyclical alternation, and the stored metadata is updated to the metadata storage disk until the test ends. Storage space difference update unit A: It is used to first fill the generated metadata into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata of storage space A is updated to the metadata storage disk. Then, a merging operation is performed with the existing baseline metadata in the metadata storage disk. B storage space difference update unit: After the metadata storage task is switched to the B storage space, the metadata generated by data reading and writing is filled into the B storage space until the B storage space is full. Then the metadata storage task is switched to the A storage space, and the metadata of the B storage space is updated to the storage disk and merged with the existing base metadata of the metadata storage disk. Test End Difference Update Unit: Used to update the metadata storage disk with the latest metadata stored in storage space A or storage space B when the test ends.

4. The fast metadata storage device for SSD performance testing based on difference updates according to claim 3, characterized in that: It also includes a storage space calculation unit, which is used to determine the size of storage space A and storage space B based on the data read rate of the test disk and the metadata storage disk.

5. An electronic device, characterized in that: The method includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the fast metadata storage method for SSD performance testing based on differential updates as described in claim 1 or 2.

6. A computer storage medium, characterized in that, The computer storage medium stores computer-executable instructions, which are used to execute the fast metadata storage method for SSD performance testing based on difference updates as described in claim 1 or 2.

Images