Fast metadata storage method and device based on difference value updating and applied to SSD performance test, electronic equipment and storage medium

Abstract

The invention belongs to the technical field of solid state disk testing, and particularly relates to a fast metadata storage method and device based on difference value updating and applied to SSD performance testing, electronic equipment and a storage medium. According to the method, only changed metadata is stored, a storage space A and a storage space B are opened up in a memory, and in the read-write testing process of a test disk, the metadata can be quickly stored in the test disk; the storage space A is filled with the generated metadata, once the storage space A is full, the metadata in the storage space A is updated into the metadata storage disk and merged with reference metadata in the metadata storage disk, in the process, the storage space B is switched, the generated metadata is filled into the storage space B, and the metadata in the storage space A is updated into the metadata storage disk. In this way, the storage space A and the storage space B are cyclically alternated, compared with storage of the whole disk of metadata, the storage space A and the storage space B only occupy a small part, the storage amount of the metadata and the end time of testing can be reduced, the testing efficiency is improved, and the service life of storage equipment is prolonged.

Description

Technical Field

[0001] The present invention belongs to the technical field of solid state drive testing, and in particular relates to a fast metadata storage method, device, electronic device and storage medium applied to SSD performance testing based on differential updating. Background Art

[0002] The read and write performance test of SSD (solid state drive) is an indispensable key link in verifying SSD performance. The performance of different aspects of SSD is verified through multi-scenario read and write tests. With the evolution of PCIE protocol generations and the improvement of NAND access rate, the nominal read and write performance of SSD based on PCIE protocol and NAND is also constantly improving. At the same time, the storage capacity of a single SSD has already reached the TB level, and a single test platform has also provided multiple SSD slots to support parallel read and write tests of multiple SSDs. This puts higher requirements on the read and write performance test tools, which must not only run multiple disks concurrently without speed drop, but also improve test efficiency.

[0003] The data read / write engine is a tool for testing the read / write performance of SSDs. While providing rate testing, it also needs to support data verification. To support data verification, the metadata of data blocks needs to be stored. High-capacity SSDs correspond to high-capacity metadata. In the case of multiple disks running concurrently, metadata of multiple disks needs to be stored. Currently, the storage of metadata mainly has the following problems that reduce efficiency: First, the memory stores the metadata of the entire disk at the same time, resulting in duplicate storage, increasing storage time and affecting test efficiency; second, duplicate storage causes space waste and reduces the life of the storage disk; third, duplicate storage increases energy consumption. Summary of the invention

[0004] The present invention aims to provide a fast metadata storage method, device, electronic device and storage medium based on differential update for SSD performance testing, so as to improve the efficiency of SSD performance testing, slow down the life loss of storage disks, and reduce test energy consumption.

[0005] To achieve the above objectives, the present invention adopts the following technical solutions: A fast metadata storage method based on differential update and applied to SSD performance testing is provided, the method comprising: Two storage spaces are allocated in the memory for alternately storing metadata, namely storage space A and storage space B. The SSD performance test tool loads the full disk metadata of the test data; Performing a read and write test on the test disk by using the SSD performance test tool, storing metadata generated by data reading and writing by cyclically alternating the A storage space and the B storage space during the data reading and writing process, and updating the stored metadata to the metadata storage disk until the test is completed; The generated metadata is first filled into the A storage space. Once the A storage space is full, the metadata storage task is switched to the B storage space, and the metadata of the A storage space is updated to the metadata storage disk, and a merge operation is performed with the existing reference metadata in the metadata storage disk; After the metadata storage task is switched to the B storage space, the metadata generated by data reading and writing is filled into the B storage space until the B storage space is full, and then the metadata storage task is switched to the A storage space, and the metadata of the B storage space is updated to the storage disk, and merged with the existing reference metadata of the metadata storage disk; At the end of the test, the latest metadata stored in the A storage space or the B storage space is updated to the metadata storage disk.

[0006] Preferably, the sizes of the A storage space and the B storage space are determined according to the data reading rates of the test disk and the metadata storage disk.

[0007] The present invention also provides a fast metadata storage device for SSD performance testing based on differential update, comprising: Storage space development unit: used to develop two storage spaces in the memory for alternately storing metadata, namely, storage space A and storage space B; Metadata loading unit: used to load the full disk metadata of test data through the SSD performance test tool; The SSD performance test unit is used to perform a read and write test on the test disk through the SSD performance test tool. During the data reading and writing process, the A storage space and the B storage space are used to store metadata generated by cyclically and alternately reading and writing data, and the stored metadata is updated to the metadata storage disk until the test is completed; A storage space difference updating unit: used to fill the generated metadata into the A storage space first, and once the A storage space is full, switch the metadata storage task to the B storage space, and update the metadata of the A storage space to the metadata storage disk, and perform a merge operation with the existing reference metadata in the metadata storage disk; B storage space difference updating unit: used for filling metadata generated by data reading and writing into the B storage space after the metadata storage task is switched to the B storage space, until the B storage space is full, then switching the metadata storage task to the A storage space, and updating the metadata of the B storage space to the storage disk, and merging it with the existing reference metadata of the metadata storage disk; The test end difference updating unit is used to update the latest metadata stored in the A storage space or the B storage space to the metadata storage disk when the test ends.

[0008] Preferably, it further comprises a storage space calculation unit, which is used to determine the size of the A storage space and the B storage space according to the data reading rate of the test disk and the metadata storage disk.

[0009] The present invention also provides an electronic device, including a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the fast metadata storage method based on differential update for SSD performance testing as described in any of the above items.

[0010] The present invention also provides a computer storage medium, in which computer executable instructions are stored, and the computer executable instructions are used to execute any of the above-mentioned fast metadata storage methods based on differential update and applied to SSD performance testing.

[0011] Compared with the prior art, the invention has the following beneficial effects: the fast metadata storage method for SSD performance testing based on differential update only stores changed metadata, and opens up storage space A and storage space B in the memory. The sizes of storage space A and storage space B are determined according to the speeds of the test disk and the storage disk. During the read and write test of the test disk, the generated metadata is first filled into storage space A. Once storage space A is full, the metadata of storage space A needs to be updated into the metadata storage disk and merged with the reference metadata in the metadata storage disk. In this process, in order not to affect the storage of metadata generated by normal data reading and writing, it is necessary to switch to storage space B, and the generated metadata is filled into storage space B. Until the B storage space is full, the metadata of the B storage space is updated to the metadata storage disk, and merged with the baseline metadata of the metadata storage disk, and at the same time switched to the A storage space, the metadata generated by data reading and writing is filled into the A storage space, so that the A storage space and the B storage space are cyclically alternating, and while updating the metadata, the normal test reading and writing are guaranteed while ensuring the test rate. At the end of the test, there is no need to store the metadata of the entire disk, only the latest copy of the A storage space and the B storage space needs to be updated. Compared with the storage of the entire disk metadata, the A storage space and the B storage space only occupy a small part. Through this solution, the storage amount of metadata and the end time of the test can be reduced, the test efficiency can be improved, and the service life of the storage device can be increased. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 The flowchart of the test process of an embodiment of a fast metadata storage method for SSD performance testing based on difference update of the present invention.

[0013] Figure 2 This is a flow chart of an embodiment of a fast metadata storage method for SSD performance testing based on difference update at the end of the test of the present invention.

[0014] Figure 3 The figure is a data transmission diagram of an embodiment of a fast metadata storage method for SSD performance testing based on differential update according to the present invention.

[0015] Figure 4 The schematic diagram is a schematic diagram of an embodiment of a fast metadata storage device for SSD performance testing based on differential update according to the present invention.

[0016] Figure 5 It is a structural schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] In one embodiment, a fast metadata storage method based on differential update and applied to SSD performance testing is provided. Figure 1-3 As shown, the fast metadata storage method based on difference update and applied to SSD performance test includes the following steps: (1) Two storage spaces are allocated in the memory for alternately storing metadata, namely storage space A and storage space B.

[0019] By allocating storage space A and storage space B in the memory of a computer used for performing read and write tests on the test disk, preparation is made for storing metadata in subsequent tests.

[0020] (2) The SSD performance test tool loads the full disk metadata of the test data.

[0021] The SSD performance test tool may be test software installed in a computer that performs read and write tests on the test disk, and the test data is data stored in an external memory for retrieval when performing read and write tests on the test disk.

[0022] (3) Perform read and write tests on the test disk using an SSD performance test tool. During the data read and write process, the metadata generated by data read and write is stored alternately in storage space A and storage space B, and the stored metadata is updated to the metadata storage disk until the test is completed.

[0023] The metadata storage disk is a storage space in the computer's external memory used to perform read and write tests on the test disk. It can be a separate storage space or a separate storage disk. The test disk is the SSD installed in the SSD slot during the performance test. The performance test can be performed on multiple SSDs at the same time.

[0024] First, the generated metadata is filled into storage space A. Once storage space A is full, the metadata storage task is switched to storage space B, and the metadata of storage space A is updated to the metadata storage disk and merged with the existing baseline metadata in the metadata storage disk.

[0025] When performing read and write tests on the test disk, new metadata will be generated. These metadata are stored for data verification. The existing baseline metadata in the metadata storage disk is the metadata that exists after the A storage space or B storage space is first stored. Updating the metadata of the A storage space to the metadata storage disk is a data difference update, so that the metadata stored in the metadata storage disk is consistent with the metadata generated by reading and writing data in the test disk.

[0026] Similarly, when the metadata storage task is switched to storage space B, the metadata generated by data reading and writing is filled into storage space B until storage space B is full. Then the metadata storage task is switched to storage space A, and the metadata of storage space B is updated to the storage disk and merged with the existing baseline metadata on the metadata storage disk.

[0027] (4) At the end of the test, the latest metadata stored in storage space A or storage space B is updated to the metadata storage disk.

[0028] The update at the end of the test makes the metadata stored in the metadata storage disk consistent with the metadata ultimately generated by reading and writing data in the test disk.

[0029] In the previous step (1), the size of storage space A and storage space B is determined based on the data reading rate of the test disk and metadata storage disk. When the reading rate of the test disk and metadata storage disk is faster, storage space A and storage space B need to be set to larger storage space.

[0030] Compared with the current test method, the core method of the fast metadata storage method based on differential update for SSD performance test is to remove the storage of duplicate metadata. For example, in the current method, the metadata generated during the read and write test of the test disk is stored in the memory as a whole disk, and is repeatedly stored in the storage disk belonging to the external memory, instead of adopting the storage method of differential update. This method causes the memory and the storage disk to store the metadata of the whole disk at the same time, resulting in duplicate storage, increasing the storage time, affecting the test efficiency, and repeated storage over and over again causes space waste, reduces the life of the storage disk, and repeated storage also increases energy consumption.

[0031] This method only stores changed metadata, by opening up storage space A and storage space B in the memory. The sizes of storage space A and storage space B are determined according to the speed of the test disk and storage disk. During the read and write test of the test disk, the generated metadata is first filled into storage space A. Once storage space A is full, the metadata of storage space A needs to be updated to the metadata storage disk and merged with the baseline metadata in the metadata storage disk. During this process, in order not to affect the storage of metadata generated by normal data reading and writing, it is necessary to switch to storage space B, and the generated metadata is filled into storage space B until storage space B is full and the metadata of storage space B is updated. The data is updated to the metadata storage disk and merged with the baseline metadata of the metadata storage disk. At the same time, it switches to storage space A, and the metadata generated by data reading and writing is filled into storage space A. In this way, storage space A and storage space B alternate in a cycle, and while updating the metadata, the normal test reading and writing are guaranteed while ensuring the test rate. At the end of the test, there is no need to store the metadata of the entire disk, only the latest copy of storage space A and storage space B needs to be updated. Compared with the storage of metadata of the entire disk, storage space A and storage space B only occupy a small part. Through this solution, the storage amount of metadata and the end time of the test can be reduced, and the service life of the storage device can be increased.

[0032] This method is relatively simple to implement, and the processing logic is not complicated. It has obvious excellent performance in some test scenarios, especially when performing small LBA range read and write tests on large-capacity SSDs. It can significantly reduce the amount of metadata written, shorten the test end time, and improve test efficiency.

[0033] In one embodiment, a fast metadata storage device based on difference update for SSD performance testing is provided, the device has the function of executing the above method example, the function can be implemented by hardware executing corresponding software, combined with Figure 4 As shown, the device includes a storage space creation unit 11, a metadata loading unit 12, an SSD performance test unit 13, an A storage space difference update unit 14, a B storage space difference update unit 15 and a test end difference update unit 16, wherein the storage space creation unit 11 is used to create two storage spaces in the memory for alternately storing metadata, namely, an A storage space and a B storage space; the metadata loading unit 12 is used to load the full disk metadata of the test data through an SSD performance test tool; the SSD performance test unit 13 is used to perform a read and write test on the test disk through the SSD performance test tool, and in the process of data reading and writing, the metadata generated by the data reading and writing is stored alternately through the A storage space and the B storage space, and the stored metadata is updated to the metadata storage disk until the test ends; the A storage space The difference update unit 14 is used to fill the generated metadata into the A storage space first. Once the A storage space is full, the metadata storage task is switched to the B storage space, and the metadata of the A storage space is updated to the metadata storage disk, and a merge operation is performed with the existing benchmark metadata in the metadata storage disk; the B storage space difference update unit 15 is used to fill the metadata generated by data reading and writing into the B storage space after the metadata storage task is switched to the B storage space until the B storage space is full, and then the metadata storage task is switched to the A storage space, and the metadata of the B storage space is updated to the storage disk, and a merge operation is performed with the existing benchmark metadata in the metadata storage disk; the test end difference update unit 16 is used to update the latest metadata stored in the A storage space or the B storage space to the metadata storage disk at the end of the test.

[0034] In addition, the device further includes a storage space calculation unit, which is used to determine the size of storage space A and storage space B according to the data reading rate of the test disk and the metadata storage disk. When the reading rate of the test disk and the metadata storage disk is faster, storage space A and storage space B need to be set to larger storage space.

[0035] When the device is executed by a computer and applied to SSD performance testing, only the changed metadata is stored. A storage space and B storage space are opened in the memory. The sizes of A storage space and B storage space are determined according to the speed of the test disk and the storage disk. During the read and write test of the test disk, the generated metadata is first filled into the A storage space. Once the A storage space is full, the metadata of the A storage space needs to be updated to the metadata storage disk and merged with the reference metadata in the metadata storage disk. During this process, in order not to affect the storage of metadata generated by normal data reading and writing, it is necessary to switch to the B storage space and fill the generated metadata into the B storage space until the B storage space is full. Update the metadata of storage space B to the metadata storage disk, and merge it with the baseline metadata of the metadata storage disk. At the same time, switch to storage space A, and fill the metadata generated by data reading and writing into storage space A. In this way, storage space A and storage space B alternate in a cycle. While updating metadata, the normal test reading and writing are guaranteed while ensuring the test rate. At the end of the test, there is no need to store the metadata of the entire disk, only the latest copy of storage space A and storage space B needs to be updated. Compared with the storage of metadata of the entire disk, storage space A and storage space B only occupy a small part. Through this solution, the storage amount of metadata and the end time of the test can be reduced, and the service life of the storage device can be increased.

[0036] When the device is executed by a computer and applied to SSD performance testing, it has obvious excellent performance in some test scenarios, especially when performing small LBA range read and write tests on large-capacity SSDs, it can significantly reduce the amount of metadata written, shorten the test end time, and improve test efficiency.

[0037] In one embodiment, an electronic device is provided, Figure 5 As shown, it includes a processor 21 and a memory, the memory includes a memory 22 and an external memory 23, and is connected via a bus, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, at least one program, a code set or an instruction set is loaded and executed by the processor to implement a fast metadata storage method based on differential update for SSD performance testing as in the previous embodiment.

[0038] In one embodiment, a computer storage medium is provided, in which computer executable instructions are stored, and the computer executable instructions are used to execute the fast metadata storage method for SSD performance testing based on differential update in the previous embodiment. The storage medium here includes: a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0039] It should be noted that, in this article, relational terms such as A and B are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0040] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A fast metadata storage method based on differential update for SSD performance testing, characterized in that: The method includes: Two storage spaces are allocated in the memory for alternately storing metadata, namely storage space A and storage space B. The SSD performance test tool loads the full disk metadata of the test data; Performing a read and write test on the test disk by using the SSD performance test tool, storing metadata generated by data reading and writing by cyclically alternating the A storage space and the B storage space during the data reading and writing process, and updating the stored metadata to the metadata storage disk until the test is completed; The generated metadata is first filled into the A storage space. Once the A storage space is full, the metadata storage task is switched to the B storage space, and the metadata of the A storage space is updated to the metadata storage disk, and a merge operation is performed with the existing reference metadata in the metadata storage disk; After the metadata storage task is switched to the B storage space, the metadata generated by data reading and writing is filled into the B storage space until the B storage space is full, and then the metadata storage task is switched to the A storage space, and the metadata of the B storage space is updated to the storage disk, and merged with the existing reference metadata of the metadata storage disk; At the end of the test, the latest metadata stored in the A storage space or the B storage space is updated to the metadata storage disk.

2. The fast metadata storage method based on differential update for SSD performance testing according to claim 1, characterized in that: The sizes of the A storage space and the B storage space are determined according to the data reading rates of the test disk and the metadata storage disk.

3. A fast metadata storage device based on differential update for SSD performance testing, characterized in that: include: Storage space development unit: used to develop two storage spaces in the memory for alternately storing metadata, namely, storage space A and storage space B; Metadata loading unit: used to load the full disk metadata of test data through the SSD performance test tool; The SSD performance test unit is used to perform a read and write test on the test disk through the SSD performance test tool. During the data reading and writing process, the A storage space and the B storage space are used to store metadata generated by cyclically and alternately reading and writing data, and the stored metadata is updated to the metadata storage disk until the test is completed; A storage space difference updating unit: used to fill the generated metadata into the A storage space first, and once the A storage space is full, switch the metadata storage task to the B storage space, and update the metadata of the A storage space to the metadata storage disk, and perform a merge operation with the existing reference metadata in the metadata storage disk; B storage space difference updating unit: used for filling metadata generated by data reading and writing into the B storage space after the metadata storage task is switched to the B storage space, until the B storage space is full, then switching the metadata storage task to the A storage space, and updating the metadata of the B storage space to the storage disk, and merging it with the existing reference metadata of the metadata storage disk; The test end difference updating unit is used to update the latest metadata stored in the A storage space or the B storage space to the metadata storage disk when the test ends.

4. The fast metadata storage device based on differential update and applied to SSD performance test according to claim 3, characterized in that: It also includes a storage space calculation unit, which is used to determine the size of the A storage space and the B storage space according to the data reading rate of the test disk and the metadata storage disk.

5. An electronic device, characterized in that: It includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the fast metadata storage method based on differential update for SSD performance testing as described in claim 1 or 2.

6. A computer storage medium, characterized in that: The computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the fast metadata storage method based on differential update and applied to SSD performance testing as described in claim 1 or 2.

Images