An address mapping system for large-capacity solid-state hard disks

Abstract

The invention relates to the technical field of solid-state hard disk data processing, and discloses an address mapping system for a large-capacity solid-state hard disk, including a data acquisition module and a mapping management module. The system is connected to the solid-state hard disk through a data acquisition module network, obtains logical blocks and physical blocks at all time points, and classifies and forms a data set. The address mapping module analyzes the read and write speed when converting logical blocks into physical blocks and the change trend of the read and write speed during the solid-state hard disk address mapping process, generates a corresponding fluctuation index, identifies the performance fluctuation of the solid-state hard disk, and has a strong ability to perform in-depth analysis and maintain stability. The address mapping module analyzes the remaining space of each physical block, generates a corresponding occupancy rate, and then sets a fluctuation threshold within a fixed range. Combined with the read and write speed, fluctuation index, remaining space and occupancy rate, it is determined whether there is a conversion anomaly during the solid-state hard disk address mapping process, outputs a corresponding management prompt, and the mapping management is more timely and effective.

Description

Technical Field

[0001] The present invention relates to the technical field of solid state hard disk data processing, in particular to an address mapping system for a large-capacity solid state hard disk. Background Art

[0002] The address mapping system is one of the core functions of the SSD. Its main function is to convert the host logical address space into the flash physical address space. The address mapping system is usually implemented by the FTL flash translation layer, which hides the physical characteristics of the NAND flash memory, making the SSD experience similar to that of a traditional hard disk. When the FTL flash translation layer performs mapping management, it records the mapping relationship between the logical address and the physical address. When data is written to the SSD, the FTL updates the mapping table. When reading data, the FTL finds the physical location of the data through the mapping table. Garbage collection is also an important function of the FTL. It moves valid data to a new block and then erases the old block so that it can be used again. In order to prevent some flash blocks from failing prematurely due to excessive writing, the FTL will try to balance the number of writes to each block. Frequent reading of a block may cause data errors, and the FTL needs to monitor and handle this situation. In order to prevent abnormal power failures from causing the loss of the mapping table, the FTL will periodically write the mapping table to the flash memory during operation. The address mapping system integrates multiple functions for flexible management and realizes efficient translation or mapping from the logical address space to the physical address space.

[0003] At present, when traditional solid-state hard drive address mapping systems process large-capacity data, the mapping table management is relatively complex and it is difficult to maintain a stable read and write speed, which leads to interruptions or errors in the data reading and writing process, increasing the risk of data loss or damage. In addition, when converting logical blocks into physical blocks, it is difficult to balance the number of writes to each block in a timely manner, and the flexibility and applicability are poor. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention provides an address mapping system for a large-capacity solid-state hard disk, which has the advantages of strong in-depth analysis and stability maintenance capabilities, more timely and effective mapping management, etc., and solves the problem that the traditional solid-state hard disk address mapping system is difficult to maintain a stable read and write speed and has poor flexibility and applicability.

[0005] To achieve the above-mentioned object, the present invention provides the following technical solutions: an address mapping system for a large-capacity solid-state hard disk, comprising a data acquisition module and a mapping management module;

[0006] The data acquisition module is composed of a logical data unit and a physical data unit. The logical data unit is connected to the solid-state hard disk through a network to collect a logical data set, and the logical data set includes logical blocks at all time points. The physical data unit is connected to the solid-state hard disk through a network to collect a physical data set, and the physical data set includes physical blocks at all time points. The data acquisition module transmits the logical data set and the physical data set to the address mapping module through the network.

[0007] The address mapping module is composed of a conversion analysis unit, a space analysis unit and a mapping management unit. The conversion analysis unit analyzes the read and write speed when converting logical blocks into physical blocks during the SSD address mapping process according to the logical data set and the physical data set. And read and write speed The changing trend of and transmitted to the mapping management unit through the network. The space analysis unit analyzes the remaining space of each physical block according to the physical data set. , generating the corresponding occupancy , and transmitted to the mapping management unit through the network, wherein the mapping management unit is provided with a fixed range of fluctuation thresholds , combined with the read and write speed , Volatility Index , remaining space and occupancy rate , determine whether there is a conversion anomaly in the solid-state drive address mapping process, and output the corresponding management prompt.

[0008] Preferably, the expression of the logical data set is , to The first to the A logical block at a point in time, which includes data capacity and logical address. Indicates the time point at which a single logical block is obtained.

[0009] Preferably, the expression of the physical data set is , to The first to the A physical block at a point in time, which includes data capacity and physical address. Indicates the time point at which a single physical block is obtained.

[0010] Preferably, the read and write speed The calculation process is as follows:

[0011] Extract the logical data set logical blocks at a certain point in time and marked as ;

[0012] according to , corresponding to the first The physical block at a point in time is marked as ,in, The logical address and The physical addresses belong to the same mapping table;

[0013]

[0014] In the formula, Indicates the read and write speed. Indicates The data capacity of a logical block at a point in time, Indicates the time it takes to convert a logical block into a physical block during the SSD address mapping process. The data capacity is divided by the conversion time to get the SSD conversion time. The read and write speed of a logical block at a point in time.

[0015] Preferably, the volatility index The calculation process is as follows:

[0016] According to the logical data set, The read and write speed of the logical block at a time point is marked as , to The first to the The read and write speed of the physical block at a point in time;

[0017]

[0018] In the formula, represents the volatility index, Indicates the average read and write speed obtained by dividing the sum of the read and write speeds by the number of logical blocks. , Indicates The read and write speed of the physical block at a point in time, It means that according to the variance formula, the variance value obtained is the volatility index.

[0019] Preferably, the remaining space The calculation process is as follows: Extract the first The physical block at a point in time is marked as , and The data capacity in ;

[0020]

[0021] In the formula, Indicates the remaining space. Indicates the total capacity of the SSD. Indicates the total capacity divided by the number of physical blocks to get the capacity of a single physical block. Indicates The remaining space of the physical block at a point in time.

[0022] Preferably, the occupancy rate The calculation process is as follows:

[0023] According to the physical data set, count the remaining space The number of physical blocks is 0 and is marked as ;

[0024]

[0025] In the formula, represents the occupancy rate, Indicates remaining space The number of physical blocks, Indicates the percentage of used space in the SSD to the total space, which is the SSD occupancy rate.

[0026] Preferably, the read and write speed Below average read and write speeds , it indicates that there is a conversion exception in the SSD address mapping process, marking the abnormal logic block and outputting the corresponding data prompt.

[0027] Preferably, the volatility index Exceeding the volatility threshold , it indicates that there is a conversion exception during the SSD address mapping process, and the corresponding exception prompt is output.

[0028] Preferably, in the process of address mapping of the solid state drive, the logic block is preferentially converted to the remaining space. The physical block is 0, the occupancy rate When it exceeds 95%, it means that the SSD space is too high and the corresponding cleanup prompt is output.

[0029] Compared with the prior art, the present invention provides an address mapping system for a large-capacity solid-state hard disk, which has the following beneficial effects:

[0030] 1. The present invention connects the solid-state hard disk through the data acquisition module network, obtains the logical blocks and physical blocks at all time points, and classifies them into logical data sets and physical data sets. The address mapping module analyzes the read and write speed when converting logical blocks into physical blocks during the solid-state hard disk address mapping process according to the logical data sets and physical data sets. And read and write speed The changing trend of , identify the performance fluctuations of the solid-state drive, so as to adjust the mapping strategy in a targeted manner, and have strong in-depth analysis and stability maintenance capabilities.

[0031] 2. The present invention uses an address mapping module to analyze the remaining space of each physical block according to the physical data set. , generating the corresponding occupancy , occupancy rate The higher the value, the more time the SSD needs to handle garbage collection to ensure that there is enough space for new write operations. The mapping management unit is set with a fixed range of fluctuation thresholds. , combined with the read and write speed , Volatility Index , remaining space and occupancy rate , determine whether there is a conversion anomaly in the SSD address mapping process, read and write speed Below average read and write speeds When , it means that there is a conversion anomaly in the SSD address mapping process, marking the abnormal logic block and outputting the corresponding data prompt, the fluctuation index Exceeding the volatility threshold , it indicates that there is a conversion exception during the SSD address mapping process, and the corresponding exception prompt is output. During the SSD address mapping process, the logical block is converted to the remaining space first. The physical block occupancy rate is 0 When it exceeds 95%, it means that the SSD space is too high, and the corresponding cleanup prompt is output, making mapping management more timely and effective. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a schematic diagram of the system flow of the present invention. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] When the traditional SSD address mapping system processes large-capacity data, the mapping table management is relatively complex and it is difficult to maintain a stable read and write speed, which leads to interruptions or errors in the data reading and writing process, increasing the risk of data loss or damage. In addition, when converting logical blocks to physical blocks, it is difficult to balance the number of writes to each block in time, and the flexibility and applicability are poor. Therefore, an address mapping system for large-capacity SSDs is provided. Please refer to Figure 1 ,The system includes a data acquisition module and a mapping management module;

[0035] The data acquisition module consists of logical data units and physical data units. The logical data unit collects logical data sets through a network connection to the solid-state drive. The logical data set includes logical blocks at all time points. The logical blocks allow the operating system to access the storage device in a unified way without having to worry about the underlying physical details. The expression of the logical data set is , to The first to the A logical block at a point in time, which includes data capacity and logical address. Indicates the time point for obtaining a single logical block;

[0036] The physical data unit collects physical data sets through a network connection to the solid-state drive. The physical data set includes physical blocks at all time points. The physical blocks represent the actual storage locations in the storage medium. The main controller of the solid-state drive manages the writing, erasing, and reading of data in the physical blocks, thereby maximizing the optimization of storage space. The expression of the physical data set is: , to The first to the A physical block at a point in time, which includes data capacity and physical address. Indicates the time point of obtaining a single physical block;

[0037] The data acquisition module transmits the logical data set and the physical data set to the address mapping module through the network;

[0038] The address mapping module consists of a conversion analysis unit, a space analysis unit, and a mapping management unit. The conversion analysis unit analyzes the read and write speed of the SSD address mapping process when converting logical blocks to physical blocks based on the logical data set and the physical data set. And read and write speed The changing trend of , and transmitted to the mapping management unit through the network. The calculation process is as follows:

[0039] Extract the logical data set logical blocks at a certain point in time and marked as ;

[0040] according to , corresponding to the first The physical block at a point in time is marked as ,in, The logical address and The physical addresses belong to the same mapping table;

[0041]

[0042] In the formula, Indicates the read and write speed. Indicates The data capacity of a logical block at a point in time, Indicates the time it takes to convert a logical block into a physical block during the SSD address mapping process. The data capacity is divided by the conversion time to get the SSD conversion time. The read and write speed of a logical block at a point in time.

[0043] According to the logical data set, The read and write speed of the logical block at a time point is marked as , to The first to the The read and write speed of the physical block at a point in time;

[0044]

[0045] In the formula, represents the volatility index, Indicates the average read and write speed obtained by dividing the sum of the read and write speeds by the number of logical blocks. , Indicates The read and write speed of the physical block at a point in time, It means that according to the variance formula, the variance value obtained is the fluctuation index. By analyzing the change trend of the read and write speed, the performance fluctuation of the solid-state drive can be identified, so as to adjust the mapping strategy in a targeted manner, and the in-depth analysis and maintenance capabilities are strong;

[0046] The space analysis unit analyzes the remaining space of each physical block based on the physical data set. , generating the corresponding occupancy , and transmitted to the mapping management unit through the network. The calculation process is as follows:

[0047] Extract the physical data set The physical block at a point in time is marked as , and The data capacity in ;

[0048]

[0049] In the formula, Indicates the remaining space. Indicates the total capacity of the SSD. Indicates the total capacity divided by the number of physical blocks to get the capacity of a single physical block. Indicates The remaining space of the physical block at a certain point in time helps the system quickly match the logical block to the free physical block;

[0050] According to the physical data set, count the remaining space The number of physical blocks is 0 and is marked as ;

[0051]

[0052] In the formula, represents the occupancy rate, Indicates remaining space The number of physical blocks, Indicates the percentage of used space in the SSD to the total space, which is the SSD occupancy rate. The higher the occupancy rate, the more time the SSD needs to process garbage collection to ensure that there is enough space for new write operations.

[0053] The mapping management unit sets a fixed range of fluctuation thresholds , combined with the read and write speed , Volatility Index , remaining space and occupancy rate , determine whether there is a conversion anomaly in the SSD address mapping process, read and write speed Below average read and write speeds When , it means that there is a conversion anomaly in the SSD address mapping process, marking the abnormal logic block and outputting the corresponding data prompt, the fluctuation index Exceeding the volatility threshold , it indicates that there is a conversion exception during the SSD address mapping process, and the corresponding exception prompt is output. During the SSD address mapping process, the logical block is converted to the remaining space first. The physical block occupancy rate is 0 When it exceeds 95%, it means that the SSD space is too high, and the corresponding cleanup prompt is output, making mapping management more timely and effective.

[0054] Example 1: In this experiment, a 1000MB logical block was selected as the experimental object. According to statistics, the time it takes for the solid-state hard disk to convert the logical block into a physical block is 2s. The read and write speed of the solid-state hard disk is The calculation formula is as follows:

[0055]

[0056] In the formula, Indicates the read and write speed. Indicates the data capacity in a logical block, The data capacity is divided by the conversion time to get the SSD conversion time. The read and write speed of the logical block at a time point is MB / s.

[0057] Example 2: In this experiment, a 512GB solid-state drive was selected as the experimental object. Statistics showed that the read and write speeds of converting logical blocks to physical blocks during the solid-state drive address mapping process were 400MB / s, 324MB / s, 500MB / s, 510MB / s, and 390MB / s, respectively. The volatility index of the solid-state drive was The calculation formula is as follows:

[0058]

[0059] In the formula, represents the volatility index, Indicates the average read and write speed obtained by dividing the sum of the read and write speeds by the number of logical blocks. is 424.8MB / s. According to the variance formula, the variance value is This is the volatility index.

[0060] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An address mapping system for a large-capacity solid-state hard disk, characterized in that: Including data acquisition module and mapping management module; The data acquisition module is composed of a logical data unit and a physical data unit. The logical data unit is connected to the solid-state hard disk through a network to collect a logical data set, and the logical data set includes logical blocks at all time points. The physical data unit is connected to the solid-state hard disk through a network to collect a physical data set, and the physical data set includes physical blocks at all time points. The data acquisition module transmits the logical data set and the physical data set to the address mapping module through the network. The address mapping module is composed of a conversion analysis unit, a space analysis unit and a mapping management unit. The conversion analysis unit analyzes the read and write speed when converting logical blocks into physical blocks during the SSD address mapping process according to the logical data set and the physical data set. And read and write speed The changing trend of and transmitted to the mapping management unit through the network. The space analysis unit analyzes the remaining space of each physical block according to the physical data set. , generating the corresponding occupancy , and transmitted to the mapping management unit through the network, wherein the mapping management unit is provided with a fixed range of fluctuation thresholds , combined with the read and write speed , Volatility Index , remaining space and occupancy rate , determine whether there is a conversion anomaly in the solid-state hard disk address mapping process, and output the corresponding management prompt, the read and write speed Below average read and write speeds When , it indicates that there is a conversion anomaly in the SSD address mapping process, marking the abnormal logic block and outputting the corresponding data prompt. Exceeding the volatility threshold , it indicates that there is a conversion exception in the SSD address mapping process, and the corresponding exception prompt is output. In the SSD address mapping process, the logical block is preferentially converted to the remaining space. The physical block is 0, the occupancy rate When it exceeds 95%, it means that the SSD space is too high and the corresponding cleanup prompt is output.

2. The address mapping system for a large-capacity solid-state hard disk according to claim 1, characterized in that: The expression of the logical data set is , to The first to the A logical block at a point in time, which includes data capacity and logical address. Indicates the time point at which a single logical block is obtained.

3. The address mapping system for a large-capacity solid-state hard disk according to claim 2, characterized in that: The expression of the physical data set is , to The first to the A physical block at a point in time, which includes data capacity and physical address. Indicates the time point at which a single physical block is obtained.

4. The address mapping system for a large-capacity solid-state hard disk according to claim 3, characterized in that: The read and write speed The calculation process is as follows: The address mapping system of a large-capacity solid-state hard disk according to claim 3 is characterized in that: the read and write speed The calculation process is as follows: according to , corresponding to the first The physical block at a point in time is marked as ,in, The logical address and The physical addresses belong to the same mapping table; ； In the formula, Indicates the read and write speed. Indicates The data capacity of a logical block at a point in time, Indicates the time it takes to convert a logical block into a physical block during the SSD address mapping process. The data capacity is divided by the conversion time to get the SSD conversion time. The read and write speed of a logical block at a point in time.

5. The address mapping system for a large-capacity solid-state hard disk according to claim 4, characterized in that: The volatility index The calculation process is as follows: According to the logical data set, The read and write speed of the logical block at a time point is marked as , to The first to the The read and write speed of the physical block at a point in time; ； ； In the formula, represents the volatility index, Indicates the average read and write speed obtained by dividing the sum of the read and write speeds by the number of logical blocks. , Indicates The read and write speed of the physical block at a point in time, It means that according to the variance formula, the variance value obtained is the volatility index.

6. The address mapping system for a large-capacity solid-state hard disk according to claim 5, characterized in that: The remaining space The calculation process is as follows: Extract the physical data set The physical block at a point in time is marked as , and The data capacity in ; ； ； In the formula, Indicates the remaining space. Indicates the total capacity of the SSD. Indicates the total capacity divided by the number of physical blocks to get the capacity of a single physical block. Indicates The remaining space of the physical block at a certain point in time.

7. The address mapping system for a large-capacity solid-state hard disk according to claim 6, characterized in that: The occupancy rate The calculation process is as follows: According to the physical data set, count the remaining space The number of physical blocks is 0 and is marked as ; ； ； In the formula, represents the occupancy rate, Indicates remaining space The number of physical blocks, Indicates the percentage of used space in the SSD to the total space, which is the SSD occupancy rate.

Images