A data self-reduction method and system and storage device

Abstract

The invention discloses a method and system for automatic data reduction and a storage device. The method comprises the following steps that 1.1, initialization is conducted; 1.2, an operation request is received, if the request is about space release or thin volume deletion, the step 1.5 is conducted, if the request is about data writing, the step 1.3 is conducted; 1.3, a written data segment is received, a logic address of free space in a thin pool is found from an information mapping table, and the data segment is written in a corresponding physical address; 1.4, each mapping table and each free space index table are updated, corresponding updating is conducted on the storage device or a storage medium, and if the request about data writing operation is a data writing covering operation request, the step 1.5 is conducted; 1.5, each mapping table and each free space index table are updated, a space releasing operation or a recycle operation is accomplished, and corresponding updating is conducted. The system is used for executing the method. The storage device comprises the system for automatic data reduction. According to the method and system for automatic data reduction and the storage device, data are written in the free space so that the writing performance of a storage system can be improved, the copy on write technology is adopted so that the consistency of the mapping tables can be guaranteed and the storage device can be informed of the address of an invalid page in time.

Description

technical field [0001] The invention mainly relates to the field of data storage, in particular to a data self-simplification method and system suitable for data storage devices. Background technique [0002] The physical space occupied by the logical volume in the traditional storage system on the storage device or storage medium is usually specified and allocated by the application or the user using a fixed space allocation method when the logical volume is created; that is, the logical volume is in the A fixed physical space is exclusively occupied on a storage device or storage medium. However, in actual use, since many parts of the storage space occupied by the logical volume are not filled with data, a large number of storage devices or storage space on the storage medium will be idle. Therefore, the storage space utilization rate of the traditional fixed space allocation method is extremely low. [0003] In recent years, more and more storage systems use thin provis...

AI Technical Summary

Problems solved by technology

[0005] 1. Use the in-place update method to complete the overwrite operation. When the overwrite operation points to a random address, the physical location of the data on the storage device or storage medium will also be randomly distributed, resulting in a decrease in the write performance of the storage device or storage medium.

For new storage media such as flash memory, this kind of random write operation that distributes data in different physical locations will also drastically reduce its service life

[0006] 2. When updating the mapping table, usually only an external consistency mechanism such as a log mechanism can be used to preserve the consistency of the mapping table. When the system is down when the mapping table is updated on the thin volume, it may cause long-term mapping Table recovery operation, even cause the inconsistency of the mapping table

[0007] 3. The existing thin provisioning methods usually only realize the space recovery of the logical layer, and do not use the space management characteristics of new storage media such as flash memory and PCM to truly release the physical layer space

For example, when a file is deleted, the existing thin provisioning method usually only deletes the corresponding entry in the mapping table, and does not inform the SSD of the invalid page address

Images