Data storage management method, device and equipment

Abstract

The invention provides a data storage management method, device and equipment, and the method comprises the steps: responding to a data writing instruction, writing a data block into zone, taking a unique identifier of the data block as a key, taking the position information of the data block as a value, generating a data block index in a key-value form, and writing the data block index into a storage region corresponding to index information in a memory; when the data volume of the to-be-stored area reaches a set threshold value, packaging the data of the storage area into a file and storing the file in the CMR area; in response to the data reading instruction, retrieving a first target key matched with a target identifier in the instruction in the data block index; the corresponding first target value is positioned according to the first target key, and the target data block is read according to the position information of the data block in the first target value, so that efficient storage and management of the data block and the metadata index information thereof by using the SMR disk are realized.

Description

technical field [0001] The present application relates to the technical field of data storage, and in particular to a data storage management method, device and equipment. Background technique [0002] SMR (Shingled magnetic recording disk, shingled recording disk) increases the disk density per unit space by reducing track write amplification and sacrificing random write data to obtain higher storage space. The SMR disk includes a CMR (traditional magnetic recording) area and an SMR (tile-shaped magnet recording) area. The CMR area is small and supports random reading and writing. It generally accounts for 1% of the entire SMR disk capacity, and the rest is the SMR area; the SMR area Random writing is not supported, and only 256MB can be used as the minimum unit for continuous writing and deletion (called a zone). Each zone has a write pointer, which is used to control the sequential writing of data in the zone. [0003] With the continuous development of distributed objec...

AI Technical Summary

Problems solved by technology

[0005] At present, when data blocks are stored in the SMR disk, the metadata management node will divide the user file into several data blocks of the same size, and select a data node with the same number of file splits to save the segmented business data stream. Data block file, after the data node receives the business data block, it will select one of the zone blocks of the SMR disk to write the data block into. After the writing is completed, the corresponding index data will be generated and written into the zone. However, in this method The index data reads and writes the SMR zone directly through the ioctl command, not only the read and write speed is slow, but also it will cause IO waiting and blocking in the distributed video / picture storage environment, and because the index data is written into the zone sequentially, when the data block needs to be When the corresponding index information is deleted, it will only be deleted in units of zones, which is less efficient

Images