Aggregate big file deletion method, apparatus and device, and computer storage medium

Abstract

The invention discloses an aggregate big file deletion method. The method comprises the steps of scanning an aggregate big file in an aggregate directory, and when the size of an invalid storage spaceis greater than a preset space threshold, adding the aggregate big file corresponding to the invalid storage space to a cleaning queue; according to identifiers corresponding to small files in the currently cleaned aggregate big file, judging whether the small files are to be reserved or not, and after the to-be-reserved small files are determined, writing the to-be-reserved small files in a newaggregate file; and when all the small files are traversed, deleting data in the aggregate big file and moving the aggregate big file out of the cleaning queue. When the size of the invalid storage space of the aggregate big file is greater than the preset space threshold, the to-be-reserved small files in the currently cleaned aggregate big file are written in the new aggregate file, then the aggregate big file is deleted, and the disk space is released, so that the disk utilization rate is increased. The invention furthermore discloses an aggregate big file deletion apparatus and device, anda computer storage medium.

Description

technical field [0001] The invention relates to the technical field of aggregated storage of small files, in particular to a method for deleting aggregated large files. The invention also relates to a device, equipment and computer storage medium for aggregating large files. Background technique [0002] In the application scenarios of massive small files such as social shopping websites, radio and television, and online videos, aggregate storage of small files is an important means to improve the utilization rate of the storage system and increase the speed of file reading. [0003] In the small file aggregation storage technology, multiple small files are aggregated with the aggregation object OBJ (object, object, data storage unit on the disk) as the unit, and the aggregation object OBJ is stored in the disk as the data of the aggregated large file. , which actually translates to reads of aggregated large file data. [0004] In the prior art, when deleting a small file ...

AI Technical Summary

Problems solved by technology

[0004] In the prior art, when deleting a small file in an aggregated large file, if the corresponding data of the file is deleted, it is necessary to first find the aggregated large file to which it belongs through the metadata information of the small file. If no other small files are stored in the aggregated large file, You can delete the aggregated large file directly, but when the aggregated large file stores other small file data at the same time, it cannot be deleted. You need to wait for all the files in the aggregated large file to be deleted before deleting all the data on the aggregated large file. This will cause the problem of not being able to free up disk space and reduce disk utilization

Images