4 results about "OMAP" patented technology

The invention provides a life cycle deletion optimization method for a distributed object storage system, which comprises the following steps of: S1, detecting the business volume of a cluster, starting a pre-scanning operation when the business volume is lower than a preset threshold value, and identifying an object to be deleted according with a life cycle rule; s2, respectively writing the to-be-deleted object information of different dates into corresponding omaps, and storing omap data in a disk according to a preset packaging frequency; s3, when the life cycle expires, directly reading the omap of the corresponding date, skipping a real-time scanning step, and executing batch deletion operation; and S4, recording statistical information such as the deletion quantity scanned every day on the xattr of the barrel, so that management software performs data trend analysis and operation and maintenance decision. According to the embodiment of the invention, the life cycle deletion efficiency can be improved, the metadata operation pressure is reduced, and the cluster storage space utilization rate is optimized.

The present application discloses a data deletion method, apparatus, device, and computer-readable storage medium, which relate to the field of expiration deletion. The method includes: when an object in an object storage bucket is moved to the recycle bin, an index shard of the object storage bucket is established; the object information and deletion time of the object are saved to the index shard through an omap key-value pair, where the key in the omap key-value pair includes the deletion time and the object name, and the keys are sorted according to the deletion time; the object to be deleted is determined according to the deletion time, and the object to be deleted and the corresponding omap key-value pair are deleted. When an object is deleted, an index shard is established for the object storage bucket, and the object information and deletion time of the object are saved in the index shard in the form of an omap key-value pair. The key includes the deletion time and object name of the object, and the keys are sorted according to the deletion time. The object to be deleted is determined according to the deletion time of the object, without having to traverse all the objects in the recycle bin, reducing the traversal operation.

The present invention relates to the field of object storage technology, specifically a radosgw shard residual data cleaning method, comprising the following steps: judging whether the working time is met; judging whether the time interval from the last cleaning exceeds the set time interval; judging whether the memory list to be cleaned is empty; judging whether the file list to be cleaned is empty; the beneficial effect is: the radosgw shard residual data cleaning method proposed by the present invention separates the cleaning of shard residual index data from the shard thread, and a separate cleaning thread is responsible for the cleaning. The working time and cleaning quantity of the cleaning thread can be controlled, and whether to clean can also be flexibly controlled according to the cluster pressure. The present invention can significantly reduce the pressure on the cluster caused by the simultaneous cleaning of a large amount of shard residual index data, thereby causing the problem of decreased or peak service capacity, and also avoids the problem of read amplification of the rocksdb database of the backend osd caused by the mixing of a large amount of reading and deleting omap.