Object Metadata Recovery for Space-Reclaimed Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional object storage systems lack a recycle bin design, leading to unrecoverable objects during space reclamation, resulting in storage space wastage and increased costs, and the recovery process is time-consuming due to the need to restart log parsing during updates.
Innovation Solution
Parse object metadata from logs and store it in a dedicated storage space for rapid retrieval, allowing for instant recovery by reestablishing chunk linkages based on retrieved metadata, thus avoiding impact on space reclamation and reducing recovery time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional object storage systems perform space reclamation by deleting chunks, then storage space is freed, but objects become unrecoverable and storage space is wasted
Solution Approach 1:
The system performs preliminary actions by parsing and storing object metadata in a dedicated storage space before space reclamation occurs. This metadata includes information about object-chunk linkages that can be used to recover objects even after the original chunks are deleted, thus preventing storage space waste while enabling recovery
Solution Approach 2:
The patent introduces an intermediary mechanism (the dedicated storage space for metadata) that acts as a mediator between the object storage system and the recovery process. This intermediary stores the linkage information needed for recovery, allowing the system to distinguish between actual data deletion and temporary unavailability, thereby maintaining both space utilization and recoverability
2Reliability
If the system restarts log parsing during object recovery updates, then recovery can be performed, but the recovery process becomes time-consuming
Solution Approach 1:
The system performs the time-consuming log parsing action in advance during normal operation, storing the extracted object metadata in a dedicated storage space. When recovery is needed, the system can directly retrieve the pre-parsed metadata without restarting the log parsing process, thus significantly reducing recovery time while maintaining recovery capability
Solution Approach 2:
The patent creates a copy of the essential recovery information (object metadata and chunk linkage data) in a dedicated storage space. This copy allows the recovery process to proceed independently of the original log parsing operations, enabling fast retrieval and reestablishment of object linkages without time-consuming restarts
3Productivity
If the system stores parsed object metadata in storage space, then recovery can be performed rapidly, but additional storage space is consumed
Solution Approach 1:
The system extracts only the essential metadata information (object-chunk linkage data) from the logs and stores it in a dedicated storage space, rather than storing complete log records or all object data. This extraction approach minimizes the additional storage space consumed while enabling rapid recovery operations
Solution Approach 2:
The patent applies local quality by creating a dedicated storage space specifically for metadata, separating this function from the main object storage. This localized approach ensures that the metadata storage does not interfere with normal object storage operations and allows for optimized retrieval during recovery, improving productivity without proportionally increasing overall storage consumption
Data Source
AI summary
The subject technology relates to recovering an object in a storage system. For instance, an object in a storage system is recovered by parsing object metadata associated with the object from a log in the storage system and storing the parsed object metadata in a storage space. In response to receiving a request to recover the object, the parsed object metadata from the storage space is retrieved. A linkage can be reestablished to a chunk corresponding to the object based on the retrieved object metadata. In this way, space reclamation is not impacted during recovery for the object, thereby increasing the space utilization. Furthermore, the time spent in the recovery process is reduced, and the success rate of object recovery is increased.