Cloud File System Snapshot Restore Orphan Object Cleanup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges in managing orphan cloud objects during snapshot restore operations, leading to inefficient use of cloud storage resources and increased resource costs due to orphan archived files.
Innovation Solution
The proposed solution involves intercepting user requests for snapshot restore operations, creating a current snapshot, and performing a synchronization process that deletes orphan cloud objects in the cloud storage platform, thereby efficiently handling orphan archived files during the restoration process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a snapshot restore operation is performed on a cloud-enabled file system, then the file system is restored to a previous state, but orphan cloud objects are created in the cloud storage platform leading to resource waste
Solution Approach 1:
The system creates a current snapshot of the file system before performing the restore operation. This preliminary action captures the state of all files and enables subsequent identification and deletion of orphan cloud objects that result from the restore, preventing resource waste while maintaining reliable snapshot restoration
Solution Approach 2:
The system performs a synchronization operation after the snapshot restore that compares the restored file system state with the cloud storage platform. This feedback mechanism identifies orphan cloud objects (files that exist in the cloud but no longer exist in the local file system) and triggers their deletion, thereby eliminating resource waste caused by the restore operation
2Loss of substance
If cloud objects are deleted during synchronization, then orphan archived files are cleaned up, but additional synchronization operations are required increasing system complexity
Solution Approach 1:
The system merges the synchronization operation with the existing snapshot restore workflow. By integrating the orphan object identification and deletion processes into the standard synchronization mechanism already used for cloud-enabled file systems, the system cleans up orphan archived files without requiring entirely new complex systems, thereby reducing overall system complexity while achieving effective orphan file management
Data Source
AI summary
Methods, apparatus, and processor-readable storage media for efficient synchronization of a cloud enabled file system database during a snapshot restore operation are provided herein. An example computer-implemented method includes intercepting a user request to initiate a snapshot restore operation on a file system associated with a local storage system, wherein the file system comprises one or more stub files that are indicative of locations of cloud objects comprising files that were previously sent from the local storage system to a cloud storage platform; prior to the snapshot restore operation being performed, creating a current snapshot of the file system; obtaining an indication that the file system was successfully restored on the local storage system; and using the current snapshot to perform a synchronization operation, wherein the synchronization operation deletes one or more orphan cloud objects in the cloud storage platform that resulted from the snapshot restore operation.