Cloudcache for Object Storage-Based File System Snapshot Retention
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern data backup systems face inefficiencies in managing snapshots, leading to increased data storage and prolonged backup and restore workflows, along with high network resource usage.
Innovation Solution
Implementing a cloudcache system within a client premise that facilitates data backup, restore, and sync operations using a cloudcache implementation module, which manages data blocks and metadata through a merge index database, and performs sync operations based on a retention policy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple snapshots are stored in the file system to enable data backup and restore operations, then data reliability is improved, but the amount of data stored increases proportionally with the number of snapshots
Solution Approach 1:
The patent segments the storage system into two distinct parts: cloudcache (local cache storage at client premises) and object storage (centralized cloud storage). This segmentation allows snapshots to be distributed across both locations, reducing the burden on any single storage system and enabling efficient data retention management while maintaining data reliability.
Solution Approach 2:
The cloudcache acts as an intermediary between the client and the object storage system. It temporarily holds data blocks and metadata locally, reducing the need to store complete snapshots in the object storage. This intermediary role enables the system to maintain multiple snapshots for reliability while minimizing the total data stored in the file system by keeping redundant data in the local cache.
2Reliability
If multiple snapshots are maintained in the system to ensure data backup capability, then data protection is improved, but the time required for backup and restore workflows increases
Solution Approach 1:
The system performs preliminary actions by pre-caching data blocks and metadata in the cloudcache before they are needed for restore operations. The cloudcache implementation module proactively manages data retention and synchronization, so when a restore operation is initiated, the required data is already available locally or can be quickly retrieved, significantly reducing the actual restore time.
Solution Approach 2:
The cloudcache serves as an intermediary that accelerates backup and restore workflows by providing fast local access to data blocks and metadata. Instead of directly accessing object storage for every operation, the system uses the cloudcache as a buffer, reducing the time required for data retrieval and processing while maintaining data protection through coordinated synchronization between cache and cloud storage.
3Reliability
If complete snapshots are stored in object storage for backup purposes, then data recoverability is improved, but network resource usage during sync operations increases
Solution Approach 1:
The patent extracts only the essential data blocks and metadata needed for data recovery from the complete snapshots and stores them in the cloudcache. Rather than synchronizing entire snapshots between cloudcache and object storage, the system identifies and transfers only the necessary data blocks, significantly reducing network resource usage while maintaining data recoverability through selective caching and intelligent synchronization strategies.
Data Source
AI summary
The present invention discloses a file storage system including an object storage for storing data blocks for a client, a merge index database to store metadata corresponding to the stored data blocks using a merge index, a cloudcache located on a premise of the client, and a cloudcache implementation module communicatively coupled to the object storage, the cloudcache and the merge index database. The cloudcache implementation module facilitates data backup and restore operations for the client in accordance with a data retention policy, where one or more data blocks are stored on the cloudcache and a sync operation is performed between the cloudcache and the object storage. A backup of the data blocks is performed to the cloudcache in a backup operation, data blocks are compacted, and a restore operation for data blocks stored on the cloudcache are performed in accordance with the data retention policy.