Object Storage Data Recovery via Local Caching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data backup systems face challenges in maintaining regular backup copies of increasing data volumes, as even reliable storage devices can fail, and RAID configurations do not protect against user errors or accidental file deletions, necessitating a cost-effective and reliable data restoration solution.
Innovation Solution
A system and method for restoring data from an object-based storage system, where a recovery module retrieves recovery objects from an object store, determines available recovery points, and offers on-demand recovery options, caching data locally to reduce overhead and improve performance by only retrieving data as needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If cloud-based storage service is used for data backups, then storage cost and accessibility are improved, but data retrieval speed and system compatibility are worsened
Solution Approach 1:
The system performs preliminary actions by pre-processing and caching frequently accessed backup data in local storage before it is actually needed. This allows the system to maintain cloud-based storage for capacity while having fast local copies ready for quick retrieval, thus resolving the contradiction between storage quantity and retrieval speed.
Solution Approach 2:
The patent implements local quality by creating location-specific optimizations: hot data is cached locally in high-speed storage, while cold data remains in cloud storage. This differential approach based on data access patterns allows the system to provide fast retrieval for critical data while maintaining economical cloud storage for archival data.
2Quantity of substance
If cloud-based storage service is used for data backups, then storage cost and accessibility are improved, but data retrieval speed and system compatibility are worsened
Solution Approach 1:
The patent applies universality by designing a multi-functional backup system that can handle multiple storage protocols and data formats through a unified interface. The system can work with different cloud providers and storage types (object storage, block storage, file storage) while presenting a consistent API to applications, thus improving compatibility despite the added complexity of cloud integration.
Solution Approach 2:
The patent introduces an intermediary layer (backup agent and management software) that mediates between the cloud storage service and the local system. This intermediary handles protocol conversions, data formatting, and access coordination, making the system compatible with various cloud providers while maintaining a consistent local interface.
3Reliability
If traditional backup systems are used, then data redundancy is improved, but protection against user errors and accidental deletions is worsened
Solution Approach 1:
The backup system applies universality by providing multi-functional protection that covers not only hardware failures (through redundancy) but also user errors and accidental deletions. The system maintains multiple backup copies with versioning capabilities, allowing recovery from any point in time, thus expanding the scope of protection beyond what traditional RAID configurations provide.
Solution Approach 2:
The patent implements beforehand cushioning by creating multiple backup copies and maintaining version history before user errors or catastrophic failures occur. This allows the system to cushion against various failure modes including accidental deletions, ransomware attacks, and hardware failures by having pre-prepared recovery points.
Data Source
AI summary
A system and method for recovering data backed up to an object store are provided. In some embodiments, the method includes identifying an address space of a data set to be recovered. A set of data objects stored by an object-based system is identified that corresponds to the address space and a selected recovery point. The identified set of data objects is retrieved, and data contained in the retrieved set of data objects is stored to at least one storage device at a block address determined by the retrieved set of data objects to recreate the address space. In some embodiments, the set of data objects is retrieved by providing an HTTP request and receiving the set of data objects as an HTTP response. In some embodiments, the set of data objects are retrieved based on the data objects being the target of a data transaction.