Automated Data Recovery from Remote Replicas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mass-scale data storage systems, the manual process for recovering data from remotely stored replicas is inefficient due to the lack of scalability in tracking replica locations and availability across multiple data centers, leading to unavailability of information to all nodes.
Innovation Solution
A system and method for automatically recovering data objects by storing replicas across multiple data centers, recording health information, calculating query-priority, and restoring data from available replicas based on calculated restoration-priority, utilizing a priority queue for optimized recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual process is used for recovering data from remotely stored replicas, then administrative assistance can be provided, but the process becomes inefficient and non-scalable
Solution Approach 1:
The system implements automated data recovery where the storage system itself performs recovery operations without requiring manual administrative assistance. The automated recovery manager monitors replica health, identifies available replicas, and executes restoration operations automatically, transforming the manual process into a self-service automated system that maintains reliability while dramatically improving efficiency
Solution Approach 2:
The patent replaces the manual mechanical process of administrative assistance with an automated software-based system. The automated recovery manager uses electronic monitoring, querying, and restoration mechanisms to substitute human administrative operations, thereby eliminating the inefficiencies of manual processes while maintaining the reliability of administrative oversight through automated decision-making
2Reliability
If multiple data centers are distributed remotely, then risk mitigation against catastrophic events is improved, but tracking replica locations and availability becomes complex
Solution Approach 1:
The automated recovery manager serves multiple functions: it monitors replica health, tracks replica locations across distributed data centers, queries availability status, calculates priority metrics, and executes restoration operations. This universal component consolidates multiple tracking and management functions into a single system, reducing overall complexity while maintaining comprehensive oversight of replicas across remotely distributed data centers for risk mitigation
3Device complexity
If information about replica locations is not readily scalable, then system size can be reduced, but information becomes unavailable to all nodes
Solution Approach 1:
The automated recovery manager acts as an intermediary component that centralizes the collection and management of replica location and availability information. Instead of requiring every node to maintain scalable information about all replicas, the recovery manager mediates by maintaining this information centrally and providing it to nodes that need it, thereby solving the scalability problem while ensuring information availability through this intermediary service
Data Source
AI summary
Machines, systems and methods for recovering data objects in a distributed data storage system, the method comprising storing one or more replicas of a first data object on one or more clusters in one or more data centers connected over a data communications network; recording health information about said one or more replicas, wherein the health information comprises data about availability of a replica to participate in a restoration process; calculating a query-priority for the first data object; querying, based on the calculated query-priority, the health information for the one or more replicas to determine which of the one or more replicas is available for restoration of the object data; calculating a restoration-priority for the first data object based on the health information for the one or more replicas; and restoring the first data object from the one or more of the available replicas, based on the calculated restoration-priority.