Distributed Storage Data Recovery Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed storage systems face challenges in enhancing reliability due to limitations in dynamically prioritizing data recovery, especially for highly vulnerable data, which is often hindered by hardware implementation or licensing restrictions.
Innovation Solution
A method and system that dynamically identify highly vulnerable data and create temporary replicas using existing APIs, allowing for prioritized recovery without altering the primary data recovery infrastructure, thereby enhancing system reliability by focusing on the most at-risk data first.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional replication schemes are used to ensure data reliability, then data loss protection is provided, but the system cannot dynamically prioritize recovery of highly vulnerable data
Solution Approach 1:
The system performs preliminary identification of highly vulnerable data before failures occur. By proactively determining which data objects have the fewest replicas and are therefore most at risk, the system can prioritize their recovery without waiting for actual failures, thus resolving the contradiction between maintaining reliability and enabling dynamic prioritization.
Solution Approach 2:
The patent introduces an intermediary software layer that sits between the storage system and the hardware recovery mechanisms. This intermediary uses APIs to communicate with the hardware without modifying it, enabling dynamic prioritization of highly vulnerable data while preserving the existing hardware implementation and licensing terms.
2Reliability
If hardware-based recovery mechanisms are used, then recovery functionality is provided, but modifications to prioritize vulnerable data are prohibited by licensing
Solution Approach 1:
The system introduces a software intermediary layer that communicates with hardware recovery mechanisms through existing APIs. This intermediary enables dynamic prioritization of highly vulnerable data by orchestrating recovery operations through the hardware without requiring modifications to the hardware itself, thus maintaining licensing compliance while achieving adaptability.
Solution Approach 2:
The patent replaces hardware-based decision-making for recovery prioritization with a software-based system. Instead of modifying hardware recovery mechanisms, the system uses software logic to identify highly vulnerable data and directs recovery operations accordingly, substituting mechanical/hardware control with software control.
3Reliability
If all data is restored during failure recovery, then complete data recovery is achieved, but the system remains vulnerable to additional failures during the restoration process
Solution Approach 1:
The system applies local quality by differentiating between highly vulnerable data and other data during recovery operations. Instead of treating all data equally, the system prioritizes restoration of highly vulnerable data (those with the fewest replicas) first, reducing the window of vulnerability during recovery while still achieving complete data restoration eventually.
Solution Approach 2:
The system performs preliminary identification of highly vulnerable data before the recovery process begins. This preliminary action enables the system to immediately prioritize restoration of the most critical data objects, reducing the time the system spends in a vulnerable state during recovery while ensuring complete data restoration is still achieved.
Data Source
AI summary
Machines, systems and methods for enhancing data recovery in a data storage system, the method comprising determining whether one or more data storage mediums in a data storage system are unavailable; determining data that are at a risk of loss, due to said one or more data storage mediums being unavailable; from among the data that is determined to be at the risk of loss, identifying data that is highly vulnerable to loss; and creating one or more temporary replicas of the data that is highly vulnerable to loss.