Virtual Storage Device Recovery via Real Device Metadata Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In storage systems, data loss can occur, making it difficult to reconstruct virtual storage devices (VSDs) from real storage devices (RSDs), especially when the discovery of data loss is delayed, and users need assistance to recover valuable data.

Innovation Solution

A system that maintains metadata coupling VSDs with RSDs allows users to identify recoverable data blocks and prioritize their recovery, by determining which RSDs need to be replaced and in what order, enabling the recovery of a maximum amount of valuable data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data loss occurs in RSDs, then data integrity is compromised, but reconstruction of VSDs becomes infeasible without proper metadata tracking

Engineering Contradiction:
Improvedata integrityVSAvoidreconstruction complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces metadata as an intermediary layer that tracks the relationship between VSDs and RSDs. This metadata serves as a mediator that enables reconstruction of VSDs from RSDs even when data loss occurs, by providing the necessary mapping information without requiring complex direct analysis of the storage devices themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms where the metadata is continuously updated and maintained to reflect the current state of VSD-RSD relationships. This feedback loop allows the system to detect data loss conditions and trigger appropriate reconstruction procedures based on the stored metadata information.

Inventive Principle:
Principle #23Feedback

2Loss of information

If complete data reconstruction is attempted, then all valuable data can be recovered, but the time and resources required increase significantly

Engineering Contradiction:
Improvedata recovery completenessVSAvoidrecovery time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent applies preliminary action by maintaining metadata in advance that documents the relationships between VSDs and RSDs before data loss occurs. This pre-established metadata enables rapid identification of which RSDs contain data for which VSDs, eliminating the need for time-consuming discovery processes after data loss is detected.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system segments the recovery process by using metadata to identify and prioritize specific VSDs or data blocks for reconstruction. Instead of attempting to reconstruct all data uniformly, the metadata enables selective recovery of the most valuable or critical data segments first, reducing overall recovery time.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If metadata is maintained to track VSD-RSD relationships, then data recovery is enabled, but system complexity increases

Engineering Contradiction:
Improvedata recovery easeVSAvoidmetadata management complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The metadata system is designed to be self-maintaining through automated processes that update the metadata as data is written or moved between VSDs and RSDs. This self-service approach reduces the manual complexity of metadata management while still providing comprehensive tracking information for data recovery operations.

Inventive Principle:
Principle #25Self-service

4Reliability

If RSDs are replaced to recover data, then data loss is mitigated, but the process requires user intervention and system downtime

Engineering Contradiction:
Improvedata availabilityVSAvoidsystem availability
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The metadata is prepared and maintained in advance, allowing the system to immediately identify which RSDs need to be replaced and what data needs to be recovered. This preliminary preparation minimizes the decision-making time and system downtime required when actual data loss occurs and RSD replacement becomes necessary.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9703655B1Recovery after data loss in a reliable distributed computing system
Publication Date: 2017.07.11 SCALE COMPUTING INC
  • US9703655B1 patent drawing
  • US9703655B1 patent drawing
  • US9703655B1 patent drawing

AI summary

Real system devices (RSD's) emulate virtual system devices (VSD's); system elements can use RSD's and manipulate VSD's, while users can only use VSD's. Identifying when RSD's have erroneous data. Providing a mapping of RSD's to VSD's, to recover a maximum set of VSD's. Providing a mapping of VSD's to RSD's, to recover a specified most valuable VSD. Reconstructing VSD's from RSD's having erroneous data, and coordinating with a user's assistance to couple RSD's in an order allowing data recovery. Metadata is maintained coupling data identifiable on VSD's with corresponding data on RSD's; it is possible to trace connections between RSD's and VSD's even without complete data.