RAID Rebuild via Physical-Virtual Block Relationship Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In RAID storage systems, the rebuild process after a drive failure is inefficient due to the lack of knowledge about invalidated blocks, leading to rebuilding of unreferenced data, which increases rebuild time and data fragmentation, especially with larger drives and more complex data paths.

Innovation Solution

The implementation of a method to identify and write information about the relationship between physical layer blocks and virtual logic blocks within the RAID storage, including back pointers, allowing the system to rebuild only referenced data by maintaining these relationships at the RAID level, thereby speeding up the rebuild process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the rebuild process recreates all data on a failed drive using survived data and code blocks, then data redundancy and reliability are maintained, but rebuild time increases significantly especially with larger drives

Engineering Contradiction:
Improvedata redundancyVSAvoidrebuild time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts and stores metadata information about the relationship between physical layer blocks and virtual logic blocks separately from the main data storage. This metadata layer enables the system to identify which physical blocks contain valid, referenced data that needs to be rebuilt, extracting only the necessary reconstruction information rather than rebuilding all data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary action by maintaining and updating metadata that tracks the relationship between physical blocks and virtual logic blocks during normal operations. This pre-established knowledge structure allows the rebuild process to immediately identify which blocks need reconstruction without having to analyze the entire drive contents during the failure recovery process.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system rebuilds all data on a failed drive, then complete data recovery is ensured, but data fragmentation increases and rebuild efficiency decreases

Engineering Contradiction:
Improvedata recovery completenessVSAvoidrebuild efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent introduces metadata as an intermediary layer between the physical storage medium and the logical data structure. This metadata acts as a mediator that provides knowledge about which physical blocks contain valid data, enabling the rebuild process to selectively reconstruct only necessary blocks rather than all data, thus improving efficiency while maintaining recovery completeness.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of time

If metadata about block relationships is maintained at the RAID level, then only referenced data needs to be rebuilt, but system complexity increases

Engineering Contradiction:
Improverebuild timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent segments the storage system into distinct layers: the physical layer for data storage and a metadata layer for relationship tracking. This segmentation allows the metadata about block relationships to be maintained separately and independently, adding functionality without significantly complicating the core storage operations. The metadata structure is organized in a manageable, modular way that facilitates efficient access during rebuild operations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11520522B2System and method for faster RAID rebuild via allocation knowledge
Publication Date: 2022.12.06 EMC IP HLDG CO LLC
  • US11520522B2 patent drawing
  • US11520522B2 patent drawing
  • US11520522B2 patent drawing

AI summary

A method, computer program product, and computer system for identifying, by a computing device, information associated with a relationship between a physical layer block and a virtual logic block for RAID storage. The information associated with the relationship between the physical layer block and the virtual logic block may be written within the RAID storage. The physical layer block within the RAID storage may be rebuilt only when the physical layer block includes the information associated with the relationship between the physical layer block and the virtual logic block.