Storage System Spare Block Allocation for RAID Rebuild

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional RAID techniques face challenges in ensuring sufficient capacity for distributed RAID rebuild processes, particularly when the total number of blocks per stripe is less than the number of storage devices, leading to complex calculations or excessive spare capacity allocation, which degrades storage system performance.

Innovation Solution

The proposed solution involves reserving spare blocks across storage devices in a manner that guarantees sufficient capacity for rebuilds by designating multiple devices as spares for each stripe and determining the number of spare blocks needed based on failure combinations, allowing shared use of spare blocks across devices, thus ensuring minimal reserved capacity is used.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional RAID techniques are used to ensure sufficient capacity for distributed RAID rebuild processes, then rebuild capacity is guaranteed, but complex calculations are required and storage system performance degrades

Engineering Contradiction:
Improverebuild capacity guaranteeVSAvoidcalculation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing the number of spare blocks needed for each storage device in advance, based on all possible failure combinations. This pre-computed information is stored in metadata, eliminating the need for complex real-time calculations during rebuild operations. The system determines spare block requirements beforehand for single, dual, and triple failure scenarios, and stores these values for quick retrieval during actual rebuilds.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If conventional RAID techniques allocate excessive spare capacity to each device, then sufficient rebuild capacity is available, but storage device capacity is wasted and system performance degrades

Engineering Contradiction:
Improverebuild capacity availabilityVSAvoidstorage capacity waste
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The patent applies local quality by determining the exact number of spare blocks needed for each specific storage device based on its role in different failure combinations. Instead of uniformly allocating excessive spare capacity to all devices, the system calculates precise requirements for each device considering all possible failure scenarios (single, dual, triple failures). This per-device optimization ensures each storage device has exactly the right amount of spare capacity needed, minimizing waste while maintaining rebuild guarantees.

Inventive Principle:
Principle #3Local quality

3Productivity

If the total number of blocks per stripe is less than the number of storage devices, then distributed RAID efficiency is improved, but it becomes unduly difficult to ensure sufficient available capacity for rebuilds

Engineering Contradiction:
Improvedistributed RAID efficiencyVSAvoidrebuild capacity sufficiency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent resolves this contradiction by pre-calculating spare block requirements for all possible failure combinations before the actual failure occurs. The system determines, for each storage device, the exact number of spare blocks needed considering all scenarios where that device or other devices might fail. These pre-computed values are stored in metadata, enabling the system to guarantee sufficient rebuild capacity even when blocks per stripe are fewer than storage devices, without requiring complex real-time calculations during rebuild operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11169880B1Storage system configured to guarantee sufficient capacity for a distributed raid rebuild process
Publication Date: 2021.11.09 EMC IP HLDG CO LLC
  • US11169880B1 patent drawing
  • US11169880B1 patent drawing
  • US11169880B1 patent drawing

AI summary

A storage system comprises a plurality of storage devices, and is configured to establish a redundant array of independent disks (RAID) arrangement comprising a plurality of stripes, with each of the plurality of stripes comprising a plurality of blocks, the blocks being distributed across multiple ones of the storage devices. In conjunction with establishment of the RAID arrangement, the storage system is further configured, for each of the plurality of stripes, to designate multiple ones of the storage devices as respective spare devices for that stripe, and for each of the storage devices, to determine numbers of the stripes for which that storage device is designated as a spare device for respective ones of the other storage devices in each of multiple spare levels and for each of multiple failure combinations. A particular number of spare blocks is reserved for each of the storage devices using the determined numbers.