Tiered Storage Extent Rebuilding with Priority-Based Pausing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage appliances face the risk of exposing critical data to unnecessary loss when a second drive fails during the rebuilding process of a first failed drive, as they continue rebuilding in priority order without addressing higher-priority extents from a second failed drive.
Innovation Solution
Implement a method to pause rebuilding of extents from a lower-priority tier and switch to rebuilding higher-priority extents if any are found to have failed, ensuring that critical data is protected by prioritizing their recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional systems continue rebuilding extents in priority order without checking for new failures, then rebuilding process is simple and continuous, but critical data from second failed drive is exposed to greater risk of loss
Solution Approach 1:
The system implements a feedback mechanism where the notification handler continuously monitors for new drive failures during the rebuilding process. When a new failure is detected, the system receives notification, determines the tier priority of the new failure, and adjusts the rebuilding sequence accordingly by pausing current rebuilding and switching to higher-priority extents.
Solution Approach 2:
The rebuilding process is made dynamic by allowing the system to adapt its rebuilding sequence in real-time based on new failure conditions. The notification handler enables the system to dynamically switch between rebuilding lower-priority and higher-priority extents, ensuring that critical data is always prioritized while maintaining operational flexibility.
2Reliability
If the system switches to rebuild higher-priority extents when new failures occur, then data protection is improved, but rebuilding process requires pausing and resuming which reduces productivity
Solution Approach 1:
The system performs preliminary checks to determine the tier priority of newly failed extents before committing to switching the rebuilding sequence. By evaluating priority levels in advance, the system ensures that switches to higher-priority rebuilding only occur when necessary, minimizing unnecessary interruptions and maintaining overall rebuilding efficiency.
Solution Approach 2:
The system applies different rebuilding priorities to different extents based on their tier classification. Rather than uniformly treating all extents, the notification handler identifies which specific extents require immediate attention based on their priority level, allowing critical data to be rebuilt first while less critical extents continue in the background.
3Reliability
If the system monitors for new failures during rebuilding, then data protection against multiple failures is improved, but system complexity and processing overhead increase
Solution Approach 1:
The notification handler serves as a self-service monitoring mechanism that automatically detects new drive failures and triggers appropriate responses without requiring external intervention. The system monitors its own state, determines priority levels, and autonomously adjusts the rebuilding sequence, reducing the need for complex external monitoring infrastructure.
Data Source
AI summary
A method of responding to failures in a tiered storage system is provided. The method includes (a) rebuilding a set of failed storage extents belonging to a first storage tier; (b) receiving a notification that a particular storage extent has failed while rebuilding the set of failed storage extents belonging to the first tier; and (c) upon determining that the particular storage extent belongs to a second storage tier that has a higher priority than does the first storage tier: (1) pausing rebuilding the set of failed storage extents belonging to the first storage tier, (2) rebuilding the particular storage extent, and (3) resuming rebuilding the set of failed storage extents belonging to the first storage tier after rebuilding the particular storage extent. An apparatus, system, and computer program product for performing a similar method are also provided.