Failed Storage Device Self-Rebuild via Peer-to-Peer Data Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data reconstruction and rebuild processes for failed storage devices in storage systems cause significant performance degradation due to the need for remaining devices to handle data reconstruction, which can be resource-intensive and affect system performance.
Innovation Solution
The failed storage device participates in the data reconstruction and rebuild process through peer-to-peer communication with functioning devices, utilizing its own compute and storage resources, and takes into account the actual failure mechanism, such as partial media failure, to limit reconstruction to only the affected areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional data reconstruction processes are used where remaining functioning storage devices handle data reconstruction for a failed device, then data redundancy and system reliability are maintained, but system performance degrades significantly due to the resource-intensive nature of the reconstruction process
Solution Approach 1:
The failed storage device performs data reconstruction for itself using its own remaining compute resources and storage capacity. The device identifies its own failed portions, retrieves necessary data and redundancy information from other devices, and reconstructs its data independently, eliminating the performance burden on other functioning devices while maintaining data redundancy
2Reliability
If the entire failed storage device is used for data reconstruction even when only partial media failure occurs, then complete data recovery is ensured, but system performance degradation increases proportionally to the entire device rather than just the failed portion
Solution Approach 1:
The system performs data reconstruction only for the specific failed portions of the storage device rather than treating the entire device as failed. By identifying and targeting only the affected media sections, the reconstruction process recovers necessary data while minimizing performance degradation to proportionate only the actual data lost rather than all data on the device
Data Source
AI summary
Methods, systems, and other aspects for reconstructing data and rebuilding a failed storage device in a storage system using one or more functioning compute resources and/or storage resources of the failed storage device. For example, a method may include, responsive to a detection of a failed storage device in a storage system, locating data and redundancy information in functioning storage device(s) in the storage system for reconstructing data of the failed storage device; issuing peer-to-peer commands to the functioning storage device(s) to obtain the data and the redundancy information from the functioning storage device(s); and reconstructing the data of the failed storage device based on the data and the redundancy information obtained from the functioning storage device(s), wherein a functioning compute resource of the failed computing device at least partially performs one or more of the locating, issuing, and reconstructing.