Peer-Assisted Data Slice Rebuilding for Distributed Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current dispersed storage systems face performance issues when rebuilding erroneous or missing data, as they often rely on their own resources, which can impact read/write performance of valid data.
Innovation Solution
The system distributes the rebuilding of corrupted or missing encoded data slices across other storage units in the network, allowing an alternate DS unit to perform the rebuilding operations, thereby reducing the load on the affected unit and enhancing rebuilding speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the memory storage device uses its own resources to rebuild corrupted data, then data rebuilding can be performed, but read/write performance of valid data is adversely impacted
Solution Approach 1:
The patent extracts the data rebuilding function from the affected memory storage device and relocates it to a different storage device within the RAID array. When a storage device detects corrupted data, it sends a rebuild request to another device, which then performs the rebuilding operation using redundant data from other devices in the array, preventing performance degradation on the original device.
Solution Approach 2:
The patent introduces an intermediary storage device that acts as a mediator in the data rebuilding process. The affected device requests help from another device, which serves as an intermediary to perform the actual rebuild operation by retrieving redundant data from other devices and reconstructing the corrupted data, thereby isolating the performance impact.
2Reliability
If conventional systems rely on the memory storage device itself to rebuild corrupted data, then data can be recovered, but the rebuilding process is slow and impacts system performance
Solution Approach 1:
The patent merges multiple resources (CPU power, storage bandwidth, network connectivity) from different RAID array devices to perform the rebuilding operation collectively. Instead of one device working alone, the system combines resources across multiple devices to accelerate the data rebuilding process while maintaining data recovery capability.
Data Source
AI summary
A distributed storage network (DSN) stores sets of encoded data slices in sets of storage units. A first storage unit assigned to store an encoded data slice included in a set of encoded data slices transmits a rebuild request associated with the storage error to a second storage unit. The second storage unit generates the rebuilt encoded data slice in response to the rebuild request, and transmits the rebuilt encoded data slice back to the first storage unit, which stores the rebuilt encoded data slice.