Encoded Data Slice Rebuild Using Storage Unit Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and security due to the failure of physical movement-based memory devices, such as disc drives, which can lead to bit-level corruption and require costly redundancy solutions like RAID, increasing maintenance demands and security risks with multiple copies of data.
Innovation Solution
A distributed storage network (DSN) system that uses error coding dispersal storage functions to partition data into slices, distribute them across multiple physically diverse locations, and employs a storage integrity processing unit for verification and rebuilding, ensuring data integrity and security through redundancy without the overhead of RAID.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple copies of data are stored for redundancy, then data reliability is improved, but security risk increases due to unauthorized access
Solution Approach 1:
The patent segments data into multiple encoded slices distributed across different storage units. Instead of storing complete copies, the data is divided and encoded such that a threshold number of slices are needed to reconstruct the original data. This segmentation approach maintains reliability through distribution while enhancing security, as individual slices are useless without the threshold requirement.
Solution Approach 2:
The patent introduces error correction codes as an intermediary mechanism between the original data and storage units. These codes enable recovery from failures without requiring exact copies, acting as a mediator that provides reliability through mathematical reconstruction rather than physical duplication. This intermediary layer reduces security risks while maintaining data availability.
2Reliability
If RAID redundancy solutions are used, then data integrity is improved, but device complexity and maintenance demands increase
Solution Approach 1:
The system segments data into encoded slices distributed across storage units, eliminating the need for complex RAID controller hardware and software. Each storage unit independently stores encoded portions, simplifying the overall system architecture while maintaining data integrity through the encoding scheme.
Solution Approach 2:
The patent implements self-healing capabilities where the system automatically detects missing or corrupted slices and reconstructs them using error correction codes without requiring manual intervention. This self-service approach reduces maintenance demands while ensuring data integrity, as the system autonomously handles recovery operations.
3Quantity of substance
If physical movement-based memory devices are used, then storage capacity is improved, but data corruption risk increases due to mechanical failures
Solution Approach 1:
The patent segments data across multiple storage units with encoded redundancy, so that mechanical failures of individual devices do not result in data loss. The segmentation distributes risk across multiple components, allowing the system to tolerate physical failures while maintaining overall reliability.
Solution Approach 2:
The system implements beforehand cushioning through error correction codes and redundant encoded slices stored across multiple devices. This preparatory measure ensures that if mechanical failures occur, the data can be recovered from remaining slices, cushioning against the harmful effects of physical device failures.
Data Source
AI summary
A method begins with a processing module of a dispersed storage network (DSN) identifying an encoded data slice of a set of encoded data slices that requires rebuilding and identifying storage units of the DSN that store the set of encoded data slices. The method continues with the processing module determining a rebuilding metric regarding the identified encoded data slice and selecting a sub-set of the storage units for retrieving a decode threshold number of encoded data slices of the set of encoded data slices based on the rebuilding metric. When the decode threshold number of encoded data slices have been retrieved, the method continues with the processing module decoding the decode threshold number of encoded data slices to produce a reconstructed data segment and generating a rebuilt encoded data slice from the reconstructed data segment.