Distributed Storage Network Data Integrity via Error-Coded Slices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computer storage systems face challenges with data integrity and security due to the failure of memory devices, particularly those using physical movement technologies, which can lead to data loss and increased maintenance demands, and RAID systems suffer from efficiency and security issues as they attempt to mitigate these problems.
Innovation Solution
A distributed storage network with error-coded data slices is implemented, where data is partitioned into segments, encoded, and stored across multiple geographically diverse locations, allowing for reliable and secure data retrieval and integrity verification, even in the presence of device failures, using a DS managing unit, DS processing unit, and storage integrity processing unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in conventional memory devices, then storage capacity is achieved, but data integrity deteriorates due to device failure and bit corruption
Solution Approach 1:
The patent divides data into multiple segments and distributes them across different storage units. Each segment is independently stored, so that if one storage unit fails, other segments remain intact and can be used for data reconstruction through error correction coding.
Solution Approach 2:
The patent introduces error correction codes as an intermediary layer between the data and storage media. These codes enable the system to detect and correct bit corruptions without requiring redundant copies of the entire data, thus maintaining data integrity while reducing storage overhead.
2Reliability
If RAID systems are used to protect against data loss, then data security improves, but system complexity and overhead increase
Solution Approach 1:
The patent changes the fundamental parameter of redundancy from storing complete data copies (RAID approach) to storing error correction codes that require minimal overhead. This parameter change allows the system to achieve comparable or superior reliability with significantly reduced storage overhead and simplified system architecture.
3Reliability
If multiple redundant storage systems are implemented, then data reliability improves, but storage efficiency deteriorates due to overhead
Solution Approach 1:
Instead of creating multiple complete copies of data as in traditional redundancy systems, the patent uses error correction codes that act as compact representations of redundancy information. These codes enable reconstruction of original data with minimal storage overhead, thus maintaining high storage efficiency while ensuring data reliability.
Data Source
AI summary
A method begins with a processing module issuing a set of write requests regarding storing a set of encoded data slices in dispersed storage network (DSN) memory and confirming that at least a write threshold number of encoded data slices have been temporarily stored in the DSN memory. When confirmed, the method continues with the processing module issuing a second set of write requests regarding storing a set of encoded directory slices in the DSN memory and confirming that at least a second write threshold number of encoded directory slices have been temporarily stored in the DSN memory. When confirmed, the method continues with the processing module issuing write commit requests regarding the at least a write threshold number of encoded data slices and the at least a second write threshold number of encoded directory slices.