Dispersed Storage Recovery Using Threshold Slice Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current dispersed storage networks face challenges in ensuring data integrity and availability across multiple storage units, particularly in scenarios where data corruption or loss occurs due to failures in storage units, without relying on redundant copies.
Innovation Solution
The implementation of a dispersed storage network (DSN) that uses error encoding techniques, such as Cauchy Reed-Solomon encoding, to distribute data across multiple storage units, allowing for data recovery even if some units fail, by encoding data into multiple slices that can be decoded from a threshold number of available slices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is distributed across multiple storage units without redundant copies, then storage efficiency is improved, but data reliability deteriorates when storage units fail
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage units. Each slice contains a portion of the encoded data, allowing the system to store data efficiently without complete redundant copies while maintaining the ability to reconstruct the original data from a threshold number of slices even when some storage units fail
Solution Approach 2:
The patent employs error encoding techniques that transform the data into encoded slices with specific mathematical properties. By changing the parameter of data representation through encoding functions, the system enables reliable data recovery from a threshold number of slices, resolving the contradiction between storage efficiency and data availability
2Reliability
If error encoding techniques are used to distribute data across storage units, then data security is improved, but system complexity increases
Solution Approach 1:
The patent introduces error encoding functions as an intermediary layer between the data and storage units. These encoding functions act as mediators that transform data into encoded slices for storage and can reconstruct the original data from retrieved slices, thereby improving data security while managing system complexity through a standardized intermediate processing layer
Data Source
AI summary
A storage network operates by: issuing a read threshold number of read slice requests to storage units of a set of storage units, where the read threshold number of read slice requests identifies a read threshold number of encoded slices of a set of encoded slices corresponding to a data segment; when one or more other encoded data slices of the read threshold number of encoded slices is not received within a time threshold, facilitating receiving a decode threshold number of encoded slices of the set of encoded slices; decoding the decode threshold number of encoded slices to produce recovered encoded data slices, wherein a number of the recovered encoded data slices corresponds to the read threshold number minus a number of the encoded slices received within the time threshold; and outputting the recovered encoded data slices and the encoded slices of the read threshold number of encoded slices received within the time threshold.