Dispersed Storage Network Data Integrity via Pairwise Encryption
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems face bottlenecks and chokepoints that hinder overall system performance due to data storage errors and inadequate error handling mechanisms.
Innovation Solution
A dispersed storage network (DSN) using error-encoded data and a managing unit that coordinates storage, integrity processing, and error decoding to ensure data integrity and availability across multiple storage units, employing Cauchy Reed-Solomon encoding and decoding to distribute and rebuild encoded data slices securely.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a single location, then storage simplicity is maintained, but system reliability deteriorates due to storage errors and bottlenecks
Solution Approach 1:
The patent divides data into multiple encoded slices using error correction codes (such as Reed-Solomon or Cauchy Reed-Solomon) and distributes them across multiple storage units. Each slice can be independently stored and retrieved, allowing the system to maintain data integrity even if some storage units fail. This segmentation approach transforms a single-point-of-failure system into a distributed system with inherent redundancy.
Solution Approach 2:
The patent creates multiple copies of the data in the form of encoded slices and stores them across different storage units. Instead of storing a single copy of data, the system generates multiple encoded versions that can be used to reconstruct the original data. This copying mechanism ensures that data availability is maintained even when some storage units are unavailable.
2Reliability
If error correction is implemented, then data reliability is improved, but system performance deteriorates due to processing overhead
Solution Approach 1:
The patent performs error correction encoding in advance during the data storage process. By pre-encoding data into multiple slices with error correction information embedded, the system eliminates the need for complex real-time error correction processing during data retrieval. This preliminary action allows for faster read operations while maintaining reliable error correction capabilities.
Solution Approach 2:
By segmenting data into smaller encoded slices, the patent reduces the processing overhead associated with error correction. Instead of processing large amounts of data at once, the system can handle smaller units independently, which improves overall processing speed while maintaining the integrity and reliability benefits of error correction.
3Reliability
If distributed storage is used, then system reliability is improved, but data retrieval complexity increases
Solution Approach 1:
The patent implements a universal decoding mechanism that can reconstruct the original data from any sufficient number of encoded slices. The decoding process is designed to work consistently regardless of which specific slices are available, simplifying the retrieval operation. Users or systems can retrieve data by simply requesting slices from available storage units without needing to manage complex reconstruction procedures.
Data Source
AI summary
A computing device of a storage network includes an interface configured to interface and communicate with a set of storage, memory that stores operational instructions and processing circuitry operably coupled to the interface and to the memory. The processing circuitry is configured to execute the operational instructions to select a set of storage network storage units and divide the set of storage network storage units into pairs of storage units, where each storage unit of the set of storage units is configured to communicate with every other storage unit of the set of storage units. The processing circuitry is further configured to generate an encryption key for each pair of storage units and distribute the encryption key to each pair of storage units.