Dispersed Storage Network Time-Sensitive Data Write Commit
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current dispersed storage networks face challenges in efficiently managing time-sensitive data storage and task processing across distributed systems, particularly in ensuring data integrity and availability in the face of failures and network complexities.
Innovation Solution
A distributed computing system that employs dispersed error encoding and decoding schemes, allowing data to be segmented, encoded, and stored across multiple geographically dispersed units, with error correction mechanisms to ensure data integrity and availability, and task processing is distributed across these units to enhance processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored using traditional redundant copying methods, then data availability is improved, but storage efficiency deteriorates due to duplicate data occupying additional space
Solution Approach 1:
The patent segments data into multiple slices and disperses them across different storage units using dispersed error encoding. Instead of storing complete redundant copies, the system divides data into portions and distributes them spatially, allowing reconstruction from any sufficient subset of slices, thereby reducing total storage requirements while maintaining availability
Solution Approach 2:
The system changes the storage parameter from redundant full copies to encoded dispersed slices. By applying error correction encoding transformations, the patent enables data to be stored in an encoded fragmented form that requires less total space while maintaining the ability to reconstruct the original data, resolving the contradiction between storage efficiency and data availability
2Reliability
If data is dispersed across multiple geographically distributed units, then system reliability is improved, but data retrieval time deteriorates due to network latency
Solution Approach 1:
The patent performs preliminary error correction encoding and slice distribution across multiple geographically dispersed storage units before data retrieval is needed. This advance preparation ensures that when data is requested, the system can immediately begin reconstructing data from available slices without delay, mitigating network latency effects while maintaining high reliability through geographic distribution
Solution Approach 2:
The system creates encoded copies of data slices and distributes them across multiple geographic locations. These encoded copies enable parallel retrieval operations and provide redundancy without requiring complete data duplication, balancing the trade-off between geographic distribution benefits and retrieval time constraints
3Reliability
If error correction encoding is applied to dispersed data, then data integrity is improved, but processing complexity deteriorates
Solution Approach 1:
The patent implements a universal dispersed error encoding scheme that handles multiple functions simultaneously: data segmentation, error correction encoding, and slice distribution. This multi-functional approach consolidates processing steps and reduces overall complexity compared to applying separate error correction mechanisms to each stored unit, while maintaining robust data integrity across the dispersed storage system
Data Source
AI summary
A method begins by a dispersed storage (DS) processing module transmitting a set of write commands for storing a set of encoded data slices in storage units of a dispersed storage network (DSN) and determining whether at least a first threshold number of write responses have been received within a response time period. When the at least the first threshold number of the write responses have been received within the response time period, the method continues with the DS processing module determining whether a total number of responses have been received within another response time period. When the total number of responses have not been received within the other response time period, the method continues with the DS processing module issuing a sub-set of write commit commands corresponding to a response number of encoded data slices for which a response was received.