Encoded Data Slice Access in Dispersed Storage Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current distributed computing systems face challenges in securely and reliably storing and processing data across multiple locations, as they are vulnerable to failures and lack efficient mechanisms for data integrity verification and task processing.
Innovation Solution
A distributed computing system that utilizes a dispersed storage network (DSN) with error-encoded data storage and retrieval, allowing data to be encoded using information dispersal algorithms and stored across geographically different sites, and supports distributed task processing through a network of execution units, ensuring data integrity and security through error correction and secure encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored across multiple geographically distributed locations, then data availability and reliability are improved, but system complexity and vulnerability to failures increase
Solution Approach 1:
The patent segments data into multiple encoded data slices distributed across different storage units. Each slice is independently stored geographically, allowing the system to maintain reliability through distribution while managing complexity through modular segmentation of data into manageable units that can be independently handled by each storage node.
Solution Approach 2:
The patent introduces encoded data slices as intermediaries between the original data and storage units. These encoded slices act as mediators that enable reliable data reconstruction from distributed storage locations without requiring complex coordination between nodes, as each node independently stores and retrieves slices based on simple addressable identifiers.
2Reliability
If error correction encoding is applied to data, then data integrity is improved, but processing time and computational resources increase
Solution Approach 1:
The patent applies error correction encoding in advance during the data storage phase, creating encoded data slices before distribution. This preliminary encoding action ensures data integrity is built into the stored slices, eliminating the need for complex real-time verification during retrieval operations and reducing processing time when data is accessed.
Data Source
AI summary
A method for execution by a dispersed storage and task (DST) execution unit includes receiving a slice access request for execution by the DST execution unit. At least one ordered codec algorithm is identified. The slice access request is executed by utilizing the at least one ordered codec algorithm. A slice access response indicating an outcome of the slice access request is generated by the DST execution unit.