Dispersed Storage Encoding for Critical Data Availability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed storage networks face challenges in maintaining the availability and integrity of critical data, particularly in the presence of device failures and network disruptions, without the need for redundant copies, and ensuring secure and reliable data retrieval and processing.
Innovation Solution
A distributed computing system that employs dispersed storage error encoding and decoding, along with distributed task processing, to store and retrieve data across geographically diverse locations, utilizing DST execution units for secure and reliable data management, including error correction and task execution, while maintaining data integrity and security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If redundant copies of data are stored to ensure availability during device failures, then data availability is improved, but storage space consumption increases
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage devices. Instead of storing complete redundant copies, the system divides data into portions and stores them in a dispersed manner, allowing data reconstruction from any sufficient subset of slices rather than requiring all copies to be intact.
Solution Approach 2:
The patent employs error correction codes that transform data into an encoded form with added redundancy bits. This parameter change in data representation allows the system to tolerate a certain number of failed slices while still enabling data recovery, achieving reliability without storing full redundant copies.
2Reliability
If data is dispersed across geographically diverse locations to improve security and availability, then resistance to hacking attempts is improved, but data retrieval complexity increases
Solution Approach 1:
The patent creates a universal data retrieval mechanism that works regardless of which specific storage devices are accessible. The error correction code is designed to reconstruct data from any sufficient combination of slices, making the retrieval process uniform and simplifying the complexity despite geographic dispersion.
Solution Approach 2:
The system incorporates integrity verification mechanisms that provide feedback about the state of stored slices. This feedback enables the retrieval process to identify which slices are available and functional, dynamically adjusting the reconstruction process without increasing fundamental complexity.
3Reliability
If error correction schemes are implemented to maintain data integrity without redundant copies, then data integrity is improved, but processing overhead increases
Solution Approach 1:
The patent applies error correction encoding during the initial data storage process, performing the computationally intensive encoding operation beforehand. This preliminary action ensures data integrity is built into the stored slices, eliminating the need for complex real-time verification during retrieval and reducing processing overhead during operations.
Data Source
AI summary
Methods and apparatus for maintaining availability of critical information in a storage network that includes a plurality of storage units. In an embodiment, a processing module(s) of the storage network identifies critical information stored in one or more memory devices of a computing device. Critical information can include, for example, information required for operation of one or more storage units to perform data access operations. The processing module obtains the critical information from the one or more memory devices, and dispersed storage error encodes the critical information to produce one or more sets of encoded critical slices. The processing module further selects a set of storage units of the storage network and facilitates storage of the one or more sets of encoded critical slices in the selected set of storage units.