Dispersed Storage Unit Selection for Reliable Slice-Based Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computer storage systems face challenges with data integrity and security due to the failure of memory devices, particularly those using physical movement technologies, which can lead to data loss and increased maintenance demands, and RAID systems face inefficiencies and security risks with multiple copies of data.
Innovation Solution
A distributed storage network (DSN) system that employs error-coded data slices stored across multiple geographically diverse locations, utilizing a DS processing unit to partition and encode data, and a DS managing unit to manage storage parameters and security, ensuring data integrity and security through redundancy and dispersal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple copies of data are stored in RAID systems, then data reliability is improved, but storage efficiency deteriorates and security risks increase
Solution Approach 1:
The patent divides data into multiple slices and distributes them across different storage facilities. Instead of creating complete copies like RAID, the system segments data into fragments (e.g., 5 slices from encoding 4 data slices + 1 parity slice) and stores them separately. This segmentation allows the system to achieve redundancy without duplicating entire data sets, thereby improving storage efficiency while maintaining reliability.
Solution Approach 2:
The patent changes the fundamental parameter of data representation by using error-correcting codes to transform data into encoded slices. Rather than storing identical copies, the system encodes data into multiple slices where any subset of a threshold number of slices can reconstruct the original data. This parameter change from copying to encoding resolves the contradiction by achieving reliability through mathematical redundancy rather than physical duplication.
2Reliability
If data is distributed across multiple storage facilities, then security is improved, but system complexity increases
Solution Approach 1:
The patent introduces a DS processing unit as an intermediary that handles the complexity of data slicing, encoding, and distribution. This intermediary component manages the interaction between the data storage request and the distributed storage facilities, abstracting away the complexity from the user while enabling secure distributed storage. The intermediary consolidates the complex operations into a manageable interface.
Solution Approach 2:
The DS processing unit serves multiple functions: it slices data, encodes slices using error-correcting codes, selects appropriate storage facilities, tracks slice locations, and reconstructs data during retrieval. By consolidating these diverse functions into a single multi-functional component, the system manages complexity while achieving enhanced security through distribution.
3Quantity of substance
If memory devices use physical movement technologies, then storage capacity is improved, but data integrity deteriorates due to device failures
Solution Approach 1:
The patent applies error-correcting codes to data slices before storage, creating a form of beforehand cushioning against potential device failures. The encoding process generates redundant information that can compensate for data loss or corruption. If physical movement causes device failure, the error-correcting codes provide a buffer that allows data reconstruction from remaining slices, thus protecting data integrity despite the limitations of physical storage media.
Data Source
AI summary
A method begins by a processing module receiving a data storage request that includes metadata and data. The method continues with the processing module determining a base-line set of error coding dispersal storage function parameters based on the metadata. The method continues with the processing module identifying candidate dispersed storage (DS) units based on the base-line set of error coding dispersal storage function parameters. The method continues with the processing module selecting DS units of the candidate DS units based on the metadata to produce selected DS units. The method continues with the processing module dispersed storage error encoding the data in accordance with at least a representation of the base-line set of error coding dispersal storage function parameters to produce a set of encoded data slices. The method continues with the processing module sending the set of encoded data slices to the selected DS units for storage therein.