Dispersed Storage Network Data Segmentation and Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and security due to the failure of physical movement-based memory devices, such as disc drives, which can lead to data loss and unauthorized access, especially as the amount of data grows and maintenance demands increase.
Innovation Solution
A distributed storage network (DSN) system that employs error-coded data slices stored across multiple geographically diverse locations, using a dispersed storage network (DSN) with a processing module that partitions data into segments, encodes them using forward error correction, and distributes them across multiple DS units for redundancy and security, allowing for reliable and secure data retrieval even in the event of device failures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If physical movement-based memory devices (disc drives) are used for data storage, then data storage capacity and accessibility are improved, but data integrity and security deteriorate due to device failures and unauthorized access
Solution Approach 1:
The patent divides data into multiple segments or slices and distributes them across multiple geographically diverse storage locations. This segmentation ensures that no single point of failure can compromise the entire dataset, thereby maintaining data integrity while preserving storage capacity across distributed disc drives.
Solution Approach 2:
The patent introduces an intermediary encoding layer that transforms original data into encoded data slices before storage. This intermediary transformation enables the system to tolerate device failures and unauthorized access, as the encoded slices require specific combinations to reconstruct the original data, thus protecting data integrity.
2Reliability
If multiple redundant disc drives are used to protect against data loss, then data security is improved, but maintenance demands and device complexity increase
Solution Approach 1:
The patent implements self-healing capabilities where the system can automatically detect, locate, and repair corrupted or lost data slices using error correction codes and redundant information stored across the distributed network. This self-service approach reduces maintenance demands while maintaining data security through multiple redundant copies.
3Speed
If data is stored in centralized locations for easy access, then data retrieval speed is improved, but vulnerability to single points of failure increases
Solution Approach 1:
The patent segments data into multiple slices and distributes them across geographically diverse storage locations. This segmentation allows the system to maintain fast retrieval speeds by accessing multiple parallel locations while eliminating single points of failure, as the distributed architecture ensures data availability even if some locations become inaccessible.
Data Source
AI summary
A method begins by a processing module applying a share encoding function on data to produce a plurality of encoded shares and generating a corresponding plurality of random numbers for the plurality of encoded shares. The method continues with the processing module generating an encryption key based on a common password and a corresponding one of the corresponding plurality of random numbers and encrypting the encoded share utilizing the encryption key to produce an encrypted share for each encoded share of the plurality of encoded shares. The method continues with the processing module facilitating storage of the corresponding plurality of random numbers and each of the encrypted shares.