Concurrent Encoded Slice Transmission in Dispersed Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges with data integrity and security due to the failure of commercial-grade memory devices, particularly those using physical movement technologies, which can lead to bit-level corruption and complete failure within three years, and the inefficiencies and security risks associated with redundant array of independent discs (RAID) solutions.
Innovation Solution
A distributed storage system that employs error coding dispersal storage functions to partition data into slices, which are then encoded and stored across multiple physically diverse locations, allowing for reliable and secure data retrieval even in the event of device failures, using a distributed network with a storage integrity processing unit for verification and reconstruction of data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If RAID systems are used to protect against disc failures, then data reliability is improved, but device complexity and security risks increase
Solution Approach 1:
The patent divides data into multiple segments and disperses them across independent storage locations rather than using traditional RAID arrays. Each segment is stored separately in different physical locations, eliminating the need for complex RAID controllers and reducing system complexity while maintaining reliability through spatial distribution
Solution Approach 2:
The patent introduces an intermediary encoding layer that transforms original data into encoded segments before storage. This encoding intermediary enables reliable data recovery without requiring complex RAID management, simplifying the system while improving reliability through mathematical redundancy
2Reliability
If multiple redundant disc drives are used to replicate data, then data reliability is improved, but security risks increase
Solution Approach 1:
Data is segmented and distributed across multiple independent storage locations rather than replicated on redundant drives. This segmentation ensures that even if some locations are compromised, the dispersed nature of segments prevents unauthorized reconstruction, reducing security risks while maintaining availability
Solution Approach 2:
Different segments are stored with different security characteristics in different locations. The patent applies local quality by varying storage parameters and access controls for different segments based on their location, enhancing security while ensuring data availability through diverse storage strategies
3Quantity of substance
If commercial-grade memory devices with physical movement are used, then storage capacity is improved, but reliability deteriorates due to bit-level corruption and failure
Solution Approach 1:
The patent applies error detection and correction encoding to data segments before they are stored in commercial-grade memory devices. This preliminary action prepares the data to withstand potential corruption from physical movement mechanisms, maintaining data integrity while utilizing high-capacity commercial storage
Solution Approach 2:
Redundant encoded segments are created and distributed beforehand to cushion against potential failures of commercial-grade storage devices. This prior cushioning ensures that even if some stored segments become corrupted, the original data can be recovered without loss
Data Source
AI summary
A method begins by a processing module dispersed storage error encoding fundamental component data of data in accordance with dispersed storage error coding parameters to produce a plurality of sets of encoded data slices, wherein the data includes the fundamental component data and enhancement component data. The method continues with the processing module transmitting a set of the plurality of sets of encoded data slices and transmitting a corresponding portion of the enhancement component data substantially concurrently with the transmitting of the set of the plurality of sets of encoded data slices.