Targeted Storage Unit Encoding for Reliable Slice-Based Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and security due to the high probability of disc failures in redundant arrays, which increases maintenance demands and introduces security risks from multiple data copies, while also incurring efficiency losses as data volume grows.
Innovation Solution
A distributed storage system that uses error-coded data slices stored across multiple physically diverse locations, employing a dispersed storage network with a processing unit that partitions data into segments, encodes them using forward error correction, and distributes them across multiple storage units, allowing for secure and reliable data retrieval even in the event of failures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If redundant disc drives are used to protect against data loss, then data reliability is improved, but maintenance demands and security risks increase
Solution Approach 1:
The patent segments data into multiple independent slices and distributes them across different storage units. Instead of replicating entire data sets across redundant drives, the system divides data into fragments (e.g., 5 slices) where a threshold (e.g., 3 slices) is needed for reconstruction. This segmentation reduces the complexity of managing redundant drives while maintaining reliability, as fewer drives need to be actively monitored and maintained compared to traditional RAID configurations.
Solution Approach 2:
The patent introduces an intermediary encoding layer that transforms original data into encoded slices before storage. This intermediary process (using error correction codes) acts as a mediator between the data and storage media, allowing the system to tolerate drive failures without requiring direct redundant copies. The encoding intermediary reduces maintenance demands by converting the reliability problem into a mathematical reconstruction problem.
2Reliability
If multiple copies of data are stored for redundancy, then data reliability is improved, but security risks from unauthorized access increase
Solution Approach 1:
The patent segments data into multiple slices distributed across different storage units, so that no single storage unit contains a complete copy of the data. To access the data, an attacker would need to compromise multiple storage units and overcome the threshold requirement, significantly increasing security compared to traditional redundancy where multiple complete copies exist. The segmentation principle transforms security from a copy-protection problem to a threshold-access problem.
Solution Approach 2:
The patent changes the parameter of data representation from complete copies to encoded fragments. By transforming data into encoded slices where the original can only be reconstructed with a sufficient number of slices, the system alters the security parameters. The harmful factor of unauthorized access is mitigated because the encoded slices without proper decoding keys or sufficient quantity are useless to attackers.
3Quantity of substance
If data volume grows in traditional storage systems, then storage capacity is improved, but efficiency losses increase
Solution Approach 1:
The patent segments data into standardized slices that can be independently managed and processed. This segmentation enables parallel processing of multiple slices simultaneously, improving efficiency as data volume grows. Unlike traditional systems where entire data sets must be processed together, the sliced architecture allows distributed processing across multiple storage units, maintaining productivity even as storage capacity expands to accommodate growing data volumes.
Solution Approach 2:
The patent transitions from traditional single-dimension storage (sequential access or centralized management) to a multi-dimensional distributed architecture where data slices can be accessed and processed in parallel across multiple dimensions (different storage units, different locations). This dimensional change enables the system to scale storage capacity without proportionally increasing processing overhead, as operations can be distributed across the multi-dimensional space of the storage network.
Data Source
AI summary
A method includes transmitting a solicitation message to target storage units of a plurality of storage units of a storage network, where the solicitation message solicits the target storage units to store encoded data slices of a first data segment of data, and where the message is not sent to other storage units of the plurality of storage units. The method further includes receiving favorable responses from at least some of target storage units, and determining an error coding function based on an amount of the favorable responses and data storage requirements for the first data segment. The method further includes encoding the first data segment in accordance with the error coding function to produce a plurality of encoded data slices. The method further includes outputting the plurality of encoded data slices to storage units of the at least some of the target storage units for storage therein.


