Dispersed Storage Re-Encoding for Failure and Repair Threshold Shifts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and redundancy, particularly in RAID systems, where increased redundancy leads to higher maintenance demands and security risks due to multiple copies of data, and the overhead of RAID devices becomes inefficient as data volume grows.
Innovation Solution
A distributed storage network (DSN) system that uses error coding dispersal storage functions to partition data into slices, which are then stored across multiple physically diverse locations, allowing for secure and reliable data retrieval and integrity verification, with the ability to rebuild corrupted slices using error coding schemes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If RAID systems increase redundancy by creating multiple copies of data, then data reliability is improved, but maintenance demands and security risks increase
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage units rather than creating full copies. Each slice is stored in a separate location, and the system can reconstruct the original data from a threshold number of slices using error correction coding. This segmentation approach reduces the overhead of redundancy while maintaining reliability.
Solution Approach 2:
The patent changes the redundancy parameter from full data copying (RAID) to fractional slicing with error correction. Instead of storing complete copies of data, the system stores fragmented slices with added error correction codes, reducing the total storage overhead while maintaining the ability to recover data from failures.
2Reliability
If RAID systems increase redundancy by creating multiple copies of data, then data reliability is improved, but security risks increase due to multiple copies
Solution Approach 1:
By segmenting data into slices and distributing them across multiple storage units, the patent ensures that no single location contains the complete data. Even if one storage unit is compromised, the attacker only obtains fragments that are useless without the other slices and the error correction decoding capability.
Solution Approach 2:
The patent introduces error correction coding as an intermediary layer between the data slices and the reconstruction process. This intermediary mechanism allows the system to verify data integrity and reconstruct original data only when the correct threshold of valid slices is provided, preventing unauthorized reconstruction from stolen slices.
3Quantity of substance
If data volume grows in RAID systems, then storage capacity is improved, but overhead becomes inefficient
Solution Approach 1:
The patent changes the redundancy ratio parameter from fixed in RAID to variable based on data characteristics and failure probability. The slicing width and error correction code rate can be adjusted dynamically, allowing the system to optimize the balance between storage capacity and overhead efficiency as data volume grows.
4Reliability
If error coding dispersal storage is used to distribute data slices, then data security and reliability are improved, but system complexity increases
Solution Approach 1:
The patent implements a universal error correction coding mechanism that handles multiple types of failures (disk failures, data corruption, network issues) through a single unified approach. The same slicing and error correction infrastructure serves both data storage and data integrity verification functions, reducing the need for separate complex systems.
Data Source
AI summary
A method begins with a processing module of a dispersed storage network (DSN) maintaining, over time, a continuum of time-to-repair information regarding a plurality of storage units of the DSN and maintaining, over time, a continuum of time-to-failure information regarding the plurality of storage units. When the continuum of time-to-repair information and the continuum of time-to-failure information are each below undesired levels, the method continues with the processing module changing dispersed storage error encoding parameters of a logical storage vault of the DSN by lowering a decode threshold number with respect to a current decode threshold number and increasing a pillar width number with respect to a current pillar width number. The method continues with the processing module re-encoding stored encoded data of the logical storage vault based on the increased pillar width number and the decreased decode threshold number.