Distributed Data Rebuilding in Dispersed Storage Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and security due to the failure of memory devices, particularly those using physical movement technologies, such as disc drives, which can lead to bit-level corruption and complete failure within three years, and redundant array of independent discs (RAID) solutions increase maintenance demands and security risks with multiple data copies.
Innovation Solution
A distributed storage network (DSN) system that employs error-coded data slices stored across multiple physically diverse locations, using a dispersed storage network (DSN) memory with a processing module that partitions data into segments, encodes them using forward error correction, and distributes them across multiple DS units for secure and reliable storage and retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If RAID solutions are used to protect against data loss, then data reliability is improved, but maintenance demands and security risks increase
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage units in a dispersed storage network. This segmentation approach provides data redundancy and reliability without requiring complex RAID configurations, as each slice can be independently stored and retrieved, reducing overall system maintenance complexity while maintaining data protection
Solution Approach 2:
The patent introduces a dispersal algorithm as an intermediary that transforms data into encoded slices before storage. This intermediary process enables reliable data recovery through error correction codes without requiring direct redundant copying mechanisms, thereby reducing maintenance demands while preserving data reliability
2Reliability
If multiple copies of data are stored, then data reliability is improved, but security risks increase
Solution Approach 1:
The patent applies local quality by storing different encoded slices of data across geographically distributed storage units rather than creating identical copies. Each storage unit holds a unique portion of the encoded data, providing redundancy and reliability while minimizing security risks since compromising one location does not expose the entire dataset
Solution Approach 2:
The patent transitions from traditional redundant copying to a dimensional approach where data is dispersed across multiple spatial locations and reconstructed through mathematical decoding. This dimensional transformation allows reliable data recovery without creating vulnerable duplicate copies, thereby reducing security risks while maintaining reliability
3Ease of operation
If data is stored in centralized systems, then ease of operation is improved, but vulnerability to failure increases
Solution Approach 1:
The patent segments data into multiple slices and distributes them across a network of storage units, maintaining ease of operation through automated encoding and retrieval processes while eliminating the single-point-of-failure vulnerability inherent in centralized systems. The segmentation enables parallel operations and distributed management
4Quantity of substance
If disc drives are used for storage, then storage capacity is improved, but data integrity deteriorates due to bit-level corruption
Solution Approach 1:
The patent applies preliminary action by encoding data with error correction codes and dispersing it across multiple storage units before any potential failure occurs. This preemptive encoding ensures that even if bit-level corruption occurs in disc drives, the original data can be recovered through the dispersed storage and retrieval process, maintaining data integrity while utilizing large-capacity storage devices
Data Source
AI summary
A technique of rebuilding encoded data slices in a dispersed storage network when detecting a plurality of encoded data slices that require rebuilding, as may occur upon failure of a memory device storing the encoded data slices. A plurality of rebuilding resources capable for use to rebuild the plurality of data slices are determined and, based on one or more attributes associated with the determination, a rebuilding task is apportioned. The resulting rebuilding assignments are allocated to the plurality of rebuilding resources to rebuild the encoded data slices. The allocation of the rebuilding assignments permits more than one rebuilding resource and associated distributed storage units to rebuild the encoded data slices.