Dispersed Data Slice Allocation Across Local, LAN, and WAN Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computer storage systems face challenges with data integrity and security due to the failure of commercial-grade memory devices, particularly those using physical movement technologies, such as disc drives, which can lead to bit-level corruption and complete failure within three years, and RAID systems that, while addressing failure issues, introduce security risks and efficiency problems with increased maintenance and storage overhead.
Innovation Solution
A distributed storage network (DSN) system that employs error-coded data slices stored across multiple geographically diverse locations, utilizing a dispersed storage processing unit to partition data into segments, encode them using forward error correction, and distribute them across multiple DS units for secure and reliable storage and retrieval, ensuring data integrity and security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored using conventional memory devices or RAID systems, then data storage capacity is achieved, but data integrity and security deteriorate due to device failure and bit-level corruption
Solution Approach 1:
The patent divides data into multiple segments and stores them across different memory devices. Each segment is further divided into data slices that are distributed to multiple DS units. This segmentation ensures that failure of individual devices does not result in complete data loss, as other segments remain intact and can be used for reconstruction.
Solution Approach 2:
The patent applies error correction coding to data segments before storing them. This preliminary encoding adds redundancy information that enables recovery of original data even when some stored slices are corrupted or lost. The error correction is prepared in advance, before any failure occurs.
2Reliability
If RAID systems are used to address memory device failure, then data redundancy is improved, but security risks and maintenance overhead increase
Solution Approach 1:
The patent segments data into multiple independent segments stored across different DS units, replacing the traditional RAID array structure. This distribution across geographically diverse locations eliminates the single-point-failure vulnerability of RAID while reducing maintenance complexity through automated error correction.
Solution Approach 2:
The patent introduces error correction codes as an intermediary layer between data and storage media. This intermediary provides automatic protection against failures without requiring complex RAID management protocols, reducing both maintenance overhead and security risks associated with traditional RAID systems.
3Reliability
If data is distributed across multiple DS units, then data security and reliability are improved, but storage system complexity increases
Solution Approach 1:
The patent creates DS units that can function both as storage devices and as error correction nodes. Each DS unit stores encoded slices and can participate in reconstructing lost data, providing multiple functions within a single distributed component. This universality simplifies the overall system architecture compared to separate storage and protection mechanisms.
Solution Approach 2:
The distributed storage system implements self-service through automated error detection and correction. When data is retrieved, the system automatically verifies integrity and reconstructs any corrupted or missing slices without human intervention, reducing operational complexity despite the distributed architecture.
Data Source
AI summary
A method includes dispersed storage error encoding a data object into a plurality of sets of encoded data slices. The method further includes determining a local slice storage number, a local area network (LAN) slice storage number, and a wide area network (WAN) slice storage number, wherein a sum of the local slice number, the LAN slice storage number, and the WAN slice storage number equals the pillar width number. For at least some sets of encoded data slices, the method further includes sending the local slice storage number of encoded data slices to the local slice storage number of local memory devices; sending the LAN slice storage number of encoded data slices to the LAN slice storage number of LAN storage units of the DSN; and sending the WAN slice storage number of encoded data slices to the WAN slice storage number of WAN storage units of the DSN.