Dispersed Storage Network Data Integrity Verification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage solutions, such as RAID systems, face challenges in providing effective and efficient data continuity, security, and adaptability to various storage standards, particularly due to the risks of multiple disk failures and unauthorized access when data is replicated across multiple sites.
Innovation Solution
A dispersed storage network (DSN) system that breaks down data into error-coded slices, which are then distributed across multiple storage units, allowing for secure and efficient data reconstruction even if some slices are lost or corrupted, while also enabling sub-slicing for enhanced security and adaptability to different storage standards.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is replicated across multiple storage sites, then data availability is improved, but security against unauthorized access and multiple disk failures deteriorates
Solution Approach 1:
The patent segments data into multiple slices and disperses them across different storage units in a distributed network. This segmentation ensures that no single storage unit contains complete data, thereby improving security while maintaining availability through distributed reconstruction capability
Solution Approach 2:
The patent implements sub-slicing where slices can be further divided into sub-slices that are stored separately. This nested structure provides enhanced security layers while maintaining the ability to reconstruct original data when sufficient sub-slices are available
2Reliability
If data is broken into error-coded slices and distributed across multiple storage units, then security and fault tolerance are improved, but system complexity increases
Solution Approach 1:
The patent creates a universal dispersed storage system that can interface with various storage standards and protocols (SCSI, Fibre Channel, FCoE, SATA, SAS, RAID). This multi-functionality allows the complex error-coding and slicing mechanisms to work across diverse storage environments without requiring separate systems for each standard
3Productivity
If traditional RAID systems are used for data redundancy, then storage efficiency is maintained, but adaptability to various storage standards deteriorates
Solution Approach 1:
The dispersed storage network is designed to be agnostic to underlying storage standards, supporting multiple protocols including SCSI, Fibre Channel, FCoE, SATA, SAS, and RAID configurations. This universality maintains storage efficiency while providing broad adaptability across different storage environments
Data Source
AI summary
An integrity record is appended to data slices prior to being sent to multiple slice storage units. Each of the data slices includes a different encoded version of the same data segment. An integrity indicator of each data slice is computed, and the integrity record is generated based on each of the individual integrity indicators, and may be, for example, list or a hash of the combined integrity indicators. When retrieving data slices from storage, the integrity record can be stripped off, a new integrity indicator of the data slice calculated, and a new integrity record created. The new integrity record can be compared to the original integrity record, and used to verify the integrity of the data slices.