Rebuilder Application for Dispersed Data Storage Integrity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed data storage networks face challenges in maintaining data integrity and security due to issues like data degradation, corruption, and compromised storage locations, which prior art solutions inadequately address through redundancy and error detection methods.
Innovation Solution
A method for rebuilding data segments in a dispersed data storage network using a rebuilder application that identifies and reconstructs compromised data slices by accessing status data from slice servers, performing integrity checks, and re-slicing data segments, ensuring data integrity and security through checksums and information dispersal algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If data is stored in a single location, then storage simplicity is improved, but reliability deteriorates due to device malfunction or destruction
Solution Approach 1:
The patent divides data into multiple data slices and stores them across different locations in a dispersed storage network. This segmentation allows the system to maintain simple storage operations at each node while ensuring high reliability through distribution, resolving the contradiction between storage simplicity and data reliability.
2Reliability
If backup copies are created and stored in separate locations, then reliability is improved, but security deteriorates due to increased attack targets
Solution Approach 1:
The patent applies encryption to data before dispersing it across multiple locations. Each data slice is encrypted and can only be reconstructed with sufficient slices, creating different security properties at different locations. This allows the system to maintain high reliability through distribution while preserving security, as individual locations contain only encrypted fragments that are useless without others.
3Reliability
If RAID configurations are used to divide and replicate data, then performance and reliability are improved, but security deteriorates as RAID does not address security concerns
Solution Approach 1:
The patent combines multiple techniques - encryption, information dispersal algorithms, and distributed storage - into a composite security architecture. This composite approach integrates security fundamentally into the storage mechanism rather than adding it as a separate layer, achieving both reliability improvement and security protection simultaneously.
4Object-affected harmful factors
If encryption is used to protect data, then security is improved, but reliability deteriorates due to potential decryption failures or key loss
Solution Approach 1:
The patent performs integrity verification through checksums before attempting to reconstruct data from dispersed slices. This preliminary action ensures that only valid, uncorrupted slices are used in decryption and reconstruction, preventing reliability issues from key loss or corrupted data while maintaining strong security encryption.
5Reliability
If data slices are distributed across multiple slice servers, then reliability is improved through redundancy, but device complexity increases due to coordination overhead
Solution Approach 1:
The patent implements a rebuilder application that autonomously monitors slice server status, detects compromised or missing data slices, and automatically initiates reconstruction processes. This self-service mechanism reduces the need for manual intervention and complex coordination overhead, allowing the system to maintain high reliability through distributed storage while managing system complexity automatically.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A rebuilder application operates on a dispersed data storage grid and rebuilds stored data segments that have been compromised in some manner. The rebuilder application actively scans for compromised data segments, and is also notified during partially failed writes to the dispersed data storage network, and during reads from the dispersed data storage network when a data slice is detected that is compromised. Records are created for compromised data segments, and put into a rebuild list, which the rebuilder application processes.