Distributed Storage Data Obfuscation and Dispersed Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with memory device failures, particularly in commercial-grade devices using physical movement technologies, leading to data loss and security issues, as well as inefficiencies in RAID systems due to increased maintenance demands and unauthorized access risks.
Innovation Solution
A distributed storage system that employs error coding dispersal storage to partition data into slices, which are then stored across multiple physically diverse locations, utilizing a dispersed storage network with a management unit to ensure data integrity and security through error correction and redundancy, while minimizing storage overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in conventional memory devices with physical movement technologies, then storage capacity is achieved, but data loss occurs due to device failures
Solution Approach 1:
The patent divides data into multiple slices and distributes them across different storage locations. Each slice is a fragment of the original data, and no single slice contains the complete information. This segmentation ensures that if one storage device fails, the data can still be recovered from other devices, directly resolving the contradiction between storage capacity and device failure vulnerability.
Solution Approach 2:
The patent implements error correction codes and redundancy mechanisms before data storage. By pre-processing the data with error correction capabilities and creating redundant copies distributed across multiple locations, the system cushions against potential device failures. This beforehand preparation ensures data integrity even when physical movement technologies fail, addressing the reliability concern.
2Reliability
If RAID systems are used to protect against data loss, then data redundancy is achieved, but maintenance demands and unauthorized access risks increase
Solution Approach 1:
The patent segments data into slices and distributes them across multiple independent storage locations without requiring a centralized RAID controller. Each storage location independently holds a portion of the data, eliminating the single point of failure and reducing maintenance complexity. This distributed segmentation approach provides data protection similar to RAID but with lower maintenance overhead.
Solution Approach 2:
The system enables self-healing capabilities where data can be automatically recovered from remaining slices if some storage locations become unavailable. The error correction codes and redundancy mechanisms allow the system to self-correct without external intervention, reducing maintenance demands while maintaining data protection, thus resolving the contradiction between reliability and device complexity.
3Reliability
If data is distributed across multiple locations, then security against unauthorized access is improved, but system complexity increases
Solution Approach 1:
The patent segments data into multiple slices that are distributed across different storage locations. Each slice alone is insufficient to reconstruct the original data, providing inherent security against unauthorized access. An attacker would need to compromise multiple distributed locations simultaneously, which significantly increases the security threshold. This segmentation-based distribution achieves security without requiring complex encryption key management systems.
Solution Approach 2:
The patent applies different error correction codes and redundancy mechanisms to different data slices based on their specific requirements. Each slice can have tailored protection levels, allowing the system to optimize security for critical data while maintaining simpler structures for less critical data. This local quality approach provides enhanced security where needed without uniformly increasing system complexity across all data, resolving the contradiction between security and system architecture.
Data Source
AI summary
A processing module of a dispersed storage network determines an obfuscation method is determined from a plurality of obfuscation methods for a data segment. The method continues with the processing module obfuscating the data segment according to the obfuscation method to produce an obfuscated data segment. The obfuscated data segment is encrypted and dispersed storage error encoded to produce a set of encoded data slices. The set of encoded data slices is then transmitted for storage in the dispersed storage network.