Distributed Storage Network Memory Access via Data Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage solutions, such as RAID systems, face challenges in providing effective and efficient data continuity, security, and adaptability to various storage standards, especially with increased probability of multiple disk failures and unauthorized access in distributed storage networks.
Innovation Solution
A distributed storage network architecture that employs error encoding and dispersal of data across multiple physically diverse storage units, using a threshold-based approach to ensure data integrity and security, with a storage integrity processing unit for verification and reconstruction of data segments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a centralized storage system, then storage management is simple, but system reliability decreases due to single point of failure and increased probability of unauthorized access
Solution Approach 1:
The patent divides data into multiple data slices and distributes them across different storage units in the network. Each storage unit holds only a portion of the data, eliminating the single point of failure while maintaining data integrity through reconstruction capability from distributed slices.
Solution Approach 2:
The patent introduces a storage integrity processing unit as an intermediary that manages data reconstruction and verification. This intermediary coordinate s the retrieval of data slices from multiple storage units and ensures data integrity without requiring direct access to all storage units, simplifying the user interface while maintaining distributed reliability.
2Adaptability or versatility
If traditional RAID systems are used, then data redundancy is provided, but adaptability to various storage standards decreases and security against unauthorized access is insufficient
Solution Approach 1:
The patent creates a universal storage network architecture that can accommodate different storage unit types and standards through the storage integrity processing unit. This intermediary layer abstracts the underlying storage diversity, allowing the system to adapt to various storage standards while maintaining consistent data security and integrity verification across all storage units.
3Reliability
If data is replicated across multiple storage units, then data availability increases, but storage cost and complexity increase
Solution Approach 1:
The patent segments data into slices that can be distributed across multiple storage units, allowing efficient use of storage capacity. Rather than requiring full replication for high availability, the system uses distributed slices with reconstruction capability, reducing the total storage capacity required while maintaining data availability.
Data Source
AI summary
A storage device of a DSN includes a plurality of memory devices, an interface, and a processing module. The storage device receives an encoded data slice of a set of encoded data slices, wherein a data segment is dispersed storage error encoded to produce the set of encoded data slices. The dispersed storage error encoding includes arranging the data segment into a data matrix of data blocks, generating an encoded data matrix from the data matrix and an encoding matrix, and arranging encoded data blocks of the encoded data matrix into the set of encoded data slices. The storage unit then divides the encoded data slice into encoded data slice partitions and generates a parity data partition therefrom. The storage device then stores the encoded data slice partitions and the parity data partition in separate memory devices.