Distributed Storage Network Data Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage systems face challenges with data integrity and security due to the high probability of disc failures in redundant arrays, which increases maintenance demands and security risks, especially as data volume grows, and existing solutions like RAID have inefficiencies and security vulnerabilities.
Innovation Solution
A distributed storage network that uses error coding dispersal storage to partition data into slices, which are then encoded and stored across multiple physically diverse locations, allowing for reliable and secure data retrieval even in the event of individual device failures, with a system managing unit overseeing data distribution, storage, and integrity verification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in redundant arrays (RAID) to improve data availability, then data accessibility is improved, but the probability of disc failures increases and maintenance demands increase
Solution Approach 1:
The patent divides data into multiple slices and distributes them across different storage devices in a segmented manner. Each slice is stored on separate physical media, eliminating the concentration of data on single discs. This segmentation approach allows the system to tolerate individual disc failures while maintaining data availability, directly resolving the contradiction between improved reliability and reduced disc failure probability.
Solution Approach 2:
The patent introduces an intermediary encoding layer that transforms original data into encoded slices before distribution. This intermediary process uses error correction coding to create redundant information distributed across multiple slices, allowing recovery from disc failures without requiring exact replica discs. The intermediary encoding mechanism resolves the contradiction by providing data availability through mathematical reconstruction rather than physical redundancy.
2Reliability
If multiple copies of data are created to reduce data loss risk, then data security is improved, but security risks from unauthorized access increase
Solution Approach 1:
The patent segments data into multiple slices distributed across different storage locations, making it impossible for unauthorized access to occur at the data level. Even if one slice is compromised, the segmented structure prevents reconstruction of complete data without all necessary slices, thus resolving the contradiction between data loss prevention and unauthorized access risk reduction.
Solution Approach 2:
The patent applies different security characteristics to different slices locally. Each slice can be stored with different security protocols, access controls, or physical security measures based on its specific requirements. This local quality approach allows tailored security strategies for each slice while maintaining overall data security, resolving the contradiction between comprehensive protection and minimized attack surface.
3Quantity of substance
If data volume increases to meet storage demands, then storage capacity is improved, but maintenance demands and operational inefficiencies increase
Solution Approach 1:
The patent implements self-service mechanisms where the distributed storage system automatically detects, locates, and recovers from disc failures without manual intervention. The system uses embedded error correction codes and distributed architecture to self-diagnose and self-repair, allowing storage capacity to scale while maintaining constant maintenance efficiency. This resolves the contradiction between increased storage capacity and maintained productivity.
Solution Approach 2:
The patent creates a dynamic storage system where data slices can be automatically relocated, redistributed, and rebalanced across available storage resources. This dynamic adaptation allows the system to optimize maintenance operations in real-time, redistributing data loads during maintenance activities and minimizing operational inefficiencies as storage capacity grows, thus resolving the contradiction between storage expansion and maintenance efficiency.
Data Source
AI summary
A method begins when at least a consensus threshold number of devices are active in a virtual private network (VPN) group of devices. The method continues by obtaining directory information regarding group specific data and retrieving one or more sets of encoded data slices from the at least the consensus threshold number of devices or a dispersed storage network (DSN) memory in accordance with the directory information. The method continues by decoding the one or more sets of encoded data slices based on the at least the consensus threshold number of devices and a number of devices in the VPN group of devices to produce the group specific data. When the at least a consensus threshold number of devices are not active in the VPN group of devices, preventing at least one of the obtaining directory information or the retrieving one or more sets of encoded data slices.