Vault Transformation in Dispersed Storage Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current dispersed storage networks face challenges in efficiently managing and synchronizing error-encoded data across multiple storage units, leading to data redundancy and inconsistency issues, which can result in data loss and unauthorized access.
Innovation Solution
The implementation of a decentralized agreement protocol (DAP) and vault transformation processes within a dispersed storage network (DSN) that enables efficient redistribution, synchronization, and redundancy reduction of encoded data slices across multiple storage units, utilizing a managing unit and integrity processing unit to manage and rebuild 'bad' or missing slices, and synchronize data across vaults.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored across multiple storage units in a dispersed storage network, then data availability and reliability are improved, but data redundancy and inconsistency issues arise
Solution Approach 1:
The patent segments data into multiple encoded slices distributed across different storage units. Each slice is a fragment of the original data transformed through encoding functions, allowing the system to store data in divided portions rather than complete copies, thereby reducing redundancy while maintaining availability.
Solution Approach 2:
The system changes parameters such as encoding functions, segment sizes, and pillar widths to optimize the balance between data availability and redundancy. By dynamically adjusting these parameters, the network can adapt to different storage requirements and minimize unnecessary data duplication.
2Reliability
If multiple copies of encoded data slices are stored across storage units, then data availability is improved, but storage volume increases
Solution Approach 1:
Instead of storing multiple complete copies of data, the patent divides data into segments and encodes them into slices that are distributed across storage units. This segmentation approach ensures data availability through distribution while minimizing the total storage volume required compared to traditional replication methods.
Solution Approach 2:
The system creates encoded copies of data segments rather than exact copies. Through encoding functions, the original data is transformed into multiple encoded slices that consume less storage space than direct replication, yet still provide the necessary redundancy for data recovery.
3Reliability
If data is encoded and distributed across storage units, then data security is improved, but data consistency and synchronization become more difficult
Solution Approach 1:
The patent implements feedback mechanisms where storage units report their data slice status to the network. This feedback enables the system to track the location and integrity of encoded slices, facilitating automated synchronization and consistency maintenance across distributed storage units without manual intervention.
Solution Approach 2:
The system performs preliminary encoding and organization of data into slices before distribution. This preliminary action establishes a structured framework that simplifies subsequent synchronization operations, as the pre-encoded slices can be systematically tracked and renewed without complex real-time coordination.
4Adaptability or versatility
If storage units are added or removed from the network, then system flexibility is improved, but data redistribution and vault transformation become more complex
Solution Approach 1:
The patent implements dynamic vault transformation capabilities that automatically adapt to changes in network composition. When storage units are added or removed, the system dynamically reencodes and redistributes data slices across the remaining units, maintaining data availability without requiring manual reconfiguration or complex redistribution protocols.
Solution Approach 2:
The encoding framework is designed with universal applicability that works consistently regardless of network configuration changes. The same encoding functions and slice management protocols apply whether the network is expanding or contracting, simplifying the handling of flexibility while managing redistribution complexity through standardized procedures.
Data Source
AI summary
A method includes identifying an existing logical storage vault having existing dispersed storage coding properties for vault transformation, where a first set of storage units support the existing logical storage vault, and a data object of first data objects stored within the first set of storage units is stored as a first plurality of sets of encoded data slices in accordance with the existing dispersed storage coding properties. The method includes identifying a new logical storage vault having new dispersed storage coding properties, wherein storage units support the new logical storage vault. The method includes transforming the first data objects from being in accordance with the existing dispersed storage coding properties to being in accordance with the new dispersed storage coding properties to produce transformed first data objects. The method includes storing the transformed first data objects in the new logical storage vault supported by the storage units.