Non-Replicated Data Copying in Dispersed Storage Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges with data integrity and security due to the failure of physical movement-based memory devices, such as disc drives, and the inefficiencies and security risks associated with redundant array of independent discs (RAID) solutions, particularly as data volume grows and maintenance demands increase.
Innovation Solution
A distributed storage network (DSN) system that uses error coding dispersal storage to partition data into slices, which are then encoded and stored across multiple physically diverse locations, allowing for reliable and secure data retrieval even in the event of device failures, with a management system for data distribution, integrity verification, and access control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored using physical movement-based memory devices (disc drives), then data storage capacity is achieved, but data integrity deteriorates due to device failure
Solution Approach 1:
The patent divides data into multiple slices and distributes them across different storage locations. This segmentation allows the system to maintain data integrity even if individual storage devices fail, as the data is not concentrated in a single location that could fail.
Solution Approach 2:
The patent transforms data from its original form into encoded slices using error coding algorithms. This parameter change in data representation enables the system to recover original data even when some slices are lost or corrupted, directly addressing the reliability issue.
2Reliability
If RAID solutions are used to protect against disc failure, then data reliability improves, but device complexity and maintenance demands increase
Solution Approach 1:
Instead of using complex RAID configurations with multiple physical drives in arrays, the patent segments data into logical slices that can be distributed across simpler storage devices. This reduces system complexity while maintaining reliability through the segmentation and distribution approach.
Solution Approach 2:
The patent replaces mechanical RAID systems with moving parts (disc drives in arrays) with a computational approach using error coding and data slicing. This substitution eliminates the need for complex mechanical RAID configurations while achieving similar or better reliability.
3Reliability
If multiple copies of data are created for redundancy, then data security improves, but storage efficiency deteriorates
Solution Approach 1:
The patent applies error coding transformations to data slices, which allows the system to store redundant information in an efficient manner. The encoded slices contain redundancy for security and recovery, but the overall storage overhead is minimized compared to simple duplication methods.
Solution Approach 2:
Instead of creating multiple complete copies of data for redundancy, the patent creates encoded slices that collectively represent the data with built-in redundancy. This selective copying approach maintains security while improving storage efficiency compared to full duplication.
4Reliability
If data is distributed across multiple locations, then data security and reliability improve, but system complexity increases
Solution Approach 1:
The patent segments data into slices with unique identifiers and distributes them across multiple locations. This segmentation, combined with the encoding scheme, provides security and reliability while managing complexity through systematic organization of distributed data elements.
Data Source
AI summary
A method begins by a dispersed storage (DS) processing module receiving a request to copy a data object in a dispersed storage network (DSN). The method continues with the DS processing module identifying one or more sets of at least a decode threshold number of slice names for one or more sets of encoded data slices of the data object and generating one or more sets of at least a decode threshold of new slice names. The method continues with the DS processing module sending the one or more sets of at least a decode threshold of new slice names to storage nodes of the DSN and instructing the storage nodes to link the one or more sets of at least a decode threshold of new slice names to the one or more sets of encoded data slices thereby producing a non-replicated copy of the data object.