Dispersed Video Storage Using Encoded Slices Instead of RAID
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges with data integrity and security due to the failure of physical movement-based memory devices, such as disc drives, and the inefficiencies and security risks associated with redundant array of independent discs (RAID) solutions, particularly as data volume grows and maintenance demands increase.
Innovation Solution
A distributed storage system that employs error coding dispersal storage functions to partition and encode data into multiple slices, which are then stored across physically diverse locations, allowing for reliable and secure data retrieval and integrity verification, using a distributed network with a storage integrity processing unit to manage and verify data slices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple levels of redundant disc drives (RAID) are utilized to protect against disc failure, then data reliability is improved, but device complexity and storage capacity overhead increase
Solution Approach 1:
The patent segments data into multiple slices and distributes them across different storage devices. Error correction codes are applied to create redundant slices, allowing data recovery without requiring complex RAID architectures. This segmentation approach simplifies the overall system while maintaining reliability.
Solution Approach 2:
The patent replaces mechanical RAID systems with electronic error correction and data slicing mechanisms. Instead of relying on physical redundant disc arrays with complex controllers, the system uses software-based error correction codes and distributed storage, reducing mechanical complexity while improving reliability.
2Reliability
If multiple levels of redundant disc drives (RAID) are utilized to protect against disc failure, then data reliability is improved, but storage capacity is reduced due to redundancy overhead
Solution Approach 1:
The patent changes the redundancy parameter from fixed RAID levels to flexible error correction codes with variable redundancy ratios. This allows optimization of storage capacity while maintaining required reliability levels, as the redundancy overhead can be adjusted based on specific needs rather than being locked into standard RAID configurations.
3Reliability
If higher-grade disc drives are used to reduce failure rate, then data reliability is improved, but system cost increases significantly
Solution Approach 1:
The patent employs inexpensive standard disc drives with error correction and redundancy mechanisms rather than expensive high-grade drives. The system accepts that individual drives may fail but uses affordable error correction codes and data slicing to recover from failures, making the overall system more cost-effective while maintaining reliability.
4Reliability
If data is replicated across multiple RAID devices to reduce loss risk, then data reliability is improved, but security risks increase due to multiple accessible copies
Solution Approach 1:
The patent applies different security qualities to different data slices stored in different locations. Rather than uniformly replicating complete data copies, the system distributes encoded slices where each location holds only a portion, and implements location-specific access controls. This ensures that compromising one location does not expose the entire dataset, maintaining reliability while enhancing security.
Data Source
AI summary
A method begins with a dispersed storage network (DSN) processing module receiving content retrieval message from one or more requesters. The method continues by determining DRM policies and read operational parameters. The method continues by retrieving a set of encoded data slices from DSN memory, the set of encoded data slices including unique subsets of the set of encoded data slices with each of the unique subsets assigned to one or more of the requesters based at least in part on the determined read operational parameters. The method continues by sending the set of encoded data slices to the requesters. The requestors select their assigned subset of the received set of encoded data slices and decode to produce the content.