Trait-Based Storage Grouping for Failure-Tolerant Encoded Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed storage and task processing systems face challenges in efficiently managing and securing large volumes of data across geographically dispersed storage units while maintaining data integrity and availability, especially in the presence of failures and hacking attempts.
Innovation Solution
A distributed computing system that employs dispersed storage error encoding and task processing units, utilizing error correction schemes to encode and distribute data across multiple geographically diverse sites, ensuring data integrity and security, and enabling efficient task execution on encoded data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored using traditional RAID systems, then data redundancy and integrity are improved, but storage capacity and cost-effectiveness deteriorate
Solution Approach 1:
The patent segments data into multiple data slices and distributes them across different storage units in a dispersed storage network. Each storage unit stores only a portion of the data, allowing the system to achieve redundancy and integrity without requiring all data to be replicated at every location, thus improving storage capacity utilization compared to traditional RAID.
Solution Approach 2:
The patent introduces a dispersed storage network as an intermediary between the data source and storage locations. This network uses error correction codes and distributed architecture to provide data integrity across multiple geographically separated storage units, eliminating the need for expensive local RAID systems while maintaining reliability.
2Reliability
If data is replicated across multiple storage units, then data availability and reliability are improved, but system complexity and management difficulty worsen
Solution Approach 1:
The patent implements self-service mechanisms where storage units autonomously manage their own data slices, and the system automatically handles data distribution, error correction, and retrieval. The dispersed storage network dynamically allocates data across storage units without requiring manual intervention or complex centralized management, reducing operational complexity while maintaining high availability.
3Ease of operation
If traditional storage systems are used, then ease of operation is maintained, but security against hacking and data breaches deteriorates
Solution Approach 1:
The patent segments data into distributed slices stored across multiple geographically separated storage units, making it difficult for hackers to access and compromise the entire data set. Even if one storage unit is compromised, the distributed architecture ensures that other units contain remaining data copies, maintaining security while preserving ease of operation through automated data management.
Data Source
AI summary
A method includes selecting a plurality of groups of storage units from a number of storage units based on a plurality of sets of storage pool traits, where a first group of storage units of the plurality of groups of storage units is based on a first set of storage pool traits of the plurality of sets of storage pool traits. The method further includes selecting a storage unit from each of the plurality of groups of storage units in accordance with a selection approach to produce a storage set of selected storage units. The method further includes utilizing the storage set of selected storage units for storing data in the storage network.