Mapped Redundant Array of Independent Nodes for Storage Utilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage techniques face inefficiencies in utilizing storage resources, particularly in large-scale systems where physical nodes with many disks can lead to underutilization, and apportioning smaller groups can be inefficient in terms of processor and network resources.
Innovation Solution
The implementation of a mapped redundant array of independent nodes (RAIN) system, which allows for a logical arrangement of real storage devices, enabling more granular use of storage resources by mapping portions of real nodes into logical clusters, providing data redundancy and allowing for flexible node addition or removal without data loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in large physical groups with many nodes and disks, then storage capacity is increased, but storage utilization efficiency decreases due to underutilization
Solution Approach 1:
The patent divides a large physical storage group into multiple smaller logical storage groups, each serving different purposes or clients. This segmentation allows the system to maintain large total capacity while improving utilization by allocating storage space more granularly and efficiently across multiple logical units.
2Productivity
If smaller physical groups are used, then storage utilization improves, but processor and network resource efficiency decreases
Solution Approach 1:
The patent combines multiple smaller logical storage groups into a unified system that shares underlying physical infrastructure. This merging allows smaller logical groups to achieve efficient resource utilization by consolidating processor and network resources at the physical level, avoiding the waste that would occur with completely separate small systems.
3Device complexity
If fixed physical group configurations are used, then system simplicity is maintained, but flexibility in storage allocation decreases
Solution Approach 1:
The patent introduces a logical abstraction layer between the physical storage infrastructure and users. This intermediary logical group structure provides flexibility in storage allocation and management without requiring changes to the underlying physical configuration, thereby maintaining system simplicity while enabling adaptable storage allocation.
Data Source
AI summary
Storage of data according to mapped reliability groups (MRGs) of mapped redundant arrays of independent nodes (mapped clusters) is disclosed. Real reliability groups (RRGs) of a real cluster can provide compartmentalization that can reduce a probability of a data loss event occurring in a cluster storage system. MRGs for a mapped cluster employing the RRGs of the real cluster can provide additional compartmentalization that can further reduce a probability of a data loss event occurring. A data protection set can be stored according to a first group of MRGs and a redundant representation of the data protection set can be stored according to a second group of MRGs, wherein a network distance between the first and second group of MRGs is greater than a network distance between constituent MRGs of either the first or second group of MRGs.