Proxy Volume Redirection for Distributed Storage Scalability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing software-defined storage systems face scalability limitations due to host-side restrictions on the number of logical storage volumes and paths, particularly in environments using advanced storage access protocols like NVMe-oF or NVMe/TCP.
Innovation Solution
The implementation of proxy volume redirection in a multi-path layer of hosts allows for enhanced scalability by associating logical storage volumes with multiple paths and redirecting input-output operations to proxy volumes over selected paths, thereby alleviating path restrictions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If host-side restrictions on the number of logical storage volumes and paths are enforced, then system stability and manageability are maintained, but scalability of the distributed storage system is limited
Solution Approach 1:
The patent introduces a proxy volume as an intermediary entity between the host and multiple storage nodes. The proxy volume acts as a mediator that receives I/O operations from the host and redirects them to the appropriate storage nodes through multiple paths. This intermediary approach allows the host to maintain a simple view with limited paths while the proxy volume handles the complexity of managing multiple paths to storage nodes, thereby resolving the contradiction between scalability and device complexity
Solution Approach 2:
The patent segments the storage access path by separating the host's view of storage from the actual storage nodes. Instead of the host directly managing multiple paths to multiple storage nodes, the system divides the access path into: (1) host to proxy volume (limited paths), and (2) proxy volume to storage nodes (multiple paths). This segmentation allows each component to operate within its own complexity boundaries while achieving overall system scalability
2Quantity of substance
If the number of paths to storage nodes is increased, then system capacity and redundancy are enhanced, but host-side path restrictions are exceeded
Solution Approach 1:
The proxy volume serves as a mediator that absorbs the impact of host-side path restrictions. It maintains associations with multiple paths to storage nodes without requiring the host to directly manage these paths. The proxy volume redirects I/O operations through selected paths from its associated set, allowing the system to utilize multiple paths for capacity and redundancy while keeping the host's path management within acceptable limits
Solution Approach 2:
The patent creates a proxy volume that represents or copies the functionality of multiple storage nodes from the host's perspective. Instead of the host directly accessing multiple storage nodes through multiple paths, the proxy volume provides a single-point interface that internally manages the multiple paths. This copying approach allows the host to work with a simplified representation while the underlying system utilizes the full capacity of multiple paths
Data Source
AI summary
An apparatus in an illustrative embodiment comprises at least one processing device that includes a processor coupled to a memory. The at least one processing device is configured to associate a logical storage volume with at least one path between a host and at least a given one of a plurality of storage nodes of a distributed storage system, and to associate a proxy volume with respective sets of one or more paths from the host to each of the plurality of storage nodes of the distributed storage system. The at least one processing device is further configured to obtain an input-output operation directed to the logical storage volume, and to redirect the input-output operation to the proxy volume over a selected one of the paths associated with the proxy volume. Such an arrangement can avoid one or more host-side restrictions, thereby enhancing scalability of the distributed storage system.