Host Multi-Path Layer for Centralized Storage Congestion Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for mitigating network congestion in software-defined storage systems using advanced protocols like NVMe-oF or NVMe/TCP face compatibility issues and increased complexity, making it difficult to manage data flow effectively.
Innovation Solution
Implementing a centralized discovery controller that interacts with a multi-path input-output (MPIO) driver to receive congestion alerts and send corresponding congestion control messages, utilizing Asynchronous Event Notifications (AENs) to manage IO operations across storage nodes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional ECN mechanisms are used for congestion mitigation, then network congestion can be regulated, but compatibility issues and implementation complexity increase
Solution Approach 1:
The patent introduces a centralized discovery controller as an intermediary component that mediates congestion control between hosts and storage targets. The controller receives congestion alerts from hosts and distributes congestion control messages to appropriate targets, eliminating the need for complex ECN implementation at host level while maintaining effective congestion regulation through centralized coordination
2Productivity
If advanced storage access protocols like NVMe-oF or NVMe/TCP are used, then storage access performance is improved, but congestion mitigation becomes more difficult
Solution Approach 1:
The centralized discovery controller serves as a mediator that simplifies congestion management for advanced protocols like NVMe-oF and NVMe/TCP. It receives congestion alerts from hosts using these protocols and distributes appropriate control messages to storage targets, enabling effective congestion mitigation without requiring complex protocol-specific implementation at host level
Solution Approach 2:
The system implements feedback mechanisms where hosts send congestion alerts to the centralized discovery controller based on observed network conditions. The controller then distributes congestion control messages back to hosts and storage targets, creating a closed-loop feedback system that dynamically adjusts data flow to maintain optimal performance while mitigating congestion
Data Source
AI summary
An apparatus in an illustrative embodiment comprises at least one processing device that includes a processor coupled to a memory. The at least one processing device is configured to implement a centralized discovery controller for coupling to a host and to a storage system accessed by the host, with the centralized discovery controller being configured to receive from the host a congestion alert, and responsive to the received congestion alert, to send to the host and to one or more targets of the storage system corresponding congestion control messages. The congestion alert is illustratively received in the centralized discovery controller from a multi-path input-output (MPIO) driver of the host, where the MPIO driver controls delivery of IO operations from the host to the storage system over selected paths. The congestion control messages may comprise respective Asynchronous Event Notifications (AENs) associated with respective Asynchronous Event Requests (AERs).