Network Port Disaggregation for NVMeoF Bottleneck Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The control path processing in high-performance distributed shared memory and storage systems, such as those using NVMeoF, often becomes a bottleneck due to the management of communications between network devices and hosts, leading to slowed data path communications and reduced throughput and bandwidth.
Innovation Solution
Implementing control path and data path disaggregation by using dedicated control path ports for management and data path ports for data operations, allowing for separate and efficient handling of control plane and data plane communications, thereby reducing bottlenecks and improving network device performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If control path and data path share the same network ports, then device complexity is reduced, but throughput and bandwidth are limited due to control path bottlenecks
Solution Approach 1:
The network interface is segmented into separate control path ports and data path ports. Control path ports are dedicated to management traffic (NVMe, TCP protocols) while data path ports handle data operations. This segmentation eliminates control path bottlenecks from data path processing, thereby improving throughput and bandwidth without requiring complex port sharing configurations.
2Productivity
If control path processing is handled by the same processor as data path processing, then ease of operation is improved, but productivity decreases due to processing bottlenecks
Solution Approach 1:
The processor functions are segmented into control path processing and data path processing. The control path processor handles management communications and protocol processing, while the data path processor handles data operations. This segmentation allows both processors to operate independently at full capacity, improving IOPS without complicating processor management through standardized interfaces.
Solution Approach 2:
A network interface card (NIC) acts as an intermediary between the control path processor and data path processor. It manages the separation of control and data path communications, handling protocol processing and data transmission independently. This intermediary approach maintains ease of operation by providing a unified interface while enabling parallel processing to improve IOPS.
3Productivity
If dedicated control path ports are implemented, then bandwidth is improved, but device complexity increases due to separate port requirements
Solution Approach 1:
The network interface is segmented into dedicated control path ports and data path ports. This segmentation enables full bandwidth utilization for both control and data traffic without interference. The increased bandwidth justifies the enhanced port structure, as separate ports provide deterministic performance guarantees that shared ports cannot achieve.
Data Source
AI summary
A network device includes at least one control path port and data path ports configured to communicate on a network. A connection request is received from a host via a control path port, and a resource of the network device is allocated to the host. A data path port is determined from among the plurality of data path ports for communication between the host and the allocated resource. An indication of the determined data path port is sent to the host via the control path port for communication on a data path between the host and the allocated resource. In one aspect, a network interface includes at least one control path port and a first plurality of data path ports configured to communicate on a network. A connection request is received from a host via a control path port, and a locally connected device is allocated to the host.