RDMA Queue Prioritization in NICs for Low-Latency Service Traffic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in reducing the processing latency of remote direct memory access (RDMA) requests for important service applications, particularly in intelligent network interface cards (iNICs), as they do not effectively prioritize processing based on service levels.
Innovation Solution
The network interface card determines the processing sequence of RDMA requests based on the service levels of the applications, preferentially processing requests of higher importance, and utilizes storage strategies to manage queue contexts efficiently, reducing latency by minimizing memory access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If RDMA requests are processed in a first-in-first-out (FIFO) manner without prioritization, then the processing is simple and efficient for general cases, but the processing latency of important service applications increases
Solution Approach 1:
The patent applies local quality by assigning different service levels to different RDMA requests based on their importance. High-service-level requests are prioritized over low-service-level requests, creating differentiated processing quality for different types of requests. This resolves the contradiction by maintaining simple FIFO processing for most requests while providing accelerated processing for important requests through service level tagging and priority-based queue selection.
Solution Approach 2:
The patent implements preliminary action by pre-tagging RDMA requests with service level indicators before they enter the processing queue. The network interface card pre-identifies high-priority requests and places them in appropriate priority queues, so that when processing occurs, the prioritization is already established. This reduces processing latency for important requests without adding complex real-time decision-making during the processing phase.
2Speed
If queue contexts are stored in host memory, then the storage capacity is large, but the access time is long
Solution Approach 1:
The patent segments queue context storage into two parts: frequently accessed context information is stored in the network interface card's onboard memory (fast but limited capacity), while less frequently accessed or larger context data remains in host memory (slow but large capacity). This segmentation allows the system to achieve fast access speeds for critical operations while maintaining sufficient storage capacity through the host memory backend.
Solution Approach 2:
The network interface card's onboard memory acts as an intermediary between the processor and host memory for queue context access. Instead of directly accessing host memory for every queue context operation, the NIC caches relevant context in its own memory, providing fast access while the host memory serves as the ultimate storage backend. This intermediary approach resolves the speed-capacity contradiction by providing fast access for frequent operations while maintaining large storage capacity.
Data Source
AI summary
A data transmission method is provided. The method includes: a network interface card of a source device obtains a first notification message and a second notification message, wherein the first notification message indicates that a first to-be-processed remote direct memory access (RDMA) request exists in a first queue of the source device, the first queue stores a request of a first service application in the source device, the second notification message indicates that a second to-be-processed RDMA request exists in a second queue of the source device, and the second queue stores a request of a second service application in the source device; and the network interface card determines a processing sequence of the first queue and the second queue based on service levels, and sends the first to-be-processed RDMA request and the second to-be-processed RDMA request to a destination device according to the processing sequence.


