RDMA Dummy Queue Pair Conversion for Low Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing RDMA protocols face challenges in efficiently establishing connections and managing general management packets (GMPs) in high-performance computer networks, leading to increased latency and packet loss as the number of nodes increases.
Innovation Solution
The system generates a plurality of dummy queue pairs with dummy parameter values and converts them into functional queue pairs by changing specific dummy parameter values to true parameter values upon receiving a connection request. Additionally, it employs a method to scatter GMPs directed to a special queue pair among multiple queues for multi-threaded handling and encapsulates messages in a reliable communication protocol to ensure reliable communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple connection requests are handled sequentially through a single queue pair, then connection establishment reliability is maintained, but latency increases and system throughput decreases
Solution Approach 1:
The patent divides a single queue pair into multiple queue pairs (first queue pair and second queue pair) to handle different connection requests simultaneously. This segmentation allows parallel processing of connection establishment, reducing latency while maintaining reliability through dedicated error handling mechanisms for each queue pair.
Solution Approach 2:
The patent introduces a new dimension of parallelism by creating multiple queue pairs instead of processing sequentially in a single queue pair. This dimensional expansion from single-queue sequential processing to multi-queue parallel processing enables simultaneous handling of multiple connection requests, significantly reducing establishment latency.
2Device complexity
If general management packets are processed through a single special queue pair, then packet management simplicity is maintained, but packet loss increases and processing efficiency decreases in large-scale networks
Solution Approach 1:
The patent segments the single special queue pair into multiple queue pairs (first special queue pair and second special queue pair) for handling different general management packets in parallel. This segmentation distributes packet processing load, reducing packet loss and improving reliability in large-scale networks while maintaining manageable complexity through systematic packet routing.
Solution Approach 2:
The patent performs preliminary classification of incoming general management packets to determine which queue pair should handle each packet. By pre-routing packets to appropriate queue pairs based on their destination or type, the system avoids congestion and packet loss that would occur with single-queue processing, while maintaining simplicity through automated classification rules.
3Speed
If dummy queue pairs are created in advance, then connection establishment speed improves, but memory resources are consumed
Solution Approach 1:
The patent creates a limited number of dummy queue pairs (first dummy queue pair and second dummy queue pair) in advance rather than creating all possible queue pairs. This partial action approach provides enough pre-configured queues to handle concurrent connections with reduced latency, while avoiding excessive memory consumption by limiting the number of dummy pairs to what is practically necessary for the expected connection load.
Data Source
AI summary
A system and method for establishing connections in a computer network supporting a remote direct memory access (RDMA) protocol, may include: generating a plurality of dummy queue pairs, each generated with dummy parameter values; and upon receiving a request to establish a connection from a first computer node in the computer network, turning one of the dummy queue pairs into a functional queue pair by changing a subgroup of the dummy parameter values to true parameter values.