RDMA Shared Connection Groups for Scalable Data Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing RDMA technology is limited by resource constraints, such as network adapter memory, and suffers from service interruptions due to single-connection faults, especially as network scale expands, leading to reduced data transmission performance and reliability.
Innovation Solution
Implementing a shared connection group for data transmission, allowing multiple services to share and reuse the same connection, thereby improving scalability and reliability by avoiding single-connection faults and optimizing path utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single-connection mode is used for data transmission in RDMA technology, then each service has a dedicated QP connection ensuring reliable transmission, but the quantity of QP connections increases with network scale expansion, which is limited by resources such as network adapter memory
Solution Approach 1:
Multiple services are merged to share a common QP connection. Instead of establishing separate QP connections for each service, the patent allows multiple services to multiplex their data transmission over a single shared QP connection, thereby reducing the total number of connections required in the network.
Solution Approach 2:
The QP connection is designed to serve multiple functions and multiple services simultaneously. A single QP connection can handle data packets from different services by identifying and routing them appropriately, making the connection universal rather than service-specific.
2Productivity
If multiple QP connections are established to support increased network scale and service quantity, then data transmission capacity increases, but resource consumption such as network adapter memory increases proportionally
Solution Approach 1:
The patent combines multiple service data streams into a single QP connection, allowing the network adapter to handle more services with fewer connections. This merging approach increases data transmission capacity without proportionally increasing the memory resources required for connection management.
Solution Approach 2:
The QP connection structure is designed to be universal, capable of handling multiple services simultaneously. This multi-functionality allows a single connection to serve multiple purposes, increasing overall system productivity while keeping resource consumption constant.
3Device complexity
If a single QP connection is used for a service, then connection management is simplified, but the service is vulnerable to interruptions when the connection fails
Solution Approach 1:
Multiple services are combined to share a QP connection, and the system implements failure detection and automatic switching mechanisms. When a connection fails, the system can detect the failure and switch to an alternative connection, maintaining service continuity while keeping connection management relatively simple through automated processes.
Solution Approach 2:
The system prepares backup connections in advance before failures occur. By having alternative QP connections ready and configured beforehand, the system can quickly switch to a backup connection when a primary connection fails, ensuring service continuity without complex real-time decision-making.
Data Source
AI summary
This application discloses a data transmission method, apparatus, device, and system, and a storage medium, and relates to the field of communication technologies. An example in which a first communication apparatus performs the method is used. The first communication apparatus obtains a first packet corresponding to a first service, where a destination of the first packet is a second communication apparatus. The first communication apparatus sends the first packet to the second communication apparatus based on a first connection group, where the first connection group is shared by services transmitted by the first communication apparatus.