Load balancing system and method based on RDMA network card erasure code unloading

Abstract

The invention discloses a load balancing system and method based on RDMA network card erasure code unloading. The system mainly comprises a sending end module and a receiving end module, the sending end module and the receiving end module are respectively connected with an RDMA network card, and the two RDMA network cards are connected through a plurality of available network transmission paths, wherein the sending end module is used for partitioning data to be sent, calling an erasure code calculation unloading function of the RDMA network cards to carry out erasure code calculation, selecting one of the plurality of available paths for each data block to be sent after coding is completed, and sending the selected data block to be sent, and the receiving end module is used for receiving part of the data blocks through the RDMA network card, calling an erasure code calculation unloading function of the RDMA network card to decode the data blocks, and restoring the original sending datablocks. By utilizing the system, the asymmetry in the data center network can be well handled, the flow in the data center network topology can be balanced as much as possible, and the system and themethod play an important role in improving the sub-bandwidth and the network utilization rate of the data center network and reducing the flow completion time.

Description

technical field [0001] The invention relates to the design of data center network load balancing, in particular to a load balancing system based on RDMA network card erasure code unloading and a working method thereof. Background technique [0002] Due to the increasing communication requirements of applications on the data center network, the data center network is required to provide high-throughput, low-latency support, and provide as large a bisection bandwidth as possible. Load balancing over multiple paths in a multi-root tree topology can achieve the above requirements. In the current data center, the standard load balancing strategy is Equal Cost Multi-Path (ECMP). ECMP distributes the flow to different paths according to the hash result of the data packet header. extensive practical deployment. However, ECMP is not perfect, it faces the problems of hash collision, inability to adapt to the asymmetry of network topology, and mixing of large and small flows. [000...

AI Technical Summary

Problems solved by technology

Although there have been a lot of work to achieve fine-grained traffic distribution mechanism on each path, most of the application scenarios of the work are limited to TCP traffic, almost no one considers multi-path transmission in RDMA data center network, and there is no one Good load balancing system for RDMA networks

Images