Memory management method of user-state RPC over RDMA

Abstract

The invention discloses a memory management method of a user-state RPC over RDMA. A registered memory pool for storing registered memory blocks is arranged in a RPC layer, and the memory blocks are used repeatedly in transmission to achieve a goal of avoiding a registered memory; meanwhile, a memory management interface is added, so that an upper-layer user can directly use the registered memory blocks managed by the RPC layer, and memory copying between the upper-layer user and a RPC component is accordingly avoided. The memory blocks managed in the registered memory pool are fixed in size, and the scope of the block size can be configured based on the actual use. The memory management method of the user-state RPC over RDMA can efficiently reduce the memory registration number when the RPC component adopts the RDMA way for transmission, and has an effect of reducing the memory registration expense.

Description

technical field [0001] The invention belongs to the technical field of computer network communication, and more specifically relates to a memory management method of RPC over RDMA in user state. Background technique [0002] Remote direct data access (RDMA) performs remote copying of the memory area through the network, and quickly transfers data from one system to the remote memory without CPU intervention, which solves the delay of server-side data processing in network transmission. [0003] IB (InfiniBand) is a system domain network widely used in high-performance computing clusters. IB Verbs is a set of interfaces for directly operating InfiniBand network cards, making full use of the RDMA technology supported by InfiniBand networks; RPC components based on IB Verbs have high bandwidth, Low-latency performance provides a common RPC interface for the upper layer, but the IB Verbs interface is used for transmission, and the memory involved needs to be explicitly registere...

AI Technical Summary

Problems solved by technology

[0003] IB (InfiniBand) is a system domain network widely used in high-performance computing clusters. IB Verbs is a set of interfaces for directly operating InfiniBand network cards, making full use of the RDMA technology supported by InfiniBand networks; RPC components based on IB Verbs have high bandwidth, Low-latency performance, providing a common RPC interface for the upper layer, but using the IB Verbs interface for transmission, the memory involved needs to be explicitly registered with the network card, and the memory registration overhead brings a large performance loss

[0004] Traditional methods to reduce memory registration overhead include FMR (Fast Memory Registration), a fast memory registration method applied in the kernel state, which involves the specific memory registration implementation of IB's Host Channel Adapter (HCA) and the conversion of kernel virtual page addresses to physical addresses. Mapping, this method is to reduce the overhead of the memory registration operation itself, which can only be implemented in the kernel state

Images