A remote memory system based on smart network card offloading

By offloading the memory management unit through a smart network card and using one-sided RDMA communication, the problem of high CPU overhead on memory nodes in user-space remote memory systems is solved, enabling seamless access and low-power remote memory management.

CN117785789BActive Publication Date: 2026-05-26SHANGHAI JIAOTONG UNIV
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SHANGHAI JIAOTONG UNIV
Filing Date
2024-01-02
Publication Date
2026-05-26

AI Technical Summary

Technical Problem

Existing user-space remote memory systems add CPU computing management and network communication overhead to memory nodes, making them unsuitable for storage-compute separation architectures.

Method used

The remote memory node management unit function is offloaded by the smart network card, and memory management is implemented by the SoC of the smart network card. It communicates directly with the memory node through one-sided RDMA, reducing the CPU involvement of the memory node.

Benefits of technology

It effectively reduces the CPU computing and management overhead of memory nodes, enables seamless access to memory nodes, and reduces electricity costs and CPU resource consumption during operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117785789B_ABST
    Figure CN117785789B_ABST
Patent Text Reader

Abstract

This invention discloses a remote memory system based on smart network interface card (NIC) offloading, relating to the field of communication technology. It includes a computing node, a smart NIC, and a memory node. The computing node sends a remote memory access request to the smart NIC; the smart NIC parses the remote memory access request and accesses the memory node; the memory node initializes and stores the remote memory; the smart NIC includes a remote memory request processing module, a data address management module, and an RDMA communication front-end; the memory node includes an RDMA communication back-end; the remote memory system is used in three phases: initialization, application registration, and operation. This invention offloads the management unit overhead from the memory node to the smart NIC, enabling in-network management of remote memory. Simultaneously, the memory node only provides memory and is completely unaware of remote memory access by applications, effectively reducing the computational management overhead of the CPU on the memory node.
Need to check novelty before this filing date? Find Prior Art