RDMA Offset Value Register Mechanism for Zero-Copy Memory Placement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional RDMA systems face challenges in achieving efficient zero-copy operations on the target device due to difficulties in controlling and anticipating incoming packets and data sizes, leading to higher communication latency and requiring non-standard hardware and software-hardware synchronization.

Innovation Solution

The introduction of RDMA operations with offset values allows for atomic access and modification of offset values during operations, enabling efficient zero-copy by dynamically calculating the memory destination based on offset values stored in a register, which can be incremented or decremented based on data length, facilitating seamless data placement without per-data software actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional RDMA operations use fixed destination addresses from packets, then the target device can process packets, but zero-copy operations cannot be achieved efficiently due to inability to control incoming packet locations

Engineering Contradiction:
Improvezero-copy operation efficiencyVSAvoidmemory address control mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces offset values as an intermediary between the fixed destination address in the packet and the actual memory location where data should be placed. The offset values, stored in registers at the target device, act as a mediator that allows the target to control the actual memory destination without changing the packet structure or requiring software intervention for each packet.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The target device autonomously manages offset values in its registers, automatically updating them based on data length information from packets. This self-service mechanism enables the target to independently control memory placement and achieve zero-copy operations without requiring software-hardware synchronization or application code modifications.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If tag-matching approach is used to enable zero-copy, then some packet routing control is achieved, but software-hardware synchronization overhead increases and it requires non-standard hardware

Engineering Contradiction:
Improvezero-copy capabilityVSAvoidsoftware-hardware synchronization time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent extracts the offset management functionality from software and implements it directly in hardware registers at the target device. By taking out the offset value storage and update mechanism from software control and placing it in hardware, the system eliminates software-hardware synchronization overhead while maintaining zero-copy capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter management approach by using mutable offset values in hardware registers instead of fixed tag-matching rules. The offset values can be dynamically updated based on data length, allowing flexible memory placement without requiring software intervention for each packet, thus reducing synchronization overhead.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If conventional RDMA operations are performed without offset values, then packet processing is simple, but the target device cannot anticipate or control incoming data locations for efficient zero-copy

Engineering Contradiction:
Improvedata placement efficiencyVSAvoidregister-based offset management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by pre-allocating and initializing offset values in hardware registers at the target device before packets arrive. These pre-configured offset values enable the target to immediately determine the correct memory destination for incoming packets without requiring real-time computation or software intervention, thus improving data placement efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical system of software-based packet routing decisions with a hardware-based register lookup and update mechanism. By substituting software processing with hardware register operations, the system achieves faster and more efficient memory address calculation while maintaining manageable device complexity through standardized register interfaces.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP4127940B1Remote direct memory access with offset values
Publication Date: 2024.10.09 HUAWEI TECH CO LTD
  • EP4127940B1 patent drawingFigure 1
  • EP4127940B1 patent drawingFigure 2
  • EP4127940B1 patent drawingFigure 3

AI summary

The present disclosure relates to Remote Direct Memory Access (RDMA). The present disclosure provides devices and corresponding methods for RDMA, which may initiate one or more RDMA operations on a memory and enable efficient zero-copy on a target device. For instance, a target device of the RDMA operation is configured to receive a packet including a first destination address and a destination key, obtain one or more offset values, and obtain a second destination address based on the first destination address, the destination key, and the one or more offset values. Further, the target device is configured to initiate the RDMA operation on the memory based on the second destination address.