Disaggregated Persistent Memory Servers for Low-Latency RDMA Access

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing computing systems face inefficiencies in resource utilization due to the generation, storage, and transfer of data, leading to suboptimal performance.

Innovation Solution

A system utilizing a persistent memory system with RDMA fabric network that allows client devices to access persistent memory servers directly, minimizing latency and resource overhead by bypassing the processing cores of the servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is stored and transferred using traditional computing system resources, then data storage and transfer functions are achieved, but resource utilization efficiency deteriorates and overall performance is impacted

Engineering Contradiction:

Improveresource utilization efficiencyVSAvoidresource overhead

Core Design Contradiction:

ProductivityVSLoss of energy

Solution Approach 1:

The system segments the memory storage function from the computing processors by introducing dedicated persistent memory servers. These servers are organized into memory pools that can be independently managed and allocated to different applications, separating the storage workload from the processing workload to improve overall resource utilization efficiency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces persistent memory servers as intermediary components between the computing processors and the storage medium. These servers manage the memory pools and handle data storage and retrieval operations, acting as a buffer that reduces the burden on processors and improves resource utilization by specializing the storage function.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If persistent memory servers are introduced to improve storage efficiency, then resource utilization improves, but system complexity increases

Engineering Contradiction:

Improvestorage efficiencyVSAvoidsystem architecture complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The persistent memory servers are designed to provide multiple functions: they serve as storage devices, manage memory pools, handle data allocation and retrieval, and can be dynamically allocated to different applications. This multi-functionality consolidates what would otherwise require separate components, actually reducing overall system complexity while improving storage efficiency.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Loss of time

If client devices access persistent memory directly through RDMA fabric, then access latency is reduced, but network infrastructure complexity increases

Engineering Contradiction:

Improvememory access latencyVSAvoidnetwork infrastructure complexity

Core Design Contradiction:

Loss of timeVSDevice complexity

Solution Approach 1:

The system replaces the traditional mechanical/bus-based memory access path with a network-based RDMA fabric. This substitution enables direct memory access between client devices and persistent memory servers over the network, dramatically reducing access latency by bypassing traditional I/O paths and processor intermediaries, despite the increased network infrastructure requirements.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12386765B2Method and system for a disaggregated persistent memory system using persistent memory servers

Publication Date: 2025.08.12 DELL PROD LP

AI summary

A system for managing data includes a client device, a remote direct memory access (RDMA) fabric network, and a persistent memory (PMEM) system comprising a plurality of PMEM servers, wherein a RDMA fabric device of the RDMA fabric is programmed to: obtain a RDMA request, associated with the data, from the client device, wherein the RDMA request specifies a PMEM address of a PMEM region, identify a PMEM server of the plurality of PMEM servers based on the PMEM address, and access the PMEM region using the PMEM server to service the RDMA request.