Filecoin Cluster RDMA Data Transfer Without TCP/IP Memory Copies

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing Filecoin cluster data transmission methods based on TCP/IP protocol result in inefficient data transmission due to excessive memory replications and multiple handshakes, affecting efficiency and speed.

Innovation Solution

Implementing a remote direct memory access (RDMA) protocol-based interface and host channel adapter (HCA) cards to directly transmit and encapsulate data between Filecoin cluster nodes, eliminating unnecessary memory copies and reducing context switching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If TCP/IP protocol is used for data transmission between Filecoin cluster nodes, then data can be transmitted reliably, but transmission efficiency deteriorates due to excessive memory replications and multiple handshakes

Engineering Contradiction:

Improvedata transmission reliabilityVSAvoiddata transmission efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent extracts and removes the TCP/IP protocol stack from the data transmission path between Filecoin cluster nodes. By using RDMA (Remote Direct Memory Access) technology, data transmission is decoupled from the traditional network software stack, eliminating the need for multiple memory replications and protocol handshakes while maintaining transmission reliability through direct memory access between nodes.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces RDMA as an intermediary mechanism that enables direct memory access between Filecoin cluster nodes without involving the traditional TCP/IP protocol stack. The RDMA interface acts as a mediator that allows efficient data transmission while preserving the reliability requirements through its inherent error handling and flow control mechanisms.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If traditional network software stack is used for data transmission, then protocol compliance is maintained, but data processing speed deteriorates due to context switching and memory copies

Engineering Contradiction:

Improveprotocol complianceVSAvoiddata processing speed

Core Design Contradiction:

Adaptability or versatilityVSSpeed

Solution Approach 1:

The patent extracts the data transmission functionality from the traditional network software stack, using RDMA to bypass the protocol processing layers. This extraction eliminates context switching between user space and kernel space, as well as unnecessary memory copies, while maintaining protocol compliance at the application layer through the Filecoin clustering protocol.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical system of traditional network protocol processing (involving multiple software layers, context switches, and memory copies) with a more efficient mechanism based on RDMA hardware capabilities. This substitution enables direct memory access between nodes, dramatically improving data processing speed while maintaining protocol compliance through software implementation at the application layer.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If multiple memory replications are performed during data transmission, then data can be processed through multiple layers, but transmission efficiency deteriorates

Engineering Contradiction:

Improvedata processing layersVSAvoidtransmission efficiency

Core Design Contradiction:

Device complexityVSProductivity

Solution Approach 1:

The patent extracts data transmission from the multi-layer processing architecture that causes multiple memory replications. By using RDMA, data is transmitted directly between node memories without being copied through multiple software layers, eliminating the efficiency penalty while maintaining the necessary processing capabilities at the application layer.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by performing data processing operations directly at the destination node memory location rather than copying data through multiple intermediate layers. The RDMA technology enables operations to be performed in-place or with minimal data movement, improving transmission efficiency while maintaining the necessary processing functionality through localized operations.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS12506803B2Filecoin cluster data transmission method and system based on remote direct memory access

Publication Date: 2025.12.23 INSPUR SUZHOU INTELLIGENT TECH CO LTD

AI summary

A filecoin cluster data transmission method and system based on RDMA, including: providing a RDMA interface; receiving and encapsulating sector data by a first node, invoking the RDMA interface to transmit the sector data, serially transmitting the sector data to a next encapsulation node; when receiving the sector data from a previous node, invoking the RDMA interface to directly transmit the sector data to a user mode memory of the node for encapsulation; invoking the RDMA interface to serially transmit the sector data back to the HCA card, and transmitting the sector data to a next node; receiving, by a last node, the sector data, invoking the RDMA interface to directly transmit the sector data to the user mode memory of the last node; invoking the RDMA interface to serially transmit the sector data back to the HCA card of the last node, and transmitting the sector data to distributed storage.