Data processing method, system and device

By setting up a central node in a distributed network and using RDMA technology for data transmission, the network communication delay problem caused by traditional TCP/IP technology is solved, and more efficient data processing and system performance improvement is achieved.

CN113596085BActive Publication Date: 2025-03-25ALIBABA CLOUD COMPUTING CO LTD
2 Cites 0 Cited by

Patent Information

Application Number
CN202110707903.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-24
Publication Date
2025-03-25
Estimated Expiration
2041-06-24

AI Technical Summary

Technical Problem

Traditional TCP/IP technology occupies a large amount of server resources and memory bus bandwidth during data processing, resulting in network communication delays, especially when the network bandwidth, processor speed and memory bandwidth do not match.

Method used

By setting up a central node in a distributed network, setting the data transmission mode between the computing node and the central node to a single-sided or bilateral transmission mode, using the Remote Direct Memory Access Module (RDMA) technology, the data to be stored is directly transmitted from the data buffer of the computing node to the data buffer of the central node to avoid the central node CPU participating in data transmission.

Benefits of technology

It reduces the consumption of the central node CPU during data transmission, improves the processing performance of the system, and reduces network communication delay.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The embodiments of the present specification provide a data processing method, system and device, wherein the data processing method includes: obtaining data to be stored, querying a network connection in an idle state in a network connection pool, and determining a data buffer corresponding to a storage address of the network connection in a central node, generating a first communication message based on the data to be stored, calling a remote direct memory access module to write the first communication message to the data buffer through the network connection, and receiving a second communication message returned by the central node, wherein the second communication message is generated by the central node by parsing the first communication message and processing the data to be stored obtained by the parsing.
Need to check novelty before this filing date? Find Prior Art