Data processing method and device

A data processing device and data processing technology, applied in the field of communication, can solve problems such as easy data overflow and low data transmission efficiency

Inactive Publication Date: 2014-03-19
HUAWEI TECH CO LTD
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The embodiment of the present invention provides a data processing method and device to solve the problems of low data transmission efficiency and easy data overflow when the RDMA Send method is used to send data one by one

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Embodiment 1 of the present invention provides a data processing method, and the data processing method is applicable to a data transmission process based on an RDMA technology.

[0045] Specifically, such as figure 1 As shown, it is a schematic flow chart of the data processing method described in Embodiment 1 of the present invention, and the data processing method may include the following steps:

[0046] Step 101: Establish a sending data memory pool.

[0047] Specifically, in the embodiments of the present invention, the execution subject of each step can usually be a data sender such as a computer or a server, which is not limited in this embodiment of the present invention; further, in this step 101, the data sender The method of establishing the sending data memory pool is similar to the method of establishing the receiving data memory pool by the data receiver described in the prior art, which will not be described in detail in the embodiment of the present in...

Embodiment 2

[0077] Embodiment 2 of the present invention provides a data processing method, and the data processing method is a further description of the data processing method described in Embodiment 1 of the present invention. Specifically, such as figure 2 As shown, it is a schematic flow chart of the data processing method described in Embodiment 2 of the present invention, and the data processing method may include the following steps:

[0078] Step 201: The data sender establishes a communication connection with the data receiver.

[0079] Specifically, the data sender or the data receiver may be equipment such as a computer or a server, respectively, which is not limited in this embodiment of the present invention.

[0080] Step 202: The data sender establishes a memory pool for sending data, and the data receiver establishes a memory pool for receiving data.

[0081] Specifically, in the embodiment of the present invention, the way in which the data sender establishes the memo...

Embodiment 3

[0102] Embodiment 3 of the present invention provides a data processing device that can be used to implement the method shown in Embodiment 1 or Embodiment 2 of the present invention, such as image 3 As shown in , it is a schematic structural diagram of the data processing device described in Embodiment 3 of the present invention. The data processing device can usually be an independent device such as a computer or a server. Of course, it can also be integrated in an independent device such as a computer or a server. The integrated device is not limited in this embodiment of the present invention.

[0103] Specifically, the data processing device may include a data receiving module 11 and a data processing module 12, wherein:

[0104] The data receiving module 11 can be used to receive the data to be sent issued by the upper layer application;

[0105] The data processing module 12 can be used to buffer the data to be sent received by the data receiving module 11 into a pre-...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and device. The method includes the steps that data to be sent issued by an upper layer application are received, and the received data to be sent are cached into a data sending memory pool which is established in advance; if it is determined that a data sending moment arrives according to a set data sending cycle, at least one of the data to be sent cached in the data sending memory pool is written into a data receiving memory pool of a data receiver in an RDMA Write mode. According to the scheme, due to the fact that the RDMA Write mode can be used for writing multiple data cached in the memory pool of a data sender into the memory pool of the data receiver at the same time, the problems that when an RDMA Send mode is used for sending data item by item, the efficiency is low, data can overflow easily and errors can occur easily can be solved, and on the premise that the data sending frequency is reduced substantially and the data overflow probability is lowered, the purpose for improving the data sending efficiency is achieved.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a data processing method and device based on RDMA (Remote DirectMemory Access, remote direct memory access) technology. Background technique [0002] RDMA is a remote direct data access technology to solve the delay of server-side data processing in network transmission. It can transfer data from one computer directly to the memory of another computer through the network without any impact on the operating system. Impact, thereby avoiding the process of data copying and text exchange in the external memory, and then achieving the effect of releasing memory bandwidth and shortening the CPU (central processing unit) cycle for improving application system performance. [0003] At present, the data transmission operation modes supported by RDMA mainly include RDMA Send (RDMA sending), RDMA Write (RDMA writing), RDMA Read (RDMA reading) and RDMA Atomic (RDMA atomic oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/08G06F13/38G06F12/0868
Inventor 彭贵平
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products