Data processing method and apparatus

A data processing and data technology, applied in the field of communication, can solve problems such as low data processing efficiency

Active Publication Date: 2017-07-25
ZTE CORP
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data processing method and device to at least solve the problem in the related art that RDMA can only transmit data through multiple interactions and multiple copies of the underlying protocol stack to perform RDMA operations and cause low data processing efficiency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and apparatus
  • Data processing method and apparatus
  • Data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] In this embodiment, a data processing method is provided, figure 1 is a flowchart of a data processing method according to an embodiment of the present invention, such as figure 1 As shown, the process includes the following steps:

[0046] Step S102, obtaining the data amount of the current data to be processed, wherein the current data to be processed includes the input and output I / O data of the current remote direct data access RDMA operation;

[0047] Step S104, if the data amount of the current data to be processed is greater than the first predetermined threshold, directly perform the RDMA operation on the current data to be processed on the page address corresponding to the current data to be processed;

[0048] Step S106, if the amount of data to be processed currently is less than or equal to the first predetermined threshold, perform an RDMA operation on the data to be processed currently on the page address in the receiving device through the pre-establishe...

Embodiment 2

[0128] In this embodiment, a data processing method is provided, Figure 7 is a flowchart of a data processing method according to an embodiment of the present invention, such as Figure 7 As shown, the process includes the following steps:

[0129] S702. When the amount of data currently to be processed acquired by the sending device is greater than a first predetermined threshold, the receiving and sending device directly executes a remote direct data access (RDMA) operation of the current data to be processed on the page address corresponding to the current data to be processed , wherein, the current data to be processed includes the input and output I / O data of the current RDMA operation;

[0130] S704. When the data amount of the current data to be processed is less than or equal to the first predetermined threshold, receive an RDMA operation of performing the current data transmission on the page address in the receiving device through the pre-established data transmiss...

Embodiment 3

[0164] In this embodiment, a data processing device is provided, Figure 8 is a schematic diagram of a data processing device according to an embodiment of the present invention, such as Figure 8 As shown, the device includes:

[0165] 1) The first acquiring unit 802 is configured to acquire the data amount of the current data to be processed, wherein the current data to be processed includes the input and output I / O data of the current remote direct data access RDMA operation;

[0166] 2) The first processing unit 804 is configured to directly perform an RDMA operation on the current data to be processed on the page address corresponding to the current data to be processed when the data amount of the current data to be processed is greater than a first predetermined threshold;

[0167] 3) The second processing unit 806 is configured to perform an RDMA operation on the current data to be processed on the page address in the receiving device through the pre-established data t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and apparatus. The method comprises the steps of obtaining a data quantity of current to-be-processed data, wherein the current to-be-processed data includes I / O (Input / Output) data for executing RDMA (Remote Direct Memory Access) operation currently; if the data quantity of the current to-be-processed data is greater than a first predetermined threshold, executing the RDMA operation of the current to-be-processed data directly on a page address corresponding to the current to-be-processed data; and if the data quantity of the current to-be-processed data is smaller than or equal to the first predetermined threshold, executing the RDMA operation of the current to-be-processed data on a page address in a receiving device through a pre-established data transmission channel. Through the data processing method and apparatus, the problem of relatively low data processing efficiency caused by the fact that the RDMA operation is executed in a mode of transmitting the data only through multi-time interaction and multi-time copying of a bottom protocol stack in the prior art is solved, so that the effect of improving data processing efficiency is achieved.

Description

technical field [0001] The present invention relates to the communication field, in particular, to a data processing method and device. Background technique [0002] With the continuous expansion of user data, the rise of information technology. The bandwidth between various communication devices is increasing. A PCIe (PCI-Express) link is widely used as a mainstream high-speed transmission protocol in a node. While continuously improving the bandwidth, the PCIe protocol has gradually begun to step out of the interconnection protocol between the central processing unit (CPU, Central Processing Unit) and external devices in the node, using the non-transparent bridge (NTB, Non Transparentbridge) technology of PCIe, The PCIe protocol can support high-speed interconnection between nodes, and the address domains of interconnected nodes are isolated through NTB. After the address mapping of the NTB, the DMA engine on the local node can access the memory on the peer node by acce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F13/28G06F12/0831
CPCG06F12/0835G06F13/28G06F2213/0024
Inventor 刘卯银秦长鹏戴庆军牛克强张翼舒坦
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap