Large scale data transmission method and system

Abstract

The invention is applicable to the technical field of communication and provides a large scale data transmission method and system. The large scale data transmission method and system comprise: when data start transferring, an application invokes a driver to make the driver initiate a write operation to a controller and the write operation includes a first user state process and a first kernel process; after the first user state process finishes executing, the driver initiates a read operation to the controller when executing the first kernel process to make the first kernel process and a second user state process pursue simultaneously, wherein the read operation includes the second user state process and a second kernel process; after the second user state process finishes executing, the driver initiates the read operation to the controller again when executing the second kernel process to make the second kernel process and the driver pursue simultaneously again with the read operation initiated by the controller; circularly executing the process until the data transfer is complete. The large scale data transmission method and system have the advantage of being capable of achieving the read operation and the write operation simultaneously when transferring the data. Especially when the date scale is relatively large, the data transmission efficiency can be improved.

Description

technical field [0001] The invention belongs to the technical field of communication, and in particular relates to a large-scale data transmission method and system. Background technique [0002] The existing direct memory access (direct memory access, DMA) implementation method is to use the direct memory access controller to write the data to be processed from the host memory to the accelerator card first, and wait for the accelerator card to complete the data calculation. The controller reads the calculated data from the accelerator card and transmits it to the host memory. In the existing direct memory access data transmission technology, during data transmission, when the direct memory access controller is performing a write operation, the transmission channel for the read operation is in an idle state; when the direct memory access controller is performing a read operation, The transmission channel of the write operation is in an idle state, especially when the data s...

AI Technical Summary

Problems solved by technology

[0003] Embodiments of the present invention provide a large-scale data transmission method and system, aiming to solve the problem of the transmission of read operations when the direct memory access controller is performing a write operation during data transmission in the existing direct memory access data transmission technology. The channel is in an idle state; when the direct memory access controller is performing a read operation, the transmission channel of the write operation is in an idle state, especially when the data size is relatively large, the two cannot be performed at the same time, so that the data writing and reading It takes a lot of time to fetch and the transmission efficiency is low

Images