File transmission method and device, equipment and storage medium

Abstract

The invention discloses a file transmission method and device, equipment and a storage medium, and the method comprises the steps: receiving a file transmission request initiated by an application program, applying for a kernel cache under the triggering of the file transmission request, and reading a corresponding file from a disk into the kernel cache; and informing the RDMA network card hardware to initiate a read operation through the RDMA network card driver so as to indicate the RDMA network card hardware to read the file in the kernel cache into the internal cache of the RDMA network card hardware, and sending the file in the internal cache to the remote node. Visibly, on the basis of related functions provided by an existing RDMA network card driver in the kernel space, file transmission is achieved by reading the corresponding file in the disk into the applied kernel cache and reading the corresponding file in the kernel cache into the RDMA network card hardware, redundant memory copying operation is avoided, the time of carrying the data from the disk to the internal cache of the RDMA network card hardware is shortened, and the transmission efficiency of file transmission is improved.

Description

technical field [0001] The present invention relates to the technical field of data transfer, and more specifically, to a file transfer method, device, equipment and storage medium. Background technique [0002] Currently, when using RDMA (Remote Direct Memory Access, remote direct address access) to implement the file transfer function, the technical level is mainly divided into the following steps: under the trigger of the application, read the data from the disk into the kernel cache, and then read the data from the kernel The cache is copied to the application cache, and finally the data is read from the application cache into the hardware internal cache, and the data is sent from the hardware internal cache to the remote node. It can be seen that in the above operation steps, there are a total of three times related to data migration, namely reading data from disk into kernel cache, copying data from kernel cache to application cache, and reading data from application c...

AI Technical Summary

Problems solved by technology

It can be seen that in the above operation steps, there are three times related to data migration, which are reading data from disk into kernel cache, copying data from kernel cache to application cache, and reading data from application cache to hardware internal cache. Copying the kernel cache to the memory copy of the application cache is essentially moving data from one address space in the memory hardware to another. In principle, it is a redundant operation and is very time-consuming.

Images