Fast data reading and writing method and device

Abstract

A fast data read / write method is applied to a computer system comprising a storage medium, a host and a hardware acceleration controller HAC. The hardware acceleration controller is connected with the host and the storage medium via interfaces, and the host comprises a central processing unit and is connected with an external interface. The method comprises: the hardware acceleration controller HAC receiving a read / write request sent by the central processing unit, the read / write request comprising metadata of an external file requiring data reading or writing and being judged by the central processing unit as generating, after the data read / write request, a command sent by the system process; reading data from the file according to the metadata; or writing into the file the data needing to be written into the file; and reporting a data read / write result to the central processing unit. Through the use of the method provided in the embodiments, IO (Input Output) processing of the file system is carried out by the HAC and thus the host can process more other services.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a fast data reading and writing method and device. Background technique [0002] A complete computer system consists of three systems: computing system, storage system and network system, which are managed by an operating system; the storage system exists in the form of a file system in the operating system, and the overhead of the file system is in the entire operating system. A large part of the performance overhead. [0003] In prior art 1, the file system and device driver are part of the operating system, and the CPU is responsible for logic and data operations. When a file read or write operation is required, the process initiates an IO request, and the IO request passes through the operating system. Kernels, processed by the CPU. The main steps are as follows: when the process needs to read and write files, it initiates an IO request to the operating system; the kernel rea...

AI Technical Summary

Problems solved by technology

The main steps are as follows: when the process needs to read and write files, it initiates an IO request to the operating system; the kernel reads the metadata in the memory, and packages the IO request, such as making the IO request include information such as the start address of the file, the length of the file, etc. And send the wrapped IO request to the device driver; the kernel controls the device driver, sends the request to read or write data to the disk, and the disk performs the corresponding read or write operation; the disk transfers the data to the memory and updates the metadata Data, the above steps require the participation of the CPU, which consumes the computing power of the CPU

[0004] In prior art two, yes Figure 1A The software stack in is modified, and the modified software stack is as follows Figure 1B as shown, Figure 1B In the above, the file system and device driver are separated from the software, and the related operations of the file system and the driver are solidified in the hardware, and the hardware is used to complete the related operations of the file system and the driver, but if the file system is too large, the metadata Too much, and the metadata are kept in the memory, the hardware memory is limited, so the size and number of files that the hardware can support are limited, and this technology needs to modify the software and hardware and other aspects, so it is not easy to integrate into in the existing operating system

Images