Data acceleration operation processing method and device and computer readable storage medium

Abstract

The invention discloses a data acceleration operation processing method and device and a computer readable storage medium. The method comprises the following steps that: a storage server applies for an input cache space and an output cache space in advance by utilizing a memory management module, and meanwhile, transmits the initial address of each memory page of the input cache space and the output cache space to a direct memory access descriptor table, wherein the input cache space stores IO original data corresponding to a user data request , and the output cache space stores a data processing result obtained after the IO original data is subjected to accelerated operation; an FPGA acceleration card receives a data acceleration operation request and transfers the IO original data to thelocal from the input cache space through the direct memory access descriptor table to subject the IO original data to accelerated operation processing, and transfers a data processing result to the output cache space through the direct memory access descriptor table; and therefore, memory copying can be avoided while the FPGA acceleration card is used for carrying out data processing on the storage server, and the performance loss of the storage server in the acceleration process is effectively reduced.

Description

Technical field [0001] This application relates to the field of data reading and writing technology, and in particular to a data acceleration operation processing method, device and computer-readable storage medium. Background technique [0002] Under the trend of big data and cloud computing, the importance of data storage has become increasingly prominent. From the current point of view, all flash products are an inevitable trend in the development of storage systems. With the rapid development of SSD (Solid State Drives) technology, more and more SSDs are used in storage systems, but the price of SSDs has always remained high. How to use the limited SSD space to store more data content, compression and deduplication are important features of all flash storage. However, features such as deduplication and compression consume too much CPU and involve memory copy operations that are unavoidable, and need to be implemented with the help of an FPGA accelerator card. [0003] When t...

AI Technical Summary

Problems solved by technology

However, features such as deduplication and compression consume too much CPU, and inevitably involve memory copy operations, which need to be implemented with the help of an FPGA accelerator card.

[0003] When the storage server calls the FPGA accelerator card for data compression and data deduplication, it needs to apply for a large storage space in advance to copy the user IO request and its data from the original storage location to the storage space, and then the FPGA accelerator card Read data from this storage space for processing. After processing, the FPGA accelerator card will send the processing results back to another storage space in the storage server, and the storage server will copy the data processing results back to the original storage location. The entire data The processing process involves multiple data copies, and the memory copy needs to consume a lot of CPU (Central Processing Unit, central processing unit) resources

Images