Data query method, device and system

Abstract

The invention discloses a data query method, device and system. The data query method comprises the following steps: acquiring a condition column corresponding to a query condition in a query request and a target column corresponding to a query target in the query request from a compressed data block through the data query device, wherein the compressed data block is obtained through compressing an original data block by taking column width as a unit; determining a line mask corresponding to at least one continuous first compression record in the condition column according to the query condition; if determining that a second compression record in the condition column corresponds to at least one original record and the at least one original record is correspondingly same as an original record corresponding to the at least one continuous first compression record one by one, determining that a line mask corresponding to the second compression record comprises a line mask corresponding to the at least one continuous first compression record; and determining a query result corresponding to the query request according to the line mask corresponding to each compression record in the condition column and the target column, so as to improve the data query speed.

Description

technical field [0001] The present invention relates to the field of databases, more specifically, to a data query method, device and system. Background technique [0002] As the amount of data and the speed of data generation continue to grow, the amount of data that needs to be processed by database query operations increases exponentially, and the query delay continues to increase. Based on the growth of data volume and large-scale data analysis requests, columnar databases are getting more and more attention. [0003] For columnar database query requests, two commonly used methods are the data query method based on the central processing unit (Central Processing Unit, CPU) software platform and the heterogeneous platform based on CPU+field-programmable gate array (Field-Programmable Gate Array, FPGA). data query method. [0004] In the data query method based on the CPU software platform, the CPU reads the required data block from the disk to the memory, indexes the da...

AI Technical Summary

Problems solved by technology

[0007] In the above data query method based on CPU+FPGA heterogeneous platform, FPGA needs to decompress the entire data block and perform data query, which affects the speed of data query

[0008] Therefore, when the existing data query method encounters a large amount of query data, it needs to decompress a large amount of data and perform query operations on a large amount of data, and the data query speed is relatively slow.

Images