Index generation method, data inquiry method, index generation device, data inquiry device and system

Abstract

The invention discloses an index generation method, a data inquiry method, an index generation device, a data inquiry device and a system, and belongs to the field of data storage. The index generation method comprises the following steps of obtaining a data file; generating corresponding index information for each data record; and for each data record in the data file, storing the corresponding index information into an index file in a hierarchy index directory in a classified way according to the attribute information of the data record, wherein the hierarchy index directory includes n index files positioned in different directories, the n is greater than or equal to 1, and the index files in each directory correspond to one group of attribute information. The index information is dispersed into different directories of the hierarchy index directory according to the attribute information of the data record; the problem of low inquiry speed during the inquiry by using the existing index file when mass data is stored is solved; and the effect that the fast inquiry and processing can be provided even when mass data is stored is achieved.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to an index generation method, data query method, device and system. Background technique [0002] As the functions of the business system become more and more powerful, the data stored in the business system is also increasing. [0003] Index files are usually established in current storage systems, for example, one data file corresponds to one index file, or one database corresponds to one index file. When it is necessary to query data records in the storage system, first query the index in the index file according to the index key, the index records the offset of the target data record in the data file, and then extract it from the data file according to the queried index Output the target data record, and use the target data record as the query result. [0004] In the process of implementing the present invention, the inventors found that the prior art has at least the follo...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the query speed is slow when using the current index file to query and cannot meet the query scenarios with high real-time requirements, the embodiment of the present invention provides an index generation method, data query method, device and system

Images