Hybrid index structure with storage perception

Abstract

The invention discloses a hybrid index structure with storage perception, and belongs to the technical field of database query. The hybrid index structure is divided into a tree index structure from top to bottom, including three parts of a top layer in a primary storage, an interlayer in internal storage, and a bottom layer in an external storage. The top layer, the interlayer, and the bottom layer are stored in the internal storage when the internal storage is sufficient. Partial or all interlayer is stored in the external storage when the internal storage is insufficient. The invention also discloses a creation method, a reading method, a range query method, and a reconstruction method of the hybrid index structure. Through memory map, when the internal storage is insufficient, part index data is stored in the external storage, so as to effectively use the internal storage and the external storage and other storage resources. The internal and external storage occupation ratio of the hybrid index structure can be rationally decided according to system conditions or user efficiency requirements, so as to improve query efficiency.

Description

technical field [0001] The invention discloses a storage-aware hybrid index structure, which belongs to the technical field of database query. Background technique [0002] The existing database index can be divided into two types according to the storage method. One is to use the frequent access method completely based on the hard disk to perform query and other operations, but does not make full use of the faster processing devices such as main memory and cache, and the performance cannot break through the device. bottleneck. The other is the main memory index technology, that is, the index is completely built in the main memory. As an efficient index method, caching technology is often used, and the performance is very efficient under the framework of modern computers. However, when the amount of data is large enough to a certain extent For example, in the current cloud computing scenario where heterogeneous computing resources are used for massive data processing, the m...

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a storage-aware hybrid index structure based on the shortcomings of the above-mentioned background technology, which is improved based on the FD-tree index structure, and the internal and external memory distribution of the index tree is determined based on the memory space, and stored on the hard disk. Partial or all of the index structure is imported into the main memory, which improves query and update efficiency without destroying the persistence characteristics of the system, and solves the index structure that only imports the B+-tree at the top of the index tree into the main memory. low technical issues

Images