Hybrid index structure with storage perception

An index structure and storage-aware technology, applied in the field of database query, can solve the problems of low index efficiency and achieve a good balance between practicability and versatility, efficiency and space occupation

Active Publication Date: 2015-09-09
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF3 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a storage-aware hybrid index structure based on the shortcomings of the above-mentioned background technology, which is improved based on the FD-tree index structure, and the internal and external memory distribution of the index tree is determined based on the memory space, and stored on the hard disk. Partial or all of the index structure is imported into the main memory, which improves query and update efficiency without destroying the persistence characteristics of the system, and solves the index structure that only imports the B+-tree at the top of the index tree into the main memory. low technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hybrid index structure with storage perception
  • Hybrid index structure with storage perception
  • Hybrid index structure with storage perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] Embodiment 1: The index creation and reconstruction process, the specific steps are as follows image 3 , Figure 6 shown.

[0036] index creation

[0037] A. Obtain the continuous space that can be occupied by the memory, calculate the space occupied by the index structure according to the number of key values, and initialize the hierarchical address table:

[0038]First calculate the space occupied by using the top-level tree completely. If it exceeds the threshold (according to the memory occupancy calculation*50%), then calculate the space occupied by the optimal number of layers of the B+-tree, and the remaining layers use the ordered index item sequence layer to calculate separately Layer number and hierarchical address table;

[0039] B. Create an initial index file of the appropriate size:

[0040] The index file is the file that stores the entire index structure and is located in the external memory. The purpose of the index file is that when the system i...

Embodiment 2

[0060] Embodiment 2: The five operations of index insertion, deletion, point query, range query and modification are as follows.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hybrid index structure with storage perception, and belongs to the technical field of database query. The hybrid index structure is divided into a tree index structure from top to bottom, including three parts of a top layer in a primary storage, an interlayer in internal storage, and a bottom layer in an external storage. The top layer, the interlayer, and the bottom layer are stored in the internal storage when the internal storage is sufficient. Partial or all interlayer is stored in the external storage when the internal storage is insufficient. The invention also discloses a creation method, a reading method, a range query method, and a reconstruction method of the hybrid index structure. Through memory map, when the internal storage is insufficient, part index data is stored in the external storage, so as to effectively use the internal storage and the external storage and other storage resources. The internal and external storage occupation ratio of the hybrid index structure can be rationally decided according to system conditions or user efficiency requirements, so as to improve query efficiency.

Description

technical field [0001] The invention discloses a storage-aware hybrid index structure, which belongs to the technical field of database query. Background technique [0002] The existing database index can be divided into two types according to the storage method. One is to use the frequent access method completely based on the hard disk to perform query and other operations, but does not make full use of the faster processing devices such as main memory and cache, and the performance cannot break through the device. bottleneck. The other is the main memory index technology, that is, the index is completely built in the main memory. As an efficient index method, caching technology is often used, and the performance is very efficient under the framework of modern computers. However, when the amount of data is large enough to a certain extent For example, in the current cloud computing scenario where heterogeneous computing resources are used for massive data processing, the m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/2272
Inventor 秦小麟王胜史文浩王潇逸李博涵
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products