Distributed type in-memory database indexing method oriented to structural data

A structured data and data distribution technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as large memory usage, low storage index efficiency, and technical effects of reducing memory requirements, so as to improve utilization rate , Efficiently store indexes, reduce the effect of technical effects

Active Publication Date: 2015-11-25
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF3 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention provides a structured data-oriented distributed memory database indexing method, which solves the technical problems of low storage index efficiency and large memory occupation in the existing distributed memory database system index, and realizes efficient storage Index, which can use the index to quickly query data, compress the index, and reduce the technical effect of memory requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed type in-memory database indexing method oriented to structural data
  • Distributed type in-memory database indexing method oriented to structural data
  • Distributed type in-memory database indexing method oriented to structural data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] In the first embodiment, a distributed memory database index method for structured data is provided, including:

[0057] Receive database operation requests;

[0058] According to the data operation request, the key value to be operated is indexed in the database.

[0059] Among them, the index includes:

[0060] Data distribution index and dictionary:

[0061] In order to cope with the large number of operations on columns in the OLAP database, this database uses columnar storage, and the compressed original data is distributed and stored in units of columns. The correlation between different columns is determined by the rowkey in the source database. The processed column data is segmented and stored in a distributed manner. At the same time, a data distribution index is established for the slice data to locate the slice. The segmented column data is compressed locally to save memory storage space.

[0062] press figure 1 As shown, the data distribution index of the name column...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed type in-memory database indexing method oriented to structural data. The method includes the steps of receiving a database operation request; indexing a to-be-operated key value in the database according to the data operation request. Indexes include distributed type indexes and bottom-layer single-machine indexes, the distributed type indexes include data distribution indexes and row distribution indexes, the data distribution indexes are responsible for cross-machine positioning of data and row tables, the bottom-layer single-machine indexes are fine-grained data-level indexes, the single-machine indexes include line compression indexes and row table indexes, the line compression indexes are composed of three vectors including the dictionary, the frequency vector and the row number index, and the row tables are responsible for keeping the mapping of row numbers of all record items to dictionary subscripts where the record items are located. The method has the technical advantages that high-efficiency storage indexing can be achieved, data can be rapidly inquired about through the indexes, the indexes are compressed, and the memory requirement is lowered.

Description

Technical field [0001] The invention relates to the field of computer software, in particular to a distributed memory database index method oriented to structured data. Background technique [0002] With the development of computer hardware level, the price of memory has become acceptable to everyone. Since memory is faster than hard disk storage, it can be better for query and access. Therefore, more and more people begin to study in memory Realize data storage. At the same time, in the information society, large-scale data storage has become very common. In order to design a database using memory in a distributed environment and meet the needs of OLAP, we have researched and designed a distributed memory database system. For databases, database indexing technology is the most important part. How to store indexes efficiently and use indexes to quickly query data is the key to database design. In addition, because it is an in-memory database, memory resources are relatively pre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/2471
Inventor 段翰聪闵革勇王瑾郑松陈超谭春强孙振兴
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap