A Method of In-Memory Data Organization and Query Based on Data Grouping

A technology of data grouping and data organization, applied in the field of information processing, can solve the problems of limited improvement of range query performance, neglect of result set optimization, etc., to achieve the effect of improving query performance, reducing time, and improving performance

Active Publication Date: 2017-03-01
安捷中科(北京)数据科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The query optimization in the traditional data management method is often aimed at the optimization of the performance during the search process, while ignoring the optimization of the result set acquisition. Therefore, the performance improvement of the range query is limited.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of In-Memory Data Organization and Query Based on Data Grouping
  • A Method of In-Memory Data Organization and Query Based on Data Grouping
  • A Method of In-Memory Data Organization and Query Based on Data Grouping

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] specific implementation plan

[0027] The present invention will be described in detail below through specific embodiments and accompanying drawings.

[0028] The memory data organization query optimization method based on data grouping proposed by the present invention, its overall flow is as follows figure 1 As shown, the specific description is as follows:

[0029] First, all data is divided into different data groups, and each group establishes an independent group data organization structure. The data organization structure can be commonly used classic memory data structures such as hash and B+ tree. Each group has its own independent insertion thread, group selection thread and insertion task queue.

[0030] Such as image 3 As shown, when there is a new data to enter the system, the group selection thread selects a unique group for the data. Grouping can be determined in different ways according to different situations: such as selecting data groups in order,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data grouping-based memory data organization query method. The method comprises the steps of dividing data into multiple groups; setting an independent insertion task queue, insertion thread and query thread in each group; selecting threads in a grouping mode, selecting one group for the data to be inserted and inserting the data into the insertion task queue of the group; polling the insertion task queue to which the insertion thread belongs by each insertion thread and inserting the data into the group; enabling a query task distributing thread to distribute the query task to the query thread of each group, performing data query in the group by each query thread and feeding the query result back to the query task distributing thread; summarizing the query results in each group by the query task distributing thread. According to the data grouping-based memory data organization query method, fast data insertion is ensured, fast result feedback in the range query is ensured, and the data query performance of a database system is effectively improved.

Description

technical field [0001] The invention relates to the technical field of information processing, in particular to a method for organizing and inquiring data stored in a database management system. The method can be used in the data management field used by any relational database, especially in the data analysis field with many range queries. Background technique [0002] In the application field of the database, the query performance of the data is one of the most important indicators of the database. In order to improve the query performance of the database, many data organization and management methods have been proposed, such as hash, B+ tree, CSB+ tree and other index structures. These methods are designed to improve the performance of data queries. [0003] In recent years, with the development of applications, there are more and more data analysis applications. For example, in the financial field, analysis of transaction trends and statistics of transaction volume; i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2471
Inventor 郭超李坤王永炎罗雄飞王宏安
Owner 安捷中科(北京)数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products