Database inquiry processing method facing concurrency OLAP (On Line Analytical Processing)

A processing method and database technology, applied in the field of database management, can solve problems such as memory bandwidth waste, HASH filtering cost increase, and HASH filter performance is difficult to predict, so as to reduce the number of executions and improve CPU efficiency.

Active Publication Date: 2012-09-12
RENMIN UNIVERSITY OF CHINA
View PDF4 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The expansion of this public HASH aggregation table will lead to an increase in the cost of HASH filtering (HASH connection), the possibility that the HASH aggregation table needs disk exchange will increase, the average performance of the query will decrease, and the performance of each HASH filter is unpredictable.
When the selectivity of the query is low, the group query needs to pass a large amount of data between the HASH filters, even when the final query bit vector is all zeros, it also needs to pass data between the HASH filters, but in fact only the query bit vector The query corresponding to the non-zero position in the result needs to use all the data passed between the HASH filters, which causes a lot of waste of memory bandwidth.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database inquiry processing method facing concurrency OLAP (On Line Analytical Processing)
  • Database inquiry processing method facing concurrency OLAP (On Line Analytical Processing)
  • Database inquiry processing method facing concurrency OLAP (On Line Analytical Processing)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] As mentioned above, there is no reliable shared I / O concurrent query processing cost model in the prior art, so it is impossible to optimize the design for different storage models and hardware settings. Therefore, the present invention provides a concurrent OLAP-oriented database query processing method (abbreviated as DDTA-CJOIN method). The DDTA-CJOIN method is especially suitable for use in multi-core processor platforms, including two technical contents of memory OLAP star join optimization based on predicate vectors and concurrent OLAP query processing based on batch query predicate vector bit operations, specifically including OLAP The multi-table join operation is vectorized, and the bit operation of the concurrent query vector group is completed, and technical measures such as planetary join processing and subsequent HASH group aggregation processing are completed. This is described in detail below.

[0031] figure 1It is a schematic diagram of optimization o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a database inquiry processing method facing the concurrency OLAP (On Line Analytical Processing). On the basis of the predicate vector-based memory OLAP star join optimization, the concurrency OLAP inquiry processing on the basis of the bit operation of inquiring predicate vectors in batches is carried out. According to the invention, in a database management system, aiming at the I/O (Input/Output) performance and the parallel OLAP processing performance, a concurrency inquiry processing optimization technology is implemented and the optimization and setting of a concurrency OLAP processing load facing the I/O performance are supported, so that the predictable processing performance facing the diversified OLAP inquiry is improved and the concurrency inquiry star join bitmap filtering processing on the basis of an array of the predicate vectors is implemented.

Description

technical field [0001] The invention relates to a database query processing method, in particular to a method for reducing the cost of star connection in concurrent OLAP and improving the concurrent query processing capability through a predicate vector batch bit processing technology, which belongs to the technical field of database management. Background technique [0002] Today, data processing can be roughly divided into two categories: on-line transaction processing (OLTP for short) and on-line analytical processing (On-Line Analytical Processing, OLAP for short). OLTP is mainly about day-to-day transaction processing, such as bank transactions. OLAP is designed to meet specific query and reporting requirements for decision support or multidimensional environments. Many applications including OLAP drive the emergence and development of data warehouse technology; and data warehouse technology in turn promotes the development of OLAP technology. [0003] In OLAP, I / O (i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/283
Inventor 王珊张延松
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap