Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Method for Optimizing Concurrent Query of Memory Database OLTP&OLAP

A query optimization and database technology, applied in database models, multi-dimensional databases, digital data processing, etc., can solve the problems of concurrency control mechanism OLAP query processing time is not significant, execution time is short, execution time is long, etc., to increase transactions Concurrent access violation probability, good applicability, and the effect of improving processing performance

Active Publication Date: 2017-02-01
RENMIN UNIVERSITY OF CHINA
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, in the mixed OLTP&OLAP load, the core problem of the update operation is the concurrency control problem caused by a large number of insert-only update loads on the fact table, and the execution time of the OLAP query on the dimension table is relatively short (mainly used to generate connection Hash table), and the execution time on the fact table is longer, so the efficiency of the concurrency control mechanism on the dimension table has no significant impact on the overall OLAP query processing time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method for Optimizing Concurrent Query of Memory Database OLTP&OLAP
  • A Method for Optimizing Concurrent Query of Memory Database OLTP&OLAP
  • A Method for Optimizing Concurrent Query of Memory Database OLTP&OLAP

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0030] In this embodiment, the problem of hybrid OLTP&OLAP concurrent query processing on typical star and snowflake models of data warehouses is mainly solved. star schema (such as figure 1 As shown) is composed of a fact table and several dimension tables, and the primary key of the dimension table and the foreign key of the fact table form a master-foreign key referential integrity reference relationship. A typical OLAP query needs to select the predefined hierarchy or dimension attribute members in the dimension table through the predicate operation on the related dimension table, and specify the grouping attribute on the dimension, and then perform group aggregation calculation on the measurement attribute of the fact table. Therefore, an OLAP query can be decomposed into query subtask sequences on each dimension table and fact table. The dimension table is responsible for outputting the grouping sequence projected on the relevant dimensions to the fact table. Grouping f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a memory database OLTP and OLAP concurrency query optimization method. The method includes the steps that (1) by means of two query processing engines, independent storage engines are adopted to a dimension table and a fact table; (2) the dimension table is updated through an embedded concurrency control mechanism of the independent storage engines, the fact table is equivalent to multiple continuous arrays in logic and maintains two dynamic data structures, namely a read record pointer and a write record pointer, the read record pointer records the position of the last record inquired through OLPA currently, and the write record pointer records the insert position of a new record; (3) an OLTP transactional queue and an OLAP transactional queue are independently executed with the read pointer and the write pointer as boundaries, the fact table adopts a column storage horizontal fragmentation model based on the fixed number of columns, N columns of storage records serve as an independent column storage container, and each column storage container adopts an independent data compression mechanism; (4) an access function on compressed data or non-compressed data is provided through access interfaces of the column storage containers when OLAP query has access to the column storage containers.

Description

technical field [0001] The present invention relates to a query optimization method for hybrid OLAP (analytical query processing) and OLTP (transactional query processing), in particular to an in-memory database OLTP&OLAP concurrent query optimization method for OLAP mode and load characteristics in the field of database management technology . Background technique [0002] Database technology can be divided into two main types: transactional query processing (on-line transaction processing, OLTP) and analytical query processing (on-line analytical processing, OLAP). Add, delete, and modify operations, the transaction execution time is short, need to meet the ACID (atomicity, consistency, isolation, persistence) characteristics, and need to ensure the correctness of transaction execution through a complex concurrency control mechanism; analytical query processing mainly Represented by the multi-dimensional analysis processing in the data warehouse using the multi-dimensiona...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/24532G06F16/283
Inventor 张延松张宇王珊
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com