Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Memory database OLTP and OLAP concurrency query optimization method

A query optimization and database technology, applied in database model, multi-dimensional database, electronic digital data processing and other directions, can solve the problems of long execution time, concurrency control mechanism OLAP query processing time is not significant, and execution time is short, and achieves good applicability , Increase the probability of concurrent transaction access conflicts, and improve the effect of processing performance

Active Publication Date: 2014-07-23
RENMIN UNIVERSITY OF CHINA
View PDF3 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, in the mixed OLTP&OLAP load, the core problem of the update operation is the concurrency control problem caused by a large number of insert-only update loads on the fact table, and the execution time of the OLAP query on the dimension table is relatively short (mainly used to generate connection Hash table), and the execution time on the fact table is longer, so the efficiency of the concurrency control mechanism on the dimension table has no significant impact on the overall OLAP query processing time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Memory database OLTP and OLAP concurrency query optimization method
  • Memory database OLTP and OLAP concurrency query optimization method
  • Memory database OLTP and OLAP concurrency query optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0030] In this embodiment, it mainly solves the problem of mixed OLTP&OLAP concurrent query processing on the typical star-shaped and snowflake-shaped model of a data warehouse. Star model (e.g. figure 1 (Shown) is composed of a fact table and several dimension tables. The primary key of the dimension table and the foreign key of the fact table form a primary-foreign key referential integrity reference relationship. A typical OLAP query needs to select predefined levels or dimension attribute members in the dimension table through predicate operations on the relevant dimension table, and specify the grouping attributes on the dimension, and then perform grouping and aggregation calculations on the measure attributes of the fact table. Therefore, an OLAP query can be decomposed into a query subtask sequence on each dimension table and fact table. The dimension table is responsible for outputting the grouping sequence projected on the relevant dimension to the fact table. The fact...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a memory database OLTP and OLAP concurrency query optimization method. The method includes the steps that (1) by means of two query processing engines, independent storage engines are adopted to a dimension table and a fact table; (2) the dimension table is updated through an embedded concurrency control mechanism of the independent storage engines, the fact table is equivalent to multiple continuous arrays in logic and maintains two dynamic data structures, namely a read record pointer and a write record pointer, the read record pointer records the position of the last record inquired through OLPA currently, and the write record pointer records the insert position of a new record; (3) an OLTP transactional queue and an OLAP transactional queue are independently executed with the read pointer and the write pointer as boundaries, the fact table adopts a column storage horizontal fragmentation model based on the fixed number of columns, N columns of storage records serve as an independent column storage container, and each column storage container adopts an independent data compression mechanism; (4) an access function on compressed data or non-compressed data is provided through access interfaces of the column storage containers when OLAP query has access to the column storage containers.

Description

Technical field [0001] The invention relates to a query optimization method for mixing OLAP (analytical query processing) and OLTP (transactional query processing), in particular to a OLTP&OLAP concurrent query optimization method for a memory database facing OLAP mode and load characteristics in the technical field of database management . Background technique [0002] Database technology can be divided into two main types: transactional query processing (on-line transaction processing, OLTP) and analytical query processing (on-line analytical processing, OLAP). Among them, transactional query processing is mainly for data in the database. Add, delete, and modify operations, the transaction execution time is short, it needs to meet the ACID (atomicity, consistency, isolation, durability) characteristics, and the correctness of transaction execution needs to be guaranteed through a complex concurrency control mechanism; analytical query processing is mainly Represented by the mu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/24532G06F16/283
Inventor 张延松张宇王珊
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com