Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

OLAP grouping aggregation method based on function dependency relationship

A functional dependency and relational technology, applied in database models, multi-dimensional databases, electrical digital data processing, etc., can solve problems such as high CPU computing cost, increased memory access delay for group computing, and increased hash table space, reducing computing costs. cost, the effect of reducing storage and computing overhead

Active Publication Date: 2016-09-07
RENMIN UNIVERSITY OF CHINA
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In OLAP queries, the GROUP BY attribute is a grouping attribute. When there are many grouping attributes or the grouping attributes involve longer character attributes, the database directly uses the longer attribute as the hash key value for group calculation. When hash mapping A higher CPU calculation cost is generated, and the group hash table needs to store a longer key value, which leads to an increase in the space of the hash table, more cache misses, and increases the memory access delay of the group calculation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • OLAP grouping aggregation method based on function dependency relationship
  • OLAP grouping aggregation method based on function dependency relationship
  • OLAP grouping aggregation method based on function dependency relationship

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0031] Such as figure 1 As shown, the database usually uses the hash group aggregation calculation method. The attribute group corresponding to the GROUP BY clause is used as the hash key value (hash key) to perform hash mapping through the hash function, and is mapped to the unique bucket in the hash table, the bucket Several hash records are stored in , and the hash records are composed of hash key values ​​and aggregation calculation units. Since different hash key values ​​may correspond to the same bucket under the mapping of the hash function, the hash key value needs to be kept in the hash table for comparison and as a grouping attribute of the output result.

[0032] The efficiency of hash group aggregation calculation depends on the storage access efficiency of hash table and the calculation efficiency of hash detection. In an in-memory database, the smaller the hash table, the higher the cache hit rate of the hash table memory access, and the lower the memory access...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an OLAP grouping aggregation method based on a function dependency relationship. The method comprises following steps: a function dependency tree structure among grouping attributes is defined, and the function dependency relationship between the grouping attributes and attributes among tables is defined; the grouping attribute of the GROUP BY clause is detected according to the grouping attribute function dependency tree; a query grouping attribute is divided into two subgroups which are formed by function dependency key attributes and other grouping attributes respectively; mode resolution is performed on a dimension table according to the function dependency relationship, wherein the dimension table adopts surrogate key mechanism and memory column storage mechanism; under the mechanisms of dimension table mode resolution and surrogate key index, grouping aggregation calculation further converts the subgroup attributes into function dependency attributes; after the grouping aggregation calculation is completed, the function dependency attributes are directly mapped to a memory offset address of related dimension table records according to function dependency attribute values to complete the operation of extracting other related grouping attributes. By means of the method, the size of grouping attributes can be reduced, and the Hash grouping calculating efficiency is increased.

Description

technical field [0001] The invention relates to an OLAP grouping aggregation method, in particular to an OLAP grouping aggregation method which reduces the grouping attributes through the functional dependency relationship between the same or different table attributes in a database, and optimizes the grouping aggregation computing performance based on the functional dependency relationship. Background technique [0002] At present, grouping and aggregation operations are an important function of OLAP queries. In relational databases, records are grouped and aggregated mainly through hash tables. In OLAP queries, the GROUP BY attribute is a grouping attribute. When there are many grouping attributes or the grouping attributes involve longer character attributes, the database directly uses the longer attribute as the hash key value for group calculation. When hash mapping A higher CPU calculation cost is generated, and the group hash table needs to store a longer key value, w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/2264G06F16/283
Inventor 张延松张宇周烜王珊
Owner RENMIN UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products