OLAP pre-calculation model, automatic modeling method and automatic modeling system

An automatic modeling and pre-computing technology, applied in computing, database models, instruments, etc., can solve the problems of increased pre-computing and storage costs, large amount of result data, long pre-computing time, etc. Computational efficiency, the effect of reducing redundant computing and data storage

Active Publication Date: 2017-08-01
SHANGHAI KYLIGENCE INFORMATION TECH CO LTD
View PDF8 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The technical problem to be solved by the present invention is: the current technology has a hidden danger of dimension explosion for the data analysis business with too many dimensions and a large dimension base, and the pre-calculation time is too long and the resulting data volume is too large. Computing and storage costs, on the other hand, also bring challenges to scanning a large number of pre-calculated results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • OLAP pre-calculation model, automatic modeling method and automatic modeling system
  • OLAP pre-calculation model, automatic modeling method and automatic modeling system
  • OLAP pre-calculation model, automatic modeling method and automatic modeling system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Such as figure 1 As shown, a kind of OLAP pre-calculation model of the present invention, this pre-computation model includes: dimension module, aggregation group module, measure module; Described dimension module comprises: common dimension unit and derivation dimension unit; Described common dimension unit , used to precalculate the fields on the fact table; the derived dimension unit is used to precalculate the primary key on the dimension table, and record the mapping relationship between the columns on the dimension table and the primary key; the dimension table of the derived dimension The primary key and common dimension are used as pre-calculated dimensions, which conform to a specific order; the aggregation group module is used to divide the multiple pre-calculated dimensions calculated in the dimension module into multiple aggregation groups; the measurement module is used to Aggregates all precomputed dimension combinations in the dimension module to generat...

Embodiment 2

[0050] Such as figure 2 Shown, a kind of automatic modeling method based on OLAP precalculation model of the present invention, this method comprises the steps:

[0051] S1, perform data statistics according to the data model and data source given by the user, and obtain the data statistics results;

[0052] S2, perform query rehearsal according to the data model and target query given by the user, and determine the business model;

[0053] S3, perform query rehearsal on the sample, and collect query statistics;

[0054] S4, based on the business model in S2 and the statistical results of data in S1, perform physical modeling, and define the dimensions, measurements, and aggregation groups of the pre-computing model;

[0055] S5, based on the query statistics in S3, adjust the model after the physical modeling in S4 to obtain a business modeling result;

[0056] S6. Optimizing and adjusting the business modeling in S5 to obtain a pre-computation model.

[0057] Solve the ...

Embodiment 3

[0086] Such as Figure 5 Shown, the automatic modeling system of a kind of OLAP precalculation model of the present invention, this system comprises: data statistics module, business model module, query statistics module, modeling building module; Data statistics module, for according to user given The data model and data source are used to perform data statistics to obtain the data statistics results; the business model module is used to conduct query rehearsal according to the data model and samples given by the user, and determine the business model; the query statistics module is used to perform sample analysis Query rehearsal, and collect query statistics; modeling building module, used to obtain the results of business modeling according to the data statistics module, business model module, and query statistics module.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an OLAP pre-calculation model, an automatic modeling method and an automatic modeling system. The model comprises a dimension module, an aggregation group module and a measurement module. The method comprises the steps of performing data statistics on all data sources to obtain a data statistics result; according to a data model given by a user and operation of performing query rehearsal on a target query, determining a business model; performing query rehearsal on a sample, and collecting query statistics; performing physical modeling, and defining dimensions, measurement and an aggregation group of the pre-calculation model; obtaining a business modeling result; and obtaining the pre-calculation model. The system comprises a data statistics module, a business model module, a query statistics module and a model building module. By adding derived dimensions and the aggregation group, the pre-calculation dimensions are combined more effectively, so that redundancy calculation and data storage are reduced; and higher calculation efficiency and smaller storage occupation are achieved, so that a better effect is achieved in big data multidimensional analysis application.

Description

technical field [0001] The invention relates to the technical field of OLAP multidimensional data analysis, in particular to an OLAP pre-calculation model, an automatic modeling method and an automatic modeling system. Background technique [0002] In the era of informatization and dataization, how to conduct multi-dimensional analysis of data for decision support is an important topic in the field of business intelligence and data mining. OLAP (especially MOLAP) was created to solve this problem. [0003] In general, data warehouses have a large amount of data, and directly performing multi-dimensional aggregation operations on a large amount of data requires a large amount of computing resources and long query time. OLAP provides a solution based on pre-calculation to improve the efficiency of multi-dimensional analysis, that is, by implementing a "data cube" to pre-aggregate the data in the data warehouse according to different dimensional combinations, and save the resul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/283G06F16/2457G06F16/2462G06F16/24539G06F16/2393
Inventor 李栋
Owner SHANGHAI KYLIGENCE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap