OLAP multi-dimensional analysis and data mining system

Abstract

The invention provides an OLAP multi-dimensional analysis and data mining system. The system comprises a data model, a distributed OLAP engine, an OLAP analysis engine, a multi-dimensional report analysis interface, a data mining interface and a data visualization tool; the data model is dragged by a user through a visual interface to finish data modeling, and has unified model configuration; thesystem automatically performs model adaptation and enables the data model to be called by cooperation with internal other engines or tools; the distributed OLAP engine provides a multi-dimensional data model preprocessing capability for the OLAP system; the OLAP analysis engine supports a multi-dimensional query analysis engine of a big data platform and a relational database, and analyzes an MDXstatement to obtain a standard SQL; the multi-dimensional report analysis interface and the data mining interface have multi-dimensional data analysis and data mining functions and provide a report analysis method and a data mining algorithm model; and the data visualization tool provides a visual service for report analysis and data mining in the multi-dimensional report analysis interface and the data mining interface, and provides visual result social sharing and chart management functions.

Description

technical field [0001] The invention relates to a data analysis and mining system, in particular to an OLAP multidimensional analysis and data mining system. Background technique [0002] The data analysis system in the prior art, such as OLAP, which stands for Online Analytical Processing, is a solution for multi-dimensional data analysis and query, which enables analysts to quickly, consistently and interactively observe information from various aspects, in order to To achieve a deep understanding of the data. However, if figure 1 As shown, the existing OLAP multidimensional analysis system is mainly composed of three layers: data layer, application layer and presentation layer. Due to the lack of an interface layer, the system is closed and cannot provide an API interface to the outside world, making it impossible for third-party systems to share data with it. [0003] Data layer: Extract data from commonly used relational databases, such as MySQL, Oracle, SQL Server a...

AI Technical Summary

Problems solved by technology

In data modeling, the open source modeling tool Workbench is generally used, but the overly complicated operation process affects the user experience and reduces the efficiency of use

Due to the limitation of the data layer, when the application layer implements the data query function, it can achieve instant response to small and medium-sized data, but it is difficult to guarantee real-time query for the massive data stored in the database and the data stored in the big data platform sex

Secondly, the OLAP query engine generally uses Mondrian, which uses the MDX language to implement queries, and only supports reading data from relational databases, but it lacks a docking interface for big data platforms and supports limited aggregation functions

In addition, the OLAP query engine does not have the ability of in-depth data analysis and data mining

Images