Multi-data-source structure analysis method and system, terminal equipment and storage medium

A technology of structural analysis and multiple data sources, applied in the field of data analysis, can solve problems such as large system resource consumption and low efficiency of data analysis methods, and achieve the effects of increasing development speed, improving overall efficiency, and saving system resources

Pending Publication Date: 2021-03-30
安徽航天信息有限公司
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The problem solved by the invention is that the existing data analysis method has low efficiency and consumes a lot of system resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-data-source structure analysis method and system, terminal equipment and storage medium
  • Multi-data-source structure analysis method and system, terminal equipment and storage medium
  • Multi-data-source structure analysis method and system, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to make the above objects, features and advantages of the present invention more comprehensible, specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0042] The terms "comprising" and any variations thereof in the description and claims of the present invention and the above drawings are intended to cover non-exclusive inclusion. For example, a process, method or system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or optionally further includes Other steps or units inherent in these processes, methods, products or apparatus.

[0043] Terms such as "first", "second" and "third" described in this specification are only used to distinguish devices / components / subcomponents / components, etc., and cannot be understood as indicating or implying relative importance or implicitly indic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-data-source structure analysis method and system, terminal equipment and a storage medium, and relates to the technical field of data analysis. The method comprises thesteps of obtaining a target SQL statement, and analyzing the target SQL statement to construct an abstract syntax tree; traversing the abstract syntax tree to construct a first query plan, and replacing a corresponding original two-dimensional table in the first query plan with a preset configuration parameter table to obtain a second query plan; executing the second query plan to query the targetdata from each data source storing the target data, and converting the queried target data in a data warehouse to generate target data in a unified format; and summarizing and analyzing the target data in the unified format. Through the method, unified query analysis of the data source structure is realized, and the development speed of data analysis application is increased; in addition, according to the method, the process of constructing a data aggregation program is omitted, and system resources are saved.

Description

technical field [0001] The present invention relates to the technical field of data analysis, in particular to a multi-data source structure analysis method, system, terminal equipment and storage medium. Background technique [0002] Existing relational data analysis tools such as Oracle, MySQL and other databases and Hadoop-based big data analysis frameworks can only process the data stored in the system, and the data of the business system needs to be extracted, cleaned and transformed before being loaded into the data warehouse , that is, the ETL (Extract-Transform-Load, extract-transform-load) process, and then aggregate data analysis, but when data is extracted from multiple data sources and the amount of data is large, there are often too many ETL tasks that are difficult to maintain, and Frequent access of ETL tasks leads to a large consumption of system resources. Therefore, the existing data analysis method will cause a large consumption of system resources, and w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/242G06F16/25
CPCG06F16/2246G06F16/2433G06F16/254
Inventor 王刚
Owner 安徽航天信息有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap