Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A BI system multi-source database cross-source cross-database fusion system and a fusion method

A fusion method and data fusion technology, applied in the field of database fusion, can solve problems such as inability of business personnel to get started, long processing time, and inability to process large data

Inactive Publication Date: 2019-02-15
CHENGDU SEFON SOFTWARE CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The relevant data source fusion methods in the prior art cannot adapt to the processing of large amounts of data. The realization of cross-source and cross-database data fusion query on the BI system has complex operations, inability to handle large data, long processing time, and general business personnel cannot get started. Shortcomings

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A BI system multi-source database cross-source cross-database fusion system and a fusion method
  • A BI system multi-source database cross-source cross-database fusion system and a fusion method
  • A BI system multi-source database cross-source cross-database fusion system and a fusion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Refer to attached Figure 1-3 , the embodiments of the present invention will be described in detail.

[0039] A BI system multi-source database cross-source cross-database integration system, including external business databases, data processing engines and data storage modules; data storage modules include traditional relational databases and big data databases, external business databases are respectively connected to traditional Relational databases and big data databases.

[0040] Customer data is usually scattered in different business systems, and the data processing engine can quickly access multi-source data and support the access of various data sources, such as: MySQL, SQLServer, Oracle.

[0041] Further, the above-mentioned traditional relational databases include MySQL data warehouse and PG data warehouse, and big data databases include Hive database.

[0042] Further, the above-mentioned data processing engine includes DataSet, ETL, Cube and OLAP.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a BI system multi-source database cross-source cross-database fusion system and a fusion method. The system comprises an external service database, a data processing engine anda data storage module. The data storage module includes a traditional relational database and a big data database. The external business database connects the traditional relational database and thebig data database through the data processing engine. The data processing engine reads the external data stored in the external business database, then encapsulates the external data into the fusion data set through the data fusion component, and finally inserts the fusion data set into the data storage module through the extraction component. The system of the invention realizes the fast cross-source and cross-database data fusion on a BI system, does not need to use a third-party ETL tool and does not need to write a complex script language, supports large data warehousing based on Hadoop, and adopts a bottom-level distributed computing framework to realize the data processing and fusion of the data of TB and PB-levels.

Description

technical field [0001] The invention belongs to the technical field of database fusion, and in particular relates to a cross-source and cross-database fusion system and fusion method for multi-source databases of a BI system. Background technique [0002] The business intelligence system (BI system) emerged in the 1990s and has been widely used in various industries after nearly 30 years of development. In recent years, the advent of the era of big data has brought great challenges to the BI field. Traditional BI systems can only conduct analysis and report development based on a single data source. If you need to query heterogeneous data sources, you usually need to rely on the underlying ETL tools. Data fusion, and adopting this method will lead to complex BI analysis process, long cycle, and cannot quickly provide data support for the business. [0003] In the current era of big data, users are usually faced with a large amount of data stored in different forms and depen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25
Inventor 李晓刚赖文文王建洪
Owner CHENGDU SEFON SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com