Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data aggregation method and system

A data aggregation and database technology, applied in the field of data integration, can solve the problems of isomorphism of heterogeneous data, does not involve data cleaning, error correction, elimination of redundancy, etc., to achieve the effect of broadening the scope, reducing the difficulty of aggregation, and improving the efficiency of aggregation

Active Publication Date: 2021-10-22
山东耕元数据科技有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] The present invention does not involve data cleaning, error correction, redundancy elimination, etc. contained in the existing aggregation method, and the method and system provided are only used to solve the problem of isomorphism of heterogeneous data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data aggregation method and system
  • Data aggregation method and system
  • Data aggregation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] This embodiment provides a data convergence method;

[0055] like figure 2 As shown, a data aggregation method includes:

[0056] S101: Definition phase: Get the source database structure, generate the target database structure, define data views that express the nature of similar objective things and define the mapping rules for the source database to the target database;

[0057] S102: Dump phase: Data from the source database data sheet is the data interface of the source database; use the data interface encapsulated to the target database mapping rule, store the extracted data to the target database after the predefined data view is organized, store it to the target database. .

[0058] Further, in the S101, the source database structure is obtained; specific:

[0059] Get the source database to converge the data table itself nature of the data (e.g., table name, domain it belongs, belongs to the user, etc.) and the nature of the data to be aggregated data field in a tabl...

Embodiment 2

[0149] This embodiment provides a data convergence system,

[0150] like Figure 16 As shown, a data convergence system, including:

[0151] P101: Deploying phase: Relying on the network deployment web application server, message server, target database server, and data aggregation terminal;

[0152] P102: Configuration Stage: Configure aggregation parameters in the web application server;

[0153] P103 Convergence Stage: Start the server, receive source database data, and dump to the target database.

[0154] Further, such as Figure 17 As shown in the P101, the network deployment web application server, the message server, the target database server, and the data aggregation end; specific:

[0155] F1011: Web Application Server: Used to control the aggregation process. Composed of metadata, message server control components, aggregation object acquisition components, target library structural maintenance components, semantic dictionary maintenance components, view maintenance comp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data aggregation method and system. A target database is constructed based on a stable data model irrelevant to a demand and a source database; a stable mapping rule is constructed on the basis that data between source database tables and data in a target database can express the characteristics of the same objective things through the same structure; based on data, the brand-new convergence method can be realized by adopting a numerical value and semantic separated expression mode. Information sharing is realized, convergence efficiency is improved, and convergence difficulty is reduced. And the productization of the convergence process is realized. In the defining stage, a source database structure is obtained, a target database structure is generated, a data view expressing similar objective matter property structures is defined, and a mapping rule from a source database to a target database is defined; in the dump stage, data of the source database is extracted by taking a data table of the source database as a unit; and the extracted data is organized according to a predefined data view by using a data interface packaged with a mapping rule, and thus storing the organized data into a target database.

Description

Technical field [0001] The present invention relates to the field of data integration, and more particularly to a data aggregation method and system. Background technique [0002] Data aggregation (also known as data integration) is to provide comprehensive data sharing in different sources, format, and feature properties (heterogeneous data) to provide comprehensive data sharing. In terms of popularity, it is to achieve the goal of "information island" and realize the information. [0003] The use of data integration technology is undoubtedly the right way by aggregating the integration of heterogeneous data. However, the results of many years of practice show that the current general convergence method is always "gathering - sharing - exclusive Again - sharing - exclusive ... "The pattern is circulated, only the local, short-term information is one, and the" information island "will still be formed, and the" Island "and information are not allowed. The goal. [0004] The existi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/22G06F16/21
CPCG06F16/254G06F16/22G06F16/212
Inventor 盛楠
Owner 山东耕元数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products