Multi-source heterogeneous data unified aggregation method and system

A multi-source heterogeneous data and data technology, applied in the field of multi-source heterogeneous data unified aggregation method and system, can solve the problems of huge amount of multi-source heterogeneous data, low degree of data fusion, unfavorable data use, etc. Classified storage, high degree of fusion, and less invalid data

Pending Publication Date: 2021-04-27
长威信息科技发展股份有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, with the rapid development of Internet of Things technology, the number and types of various terminals and basic acquisition equipment are increasing, and a large amount of data is generated every moment. These data are of various types

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-source heterogeneous data unified aggregation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] Such as figure 1 As shown, a multi-source heterogeneous data unified aggregation system proposed by the present invention, the system includes a client, a cloud server and a storage; the client, the cloud server and the storage are connected through a network; the client is provided with a data acquisition module; The cloud server is equipped with a data processing module and a data fusion module; the data collection module collects multi-source data information through the client, including a text collection unit, a picture collection unit and an audio-visual collection unit; the data processing module is connected with the data collection module, including data classification Unit, data processing unit and data matching unit, the data processing module groups the data in the data acquisition module, eliminates heterogeneity, and extracts the corresponding data feature groups according to the categories, and then compares the data feature groups with the existing data f...

Embodiment 2

[0038] The present invention also provides a unified aggregation method for multi-source heterogeneous data, including the above-mentioned system, and the steps of the method are as follows:

[0039] S1. The user inputs all multi-source heterogeneous data through the client;

[0040] S2. Classify multi-source heterogeneous data, eliminate heterogeneity, extract corresponding data features, and form new data feature groups according to categories;

[0041] S3. Carry out a correlation degree query on the new data feature group and the original data feature group, and find out the original data feature group whose correlation degree reaches the set value;

[0042] S4. Putting the new data characteristic group and the original data characteristic group into a data pool;

[0043] S5. The data decision-making model inspects and adjusts the data in the data pool until the estimated fusion degree is reached, and then performs fusion;

[0044] S6, the fused data is returned to the memo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of multi-source heterogeneous data processing, in particular to a multi-source heterogeneous data unified aggregation method and system, and the system comprises a client, a cloud server and a memory. A data acquisition module is arranged on the client; the cloud server is provided with a data processing module and a data fusion module. The multi-source data information is acquired through the data acquisition module, the data processing module groups and eliminates isomerism of the data, the data pool is manufactured, the data decision model checks the fusion degree of the data in the data pool, meanwhile, the data in the data pool is adjusted until the estimated fusion degree is reached, and then fusion is performed. Unified aggregation of multi-source heterogeneous data is achieved, the aggregation fusion degree is high, invalid data are few, classified storage of a large amount of data is facilitated, and the subsequent query efficiency is effectively improved.

Description

technical field [0001] The invention relates to the field of multi-source heterogeneous data processing, in particular to a method and system for unified aggregation of multi-source heterogeneous data. Background technique [0002] At present, with the rapid development of Internet of Things technology, the number and types of various terminals and basic acquisition equipment are increasing, and a large amount of data is generated every moment. These data are of various types and sources, that is, multi-source heterogeneous data. The amount of source heterogeneous data is huge, and the application of the traditional unified aggregation method results in a low degree of data fusion, which is not conducive to subsequent data use. Contents of the invention [0003] (1) Purpose of the invention [0004] In order to solve the technical problems existing in the background technology, the present invention proposes a unified aggregation method and system for multi-source heterog...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/2458
CPCG06F16/252G06F16/2468G06F16/2465
Inventor 黄炳裕黄河洪章阳戴文艳张涛吴迎晖
Owner 长威信息科技发展股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap