Multi-source heterogeneous data aggregation method and device, storage medium and terminal

A multi-source heterogeneous data and data technology, applied in the field of big data processing, to achieve the effect of improving system compatibility and versatility

Pending Publication Date: 2020-10-16
JINGZAN ADVERTISING SHANGHAI CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The technical problem solved by the present invention is how to reduce the complexity of system access

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-source heterogeneous data aggregation method and device, storage medium and terminal
  • Multi-source heterogeneous data aggregation method and device, storage medium and terminal
  • Multi-source heterogeneous data aggregation method and device, storage medium and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] As mentioned in the background art, there are many defects in the aggregation method of multi-source heterogeneous data in the prior art, resulting in high complexity of data conversion and low synchronization efficiency.

[0023] In order to solve the above technical problems, an embodiment of the present invention provides a multi-source heterogeneous data aggregation method, including: using a preset plug-in to obtain original data from a data source, wherein the preset plug-in corresponds to the data source one by one ; Determine a standard data structure according to the data type of the original data, the standard data structure includes at least one field and the field type of the field; convert the original data according to the standard data structure to obtain processed data; For the plurality of processed data, the plurality of processed data are classified and stored based on the standard data structure, wherein the plurality of processed data are obtained fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-source heterogeneous data aggregation method and device, a storage medium and a terminal, and the method comprises the steps of employing a preset plug-in to obtain original data from a data source, and enabling the preset plug-in to be in one-to-one correspondence with the data source; determining a standard data structure according to the data type of the originaldata, wherein the standard data structure comprises at least one field and the field type of the field; converting the original data according to the standard data structure to obtain processed data;and for a plurality of pieces of processed data, storing the plurality of pieces of processed data in a classified manner by taking the standard data structure as a reference, the plurality of piecesof processed data being obtained from the same or different data sources. Through the scheme provided by the invention, the complexity of system access and data conversion can be reduced, and the efficiency of synchronous processing of the multi-source heterogeneous data is improved.

Description

technical field [0001] The present invention relates to the technical field of big data processing, in particular to a multi-source heterogeneous data aggregation method and device, a storage medium, and a terminal. Background technique [0002] In the era of big data, it is necessary to mine and synchronize massive data. Since these data may come from different data sources, and the data formats, types, and interfaces of different data sources are different, this leads to the incompatibility of system interfaces and the complexity of data conversion when the big data platform synchronizes data from various data sources. High and low synchronization efficiency. Contents of the invention [0003] The technical problem solved by the invention is how to reduce the complexity of system access and data conversion, and improve the efficiency of synchronous processing of multi-source heterogeneous data. [0004] In order to solve the above technical problems, an embodiment of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2455G06F16/22G06F16/28
CPCG06F16/24556G06F16/22G06F16/285
Inventor 唐英荣
Owner JINGZAN ADVERTISING SHANGHAI CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap