Multi-source data integration method and system based on big data technology

A technology of multi-source data and integration method, applied in the field of big data, which can solve the problems of user inconvenience and low efficiency

Active Publication Date: 2021-06-29
DONGGUAN MENGDA INDAL INVESTMENT +1
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Therefore, when users need to query relevant data, they usually need to query different data separately and i

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-source data integration method and system based on big data technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to facilitate the understanding of those skilled in the art, the present invention will be further described below in conjunction with the embodiments and accompanying drawings, and the contents mentioned in the embodiments are not intended to limit the present invention.

[0031] The embodiment of the present invention provides a multi-source data integration system based on big data technology, such as figure 1 As shown, the system includes a business end processing device 1 , an interface processing device 2 , a big data cluster device 3 , a task monitoring device 4 and an external data source 5 .

[0032] Specifically, the service end processing device 1 can be a plurality of service ends, as a data interface of a specific service, the user initiates a data query request through the service end, and can simultaneously bring one or more parameters when initiating the request; at the same time, the service end processing device 1 It is also possible to genera...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of big data, and particularly discloses a multi-source data integration method and system based on the big data technology, and the method comprises the steps that a user initiates a data query request through a service end processing device; the interface processing device receives and analyzes the data query request, judges a corresponding data acquisition channel, acquires corresponding data through the corresponding channel and sends the data to the big data cluster device; a data association relationship is established and stored; the big data cluster device executes the data stream in real time, forms and stores a corresponding data result, and performs data association; and the task monitoring device monitors a data state in real time, and triggers and executes a corresponding processing mechanism according to a preset triggering condition and a processing mechanism thereof. According to the invention, a plurality of service ends can be effectively combined with the big data system, and a plurality of third-party data interfaces are integrated at the same time, so that an effective system for the user service ends to query data is formed.

Description

technical field [0001] The invention relates to the field of big data technology, in particular to a multi-source data integration method and system based on big data technology. Background technique [0002] At present, in many fields, big data technology needs to be used, and various data need to be used to provide information reference for relevant decision-making. At the same time, in today's social field, services are becoming more and more detailed and specialized, and correspondingly, corresponding professional data are also formed. [0003] Therefore, when users need to inquire about relevant data, they usually need to inquire about different data through multiple channels and integrate them. Such operations will undoubtedly cause inconvenience to users and be inefficient. Contents of the invention [0004] In order to solve the problems existing in the prior art, the purpose of the present invention is to provide a multi-source data integration method and system ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F16/22G06F16/2453G06F16/2455G06F16/2458
CPCG06F16/25G06F16/22G06F16/24539G06F16/24568G06F16/254G06F16/2465G06F2216/03Y02D10/00
Inventor 章志容李实彭添才
Owner DONGGUAN MENGDA INDAL INVESTMENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap