Many-to-many data acquisition system and acquisition method thereof

A technology of a data collection system and a collection method, which is applied in the field of many-to-many data collection systems, and can solve the problems of increasing the cost of channels in the system, etc.

Active Publication Date: 2015-04-08
G CLOUD TECH
View PDF7 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] One of the technical problems solved by the present invention is to provide a many-to-many data collection system for the problem of various interaction modes and high channel overhead for each system
[0004] The second technical problem solved by the present invention is to provide a collection method of many-to-many data collection system in view of the problem of various interaction modes and high channel overhead for each system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Many-to-many data acquisition system and acquisition method thereof
  • Many-to-many data acquisition system and acquisition method thereof
  • Many-to-many data acquisition system and acquisition method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The invention provides a many-to-many data acquisition system and a method for solving the problems of various interaction modes and large channel overhead for each system. The unified management of the data provider and the receiver is realized, which greatly reduces the extra overhead caused by the new channels between multiple systems, and ensures the process of collection tasks, the diversity and scalability of interaction between nodes.

[0039] See figure 1 , 2 As shown, the present invention consists of a collection management platform, a collection engine and a data processing server;

[0040] Collection management platform: used to manage data provider and receiver nodes, communication protocols, ETL rules and collection tasks;

[0041] Node: Each provider or receiver, as a sub-node, describes the interaction and status with the platform, and is managed uniformly through the platform;

[0042] Communication protocol: It includes configurable communication me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computer application technologies, in particular to a many-to-many data acquisition system and an acquisition method thereof. The system consists of an acquisition management platform, an acquisition engine and a data processing server, wherein the acquisition management platform is used for managing nodes, communication protocols, ETL (Extract-Transform-Load) rules and acquisition tasks; the acquisition engine supports a plurality of communication ways, and is used for shaking hands with a data provider node through a communication protocol, identifying the legitimacy of a provider, performing data acquisition, and informing the data processing server; the data processing server comprises a data cleaner and a plug-in data processing assembly. By adopting the many-to-many data acquisition system and the acquisition method thereof, a data acquisition flow is standardized, and an assembly interface is standardized; the many-to-many data acquisition system has the characteristics of high expandability, wide application range and the like, and can be applied to various systems of relational databases.

Description

technical field [0001] The invention relates to the technical field of computer applications, in particular to a many-to-many data acquisition system and a collection method thereof. Background technique [0002] With the development of computer application technology, the data association between application systems is getting closer and closer, and a large amount of data and information are interacting all the time. At the same time, with the diversity of development, the data interaction methods of each system are different. When the number of interaction methods increases, both the data provider and the receiver need to add additional channels, or establish their own set of solutions to solve this compatibility problem. . When the original interaction method changes, it is often accompanied by a large number of changes. SUMMARY OF THE INVENTION [0003] One of the technical problems solved by the present invention is to provide a many-to-many data acquisition system ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25
Inventor 郑葵荣艾建文安宏伟季统凯
Owner G CLOUD TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products