Cloud computing system-based data acquisition system

A technology of data collection and cloud computing, applied in the field of intelligent collection, can solve the problems that the collection system cannot adapt and the flexibility of ETL tools is low

Inactive Publication Date: 2013-05-15
HUAZHONG UNIV OF SCI & TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First, the change of the front-end system, especially the change of the front-end database system due to reasons such as business or upgrade, makes the acquisition system unable to adapt to this change
Second, the flexibility of ETL tools designed by many data acquisition systems is low, especially it cannot form a good feedback on the system situation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cloud computing system-based data acquisition system
  • Cloud computing system-based data acquisition system
  • Cloud computing system-based data acquisition system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Relevant technical content and detailed description of the present invention, now in conjunction with accompanying drawing, explain as follows:

[0044] see figure 1 , an intelligent data acquisition system based on a cloud computing system, deployed in a cloud computing system, characterized in that: the system includes a master node subsystem and a slave node system respectively deployed on a master node and a slave node of the cloud computing system, wherein , the master node subsystem includes:

[0045] Connection intelligence library module: mainly used for front-end connection, including: providing pre-connection SQL statements, generating pre-connection task-based parameters, and generating front-end connection task-based parameters;

[0046] Processing intelligent library module: used to select the data processing method, define a unified data format, determine the screening strategy of data content, generate data processing task parameters; generate data proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cloud computing system-based data acquisition system and a data acquisition method thereof. The system comprises a host node subsystem and a slave node subsystem which are arranged on a host node and a slave node of a cloud computing system respectively, wherein the host node subsystem comprises a connecting intelligent library module, a processing intelligent library module, a storage intelligent library module, an intelligent analyzing and decision-making module and a cloud computing auxiliary management host node module; and the slave node subsystem comprises a foreground connecting module, a data processing module, a background storing module and a cloud computing auxiliary management secondary module. The system is characterized by adopting an intelligently analyzed decision to provide efficient information to a task decision of a user, processing mass data by taking advantage of super-large scale of the cloud computing system at the same time and solvingthe problem of influence of continuous increase in the data on the performances of the system.

Description

technical field [0001] The invention relates to a data acquisition system of a computer network, in particular to the intelligent acquisition of a database with massive data. Background technique [0002] Cloud computing (cloud computing), a kind of distributed computing technology, its most basic concept is to automatically split a huge computing processing program into countless smaller subroutines through the network, and then hand them over to multiple servers. The huge system formed will return the processing results to the user after searching, calculating and analyzing. Through this technology, network service providers can process tens of millions or even billions of information in a few seconds, and achieve network services with the same powerful performance as "supercomputers". [0003] A computer cluster based on cloud computing technology is called "cloud". Cloud computing has the following characteristics [0004] point: [0005] (1) Very large scale. "Cl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 王芙蓉伍海浪
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products