A distributed data acquisition system and method based on cloud computing

Abstract

The invention relates to a distributed data acquisition system and method based on cloud computing. The system comprises a cloud server, at least one VMS (Virtualization Management Software), at least one Discover node, a Collect node and a cloud computing platform, wherein the cloud server is composed of at least one server, the VMS is used for managing the cloud server, and the Discover node is used for information acquisition. An acquisition program, a scheduler program and a control program are separately and independently arranged, an acquisition strategy, a data acquisition time stamp and an acquisition cycle can be self-defined, a thread pool mechanism is adopted, and multiple-VMS, multiple-object different data can be acquired at the same time. An acquisition task is executed through a thread preemption mode in a thread pool, the data acquisition delay is shortened, the acquisition task block is reduced, and the data acquisition efficiency is increased.

Description

technical field [0001] The invention relates to the technical field of cloud computing, in particular to a distributed data collection system and method based on cloud computing. Background technique [0002] Currently, cloud computing (Cloud Computing) is an Internet-based computing method, in which shared hardware and software resources and information can be provided to computers and other devices on demand. The core idea of ​​cloud computing is to uniformly manage and schedule a large number of computing resources connected by the network to form a unified resource pool to provide users with on-demand services. Cloud Computing is Grid Computing, Distributed Computing, Parallel Computing, Utility Computing, Network Storage Technologies, Virtualization, Load Balance, etc. It is the product of the fusion of traditional computer and network technology development. [0003] In the cloud computing platform, it is necessary to collect and synchronize the information collectio...

AI Technical Summary

Problems solved by technology

In this mode, there is no need to install an agent program in VMS, and multi-thread polling is used to perform collection operations. All the data that needs to be collected will be collected at one time. If there is a queuing phenomenon in data collection, once the first thread executes an error, Congestion will occur, causing all subsequent threads in the queue to fail to run, unable to collect relevant information in VMS in time, and easily cause data redundancy

For the collection of large quantities of information, this method will also cause problems such as too long collection time

Images