Method and system for data acquisition and scheduling

Abstract

The invention discloses a method and system for data collection and scheduling. Wherein the method comprises reading the acquisition index configuration information of each target server, and constructing a data form containing the configuration information and the acquisition index waiting scheduling time determined according to the configuration information; setting the acquisition time interval of the regular acquisition scheduler as the data acquisition time slice value, and start the regular collection scheduler; when the scheduled time point of the regular collection scheduler arrives, the value of the collection scheduling time of each collection index in the data form is reduced by the value of the data collection time slice; the value of the waiting scheduling time The collection indicators less than or equal to 0 are added to the task queue, and at the same time, the value of the waiting time for scheduling is reset to the value of the collection period of the collection indicators, and then waiting for the arrival of the next scheduling time point. The invention can ensure the reliability of collection index collection scheduling of the target server in a large-scale environment, and realize diversified collection of the collection index of the target server.

Description

technical field [0001] The invention relates to the field of computer information technology, in particular to a method and system for data collection and scheduling. Background technique [0002] With the increasingly wide application of the network, the data flow of the server system increases rapidly, which greatly challenges the data processing capability of the traditional type of server system. Cooperative work, and cluster technology has extremely high reliability and powerful and flexible system expansion capabilities, but in order to give full play to the collaborative work between servers, it is necessary to collect data on various indicators of each server, so as to flexibly schedule each server working. [0003] In a large data center, the number of physical servers is huge. If the physical servers are virtualized, the number of servers will be even larger. Faced with such a huge server cluster, and the indicators to be collected by each server are different, an...

AI Technical Summary

Problems solved by technology

The general method of collecting indicators for each target server is likely to cause too much pressure on the scheduling server, resulting in the inability to complete the collection tasks of each scheduling indicator in a timely and accurate manner; or there is a requirement that the indicators collected by each target server must be consistent and the collection cycle of all indicators must be consistent, etc. constraint

Images