Cluster monitoring data collection method

Abstract

The present invention discloses a cluster monitoring data collection method. The method comprises that: a service module pushes cluster monitoring data to a monitoring module, the monitoring data is stored in the monitoring module in the form of a data structure KVData based on the key value pair; the cluster node Redis is initialized, the cluster monitoring data is ground stored by using the hash table, and the index of non-zero data is stored by using the set; based on two kinds of storage methods of the hash table and the set of the Redit, a statistical module uses the unified monitoring data statistical method to collect statistics of cluster monitoring data in a single statistical period; and non-zero data in the KVData is collected in the frequency of n minutes, and the monitoring data is reported to the data center. The method disclosed by the present invention has the advantages that the collection manner is unified, data reporting is carried out after statistic collection of data, the cluster monitoring data center requires a small storage space, expansion of monitoring items is facilitated, the cluster monitoring data collection and reporting efficiency is high, and the degree of coupling between the collection module and the service module is low.

Description

technical field [0001] The invention relates to the technical field of IT cluster monitoring, in particular to a cluster monitoring data collection method. Background technique [0002] With the rapid development of Internet technology, people's lifestyles are constantly changing, becoming more and more closely connected with the Internet, and people enjoy the convenience brought by Internet services all the time. The daily use of Internet services makes its service quality and stability more important. In order to provide stable services that support high concurrency, Internet service providers usually use distributed cluster deployment services, and cluster monitoring services are an important guarantee for improving the stability of Internet service clusters. However, it is impossible for any cluster service to be 100% reliable. Cluster monitoring can help development and maintenance personnel quickly locate, troubleshoot, and restore services. The carrier of the cluste...

AI Technical Summary

Problems solved by technology

[0003] In the existing cluster services, generally the number of nodes is large, there are many monitoring items, and different modules have different data collection formats, and the cost of data management and analysis is high

And each node usually reports data according to a fixed frequency, the amount of data collected by the monitoring system is huge, and it is likely to become a bottleneck of the cluster monitoring service

Images