A cloud platform-oriented security monitoring data collection and storage method

Abstract

The invention relates to a method for collecting and storing safety monitoring data facing a cloud platform. The method includes: sequentially initializing remote and local message queues to obtain relevant information of collection plug-ins; the data collection backend runs the collection plug-in according to the loaded plug-in information, Obtain the basic data of the cloud platform; the data acquisition backend sends the collected data to the transmission agent through the message queue; start the transmission agent broker, which is responsible for communicating with the monitoring agent, collecting monitoring data and saving it in the database. Use the timestamps of all documents in TagModel and MetricModel to cache them in memory; query TagModel in the cache to obtain the Tags of monitoring indicators; insert a record into the cache and database at the same time or use Tags and timestamps as query conditions, in the current Monitor the query in the measured value model CurrentModel to update the corresponding document in the database or generate a new document and store it in the database. The invention has comprehensive acquisition and reasonable storage mode, and does not generate repeated storage.

Description

technical field [0001] The invention relates to a cloud platform security monitoring data processing method, in particular to a cloud platform-oriented security monitoring data collection and storage method. Background technique [0002] Cloud computing has attracted great attention from academia and industry due to its advantages of low cost, rapid deployment, and flexible scale. At the same time, security monitoring and analysis for cloud platforms has also become a research hotspot. [0003] However, the granularity of the basic data collected by the existing virtualization platform is too coarse to reflect the security status of the cloud platform in a timely and accurate manner. [0004] Multiple virtualization software coexist in the cloud platform, the sources of basic data are diverse, and there is no unified expression method, so it is not suitable for direct use for display and analysis. [0005] Cloud platform data sources are spread across all levels of the enti...

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the embodiments of the present invention is to summarize the basic data collected from various nodes and services on the existing cloud platform into data sets with multiple levels, large data volumes, and complex data types to perform information processing on such data sets. Extract and analyze very difficult problems, and propose a cloud platform-oriented security monitoring data collection and storage method

Images