Cloud platform-oriented security monitoring data collection and storage method

Abstract

The invention relates to a cloud platform-oriented security monitoring data collection and storage method. The method comprises the steps of initializing remote and local message queues in sequences and obtaining collection plug-in related information; operating a collection plug-in by a data collection rear end according to loaded plug-in information and obtaining cloud platform basic data; sending collected data to a transmission broker by the data collection rear end through the message queues; starting the transmission broker, wherein the broker is responsible for communicating with a monitoring broker, collecting monitoring data and storing the monitoring data to a database; prereading time stamps of all documents of a TagModel and a MetricModel and caching the time stamps in a memory; querying the TagModel in a cache and obtaining Tags of monitoring indexes; and inserting a record into the cache and the database at the same time or carrying out query in a current monitoring measurement value model CurrentModel by taking the Tags and time stamps as query conditions, thereby updating corresponding documents in the database or generating a new document and storing the new document to the database. According to the invention, the data is obtained comprehensively, a storage mode is reasonable, and the repeated storage is avoided.

Description

technical field [0001] The invention relates to a cloud platform security monitoring data processing method, in particular to a cloud platform-oriented security monitoring data collection and storage method. Background technique [0002] Cloud computing has attracted great attention from academia and industry due to its advantages of low cost, rapid deployment, and flexible scale. At the same time, security monitoring and analysis for cloud platforms has also become a research hotspot. [0003] However, the granularity of the basic data collected by the existing virtualization platform is too coarse to reflect the security status of the cloud platform in a timely and accurate manner. [0004] Multiple virtualization software coexist in the cloud platform, the sources of basic data are diverse, and there is no unified expression method, so it is not suitable for direct use for display and analysis. [0005] Cloud platform data sources are spread across all levels of the enti...

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the embodiments of the present invention is to summarize the basic data collected from various nodes and services on the existing cloud platform into data sets with multiple levels, large data volumes, and complex data types to perform information processing on such data sets. Extract and analyze very difficult problems, and propose a cloud platform-oriented security monitoring data collection and storage method

Images