Cloud protection log system and working method thereof

Abstract

The invention discloses a cloud protection log system and a working method thereof, and belongs to the technical field of information security application. The system comprises a log collection module, a log processing module and a log storage module. The method comprises the following steps that: a distributed log collection system Flume collects and aggregates log data on a cloud protection platform, and then caches the log data into a message queue Kafka; Storm responsible for executing the real-time processing task processes log data in the Kafka, the log data is stored in the HDFS after being processed, and the MapReduce responsible for executing the off-line processing task operates algorithms such as data mining and the like on the HDFS; and the data report subjected to real-time processing and off-line processing is stored in the MySQL. Compared with a log system in a traditional local protection system, the log system adopting cloud computing, distribution and other novel architectures has better real-time performance when facing massive log data in the cloud, and the reliability and expansibility of the system are also obviously improved.

Description

technical field [0001] The invention relates to a cloud protection log system and a working method thereof, belonging to the technical field of information security applications. Background technique [0002] In recent years, with the vigorous development of my country's enterprise network technology, the needs of enterprise users are also increasing. While enterprise users are pursuing high-speed and high-quality network services, network security has also received more and more attention, and the development of network security is always accompanied by the innovation of network technology. At present, network attack methods are becoming more and more complex, coupled with the weak awareness of network security precautions among ordinary enterprise employees, this has led to frequent incidents of enterprise internal network intrusion and attacks. Traditional network security solutions are gradually losing their effectiveness and facing the situation of being eliminated. W...

AI Technical Summary

Problems solved by technology

On the basis of the cloud protection system, the above solutions lack the ability to build a fully functional, unified and efficient cloud protection log system. At the same time, its performance is also limited in terms of real-time performance, reliability and scalability, and cannot effectively improve the system. performance

Images