The invention provides a massive
log data intelligent operation and
maintenance system. The
system comprises a log collecting module, a log
processing module, a log storage module and a business
application module, wherein the log collecting module is used for collecting application logs, operation
system logs and network equipment logs on a target
machine, structuring
log data and then outputtingthe
log data to the log
processing module; the log
processing module is used for real-
time processing and offline processing, real-
time processing comprises real-time statistics, real-time alarming and real-time analysis, and offline processing comprises data batch storage,
offline analysis and
machine learning; then the processed information is sent to the log storage module; the log storage module is used for storing original log data, index data,
statistical analysis data and resource configuration data, and comprises a MySQL
relation database, a Redis memory
database, an Elastic
search engine and an HBase column storage
database; the business
application module is used for providing functions of inquiry statistics, monitoring and alarming, intelligent reports, instrument panels and knowledge bases through a web interface, and the data is read out from the log storage module.