Log analysis method and device, computer equipment and storage medium

Abstract

The invention discloses a log analysis method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining an input data set which is data with a unified data structure after the standardization of the obtained original log data; inputting the input data set into a preset exception analysis model to generate exception data, the exception analysis model being arecurrent neural network model which is trained to a convergence state in advance and is used for extracting the exception data in the log data; and performing association processing on the abnormaldata based on a preset abnormal historical database. According to the method, the original log data from different servers can be quickly acquired; the log data is subjected to standardization processing to have the same data structure, and then the log data is subjected to anomaly identification by adopting the recurrent neural network model, so that even if the data volume is huge, the log datacan be rapidly identified, and the abnormal data is subjected to correlation processing to accelerate the abnormal data processing speed and improve the abnormal data processing accuracy.

Description

technical field [0001] The present invention relates to the field of computer application technology, in particular, the present invention relates to a log analysis method, device, computer equipment and storage medium. Background technique [0002] The log reflects the basic information and operation status of the user's machine equipment. At present, the commonly used processing method is to log in to each server after a fault occurs, and use Linux script tools such as grep, sed, and awk to check the cause of the fault in the log. The investigation takes a long time, and the root cause of the fault may not be found in time. [0003] The inventors found that with the development of cloud computing and big data technology, the research and application of big data has brought huge commercial value and social value. By analyzing the logs, it is possible to discover user activities and habits, application systems and product operating conditions. However, due to the fact that...

AI Technical Summary

Problems solved by technology

However, due to the fact that user machines and equipment use hardware and software from different manufacturers to generate different log formats and log forms, the number is huge, and there is a lot of redundant information. At present, there is still a lack of correlation analysis and in-depth utilization of log data.

Images