ELK-based big data alarm method, device and equipment, and storage medium

Abstract

The embodiment of the invention discloses an ELK-based big data alarm method, device and equipment and a storage medium, and relates to the technical field of big data processing. The ELK-based big data alarm method comprises the steps of collecting original result data of a service; performing cleaning processing on the original result data to obtain valid data; executing multi-dimensional data extraction on the effective data; acquiring the proportion of each data feature in the overall data, and allocating feature weights; and generating characteristic values of the multiple types of alarmcharacteristics, and generating an alarm message for pushing. In the method, multi-dimensional data extraction is performed on effective data acquired from original data; the method can achieve the deep analysis of finer granularity, thereby better discovering the abnormality in the business logic or function points, the alarm strategy is adjusted through combining two parameters, i.e., the feature weight and the feature value, affecting the alarm strategy, the dynamic adjustment of the alarm strategy is realized, and the false alarm and disturbance of an alarm is avoided.

Description

technical field [0001] The embodiments of the present application relate to the technical field of big data processing, in particular, an ELK-based big data alarm method, device, equipment, and storage medium. Background technique [0002] Logs are an extremely important part of a computer system. Logs mainly include system logs, business logs, and security logs. System operation and maintenance and developers can use logs to understand server software and hardware information, check log information, and analyze the cause of errors, etc. However, because most of the current computer systems are relatively complex, many systems are not located in one place, and even cross-border. Moreover, with the increasing complexity of computer systems and the advent of the era of big data, it is more and more likely to involve dozens or even hundreds of servers, all of which are constantly generating various log data. Faced with such a large amount of log data, which is distributed in...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the embodiment of the present application is to provide an ELK-based big data alarm method, device, equipment and storage medium, which can go deep into finer-grained analysis based on the centralized log system, and can dynamically adjust the alarm strategy. Solve the defect that the alarm strategy is too single

Images