Unlock instant, AI-driven research and patent intelligence for your innovation.

Log data processing method and device and storage medium

A processing method and log technology, which is applied to electrical components, transmission systems, etc., can solve the problem of low log data processing efficiency, and achieve the effects of improving scalability and maintainability, improving efficiency, and facilitating management

Active Publication Date: 2020-10-02
北京安帝科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is that as the data types of logs continue to increase, the efficiency of log data processing is not high. Aiming at the defects in the prior art, a log data processing method, processing device and storage medium are provided

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data processing method and device and storage medium
  • Log data processing method and device and storage medium
  • Log data processing method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0059] Such as figure 1 As shown, the embodiment of the present invention provides a log data processing method, the method may include the following steps:

[0060] Step 101: Obtain and load at least one first configuration file and at least one second configuration file; wherein, the first configuration file carries at least one merging ru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a log data processing method and device and a storage medium. The method comprises the steps: acquiring and loading a first configuration file and a second configuration file;collecting first log data to be processed; determining whether a regular expression can analyze the first log data or not; if the regular expression can analyze the first log data, analyzing the first log data and generating second log data; formatting the second log data according to a formatting rule, and generating third log data; determining a target merging rule in the merging rules according to the third log data; merging the third log data according to a target merging rule; determining whether a log event carrying the first log data appears for the first time or not, and if so, reporting the third log data; and if not, circularly executing log data collection until preset time is reached, and performing merging and reporting. According to the scheme, the log data processing efficiency can be improved.

Description

technical field [0001] The present invention relates to the technical field of data analysis and processing, in particular to a log data processing method, processing device and storage medium. Background technique [0002] The log data processing system is used to collect, analyze, merge and store security event information from the entire LAN. The log data processing system needs to collect logs of various data types such as various security protection devices, network devices, hosts, and application systems. However, the log formats and data types of each device manufacturer are different. [0003] Currently, log data processing systems mainly use analysis programs to analyze logs of various data types. However, with the increasing number of network products, the types of log data continue to increase, requiring adaptive modification of the program code in the analysis program, which is not conducive to improving the efficiency of log data processing. [0004] Therefore...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/1425H04L67/1097H04L67/30
Inventor 饶志波赵时晴周磊姜双林
Owner 北京安帝科技有限公司