A log parsing template and a log parsing method based on the template

A technology for parsing templates and logs. It is applied in the field of network log parsing. It can solve problems such as high maintenance costs, huge workload, and complex coding, and achieve the effects of reducing operation and maintenance costs, reducing workload, and improving work efficiency.

Active Publication Date: 2019-02-05
XIAMEN FUYUN INFORMATION TECH CO LTD
View PDF2 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] (1) When the system adds a new device type or a new format protocol for log source information, it needs to be re-encoded, and the maintenance cost is high
[0005] (2) When there are many types of equipment in the system and many log source format protocols, the coding workload is huge
[0006] (3) After the project goes online, new equipment is added. If the operation and maintenance personnel do not understand coding, developers need to participate, and the cost is relatively high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log parsing template and a log parsing method based on the template
  • A log parsing template and a log parsing method based on the template
  • A log parsing template and a log parsing method based on the template

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] refer to Figure 1~3 As shown, Embodiment 1 of the present invention provides a log parsing template for device log standardization.

[0047] A log will be generated during the use of each device, and the manufacturer of the device will provide a parameter correspondence table corresponding to the log.

example 1

[0048] Example 1: The log information is:

[0049] 192.168.179.1--[02 / Jul / 2018:18:24:17+0800]"GET / static / image / common / forum.gif HTTP / 1.1"304 0"http: / / 192.168.179.142 / forum.php ""Mozilla / 5.0(Windows NT 6.1;Win64;x64;rv:60.0)Gecko / 20100101Firefox / 60.0"

[0050] The parameter correspondence table of example 1 is as follows figure 2 shown.

example 2

[0051] Example 2: devid=0date="2017 / 09 / 12 12:02:47" dname=bangong logtype=9pri=5mod=logserver act=set ip=10.0.5.56port=514protocol=udp result=0fwlog=0

[0052] The log of each device corresponds to a parameter correspondence table, the parameter correspondence table includes the name of the parameter, the meaning of the parameter and the content of the parameter, and the log includes one or both of the name of the parameter and the content of the parameter , as in the above example 1, the log only includes the content of the parameter, and in example 2, the log includes the name of the parameter and the content of the parameter.

[0053]Since each log includes the IP address of the device, such as "192.168.179.1" in Example 1 and "10.0.5.56" in Example 2, the log of the device can be identified through the IP address in the log, so , the log parsing template corresponds to the IP address of the device, that is, corresponds to the device, and the log parsing template is used to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a log analysis template and a log analysis method based on the template. The log analysis template and an IP address of a device correspond to each other. The log analysis template is used for analyzing logs of different devices into standardized log information with the same format. The log parsing template comprises a pre-parsing template and a main body parsing template. The pre-resolution template is one of an empty template and a version resolution sub-template; The version analysis sub-template is as follows: extracting the character of the version correspondingto the log in the log, and selecting the main body analysis template corresponding to the character through the extracted character; The main body parsing template is composed of one or more parsing sub-templates, and the log is parsed into standardized log information with the same format by using the corresponding parsing sub-templates in a specific order. The invention can reduce the code workload, improve the work efficiency and reduce the operation and maintenance cost in the later period.

Description

technical field [0001] The invention relates to the technical field of network log analysis, in particular to a log analysis template and a log analysis method based on the template. Background technique [0002] With the development of technology, the display of information in the monitoring industry tends to display report information. Therefore, certain escape coding is required for log source information to form a specific data format for use by the log report display layer. Because the current system is relatively complex and huge, and a system contains many types of devices, the data format of the log source information is also varied. The traditional approach is to write a set of corresponding parsing codes for each type of device to convert the log source information into a data format that can be used by the presentation layer. When the system is small or there are few types of equipment, this method can quickly realize the conversion of log source information to s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18
Inventor 陈晓建陈奋陈荣有李伟彬
Owner XIAMEN FUYUN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap