A log parse method and system

A parsing method and log technology, applied in the field of data parsing, can solve problems such as low support, poor readability, and lack of log parsing fields, etc., to achieve the effect of increasing the speed of aggregation, accelerating data speed, and reducing the number of traversals

Inactive Publication Date: 2019-02-15
广东网安科技有限公司
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The existing technology has the following disadvantages: the data is kept in its original state, and the readability is poor, which is not conducive to the user's summary; the lack of available log parsing fields, the support for special device types that need to be viewed and retrieved is low, It is not conducive to administrators to do log audit; the method of log analysis is relatively simple, the structure is not uniform, and the depth of more complex log analysis is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A log parse method and system
  • A log parse method and system
  • A log parse method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention is described in further detail now in conjunction with accompanying drawing. These drawings are all simplified schematic diagrams, only illustrating the basic flow of the present invention in a schematic manner, so they only show the flow related to the present invention.

[0034] Such as figure 1 As shown, the present invention provides a log parsing method, and the method is specifically:

[0035] 101. According to the received log, the log is parsed to obtain the parsed field;

[0036] 102. Store the parsed fields in the database;

[0037] 103. Call the parsed fields in the database for data aggregation;

[0038] 104. Store the aggregated data.

[0039] Step 101, specifically analyze the received log, first perform coarse-grained analysis on the log, and then perform fine-grained analysis. According to the definition of the Syslog protocol RFC 3164 specification, the log message contains "pri", "time", "host Name" and "msg" fields, all log ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a log analysis method and a log analysis system. The log analysis method comprises the following steps: according to the received log, the log is analyzed to obtain the analyzed field; Storing the parsed fields in a database; Calling the parsed fields in the database for data aggregation; storing The aggregated data. The log analysis method of the invention realizes the analysis of most types of logs, has strong data compatibility and fast data aggregation speed. Which improves the efficiency of log parsing.

Description

technical field [0001] The invention relates to the technical field of data analysis, in particular to a log analysis method and system. Background technique [0002] In a complete information system, the log is a very important functional component. It can record all the behaviors generated by the system and express them according to a certain specification. We can use the information recorded by the log system to troubleshoot the system, optimize the performance of the system, or adjust the behavior of the system based on this information. In the field of security, logs play an especially important role and can be said to be one of the most important tools in security auditing. The analysis of the log is to decode a certain expression specification of the log, which is beneficial to our search and viewing. [0003] The existing log parsing technology is: keep the original state of the log, convert it into UTF-8 or GBK encoded text through a general decoding method, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/17
Inventor 许祥宾
Owner 广东网安科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap