Log analysis method and device

A parsing method and log technology, applied in the network field, can solve the problems of unreusable log parsing methods, high development and maintenance costs, and achieve the effects of reducing development and maintenance costs, easy expansion, and easy business.

Inactive Publication Date: 2016-10-12
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF4 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention discloses a log parsing method and device to solve the problems that the existing various types of log parsing methods cannot be reused and the development and maintenance costs are high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log analysis method and device
  • Log analysis method and device
  • Log analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0041] In order to uniformly analyze different types of logs, reduce development and maintenance costs, and facilitate service expansion, embodiments of the present invention provide a log analysis method and device.

[0042] The first log parsing method provided by the embodiment of the present invention is firstly introduced below.

[0043] Such as figure 1 As shown, a log parsing method may include:

[0044] S101, obtaining original log data;

[0045] It shou...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a log analysis method and device. The log analysis method includes the steps that original log data is acquired; a target field is captured from the original log data according to a pre-configured regular expression, wherein the regular expression includes the name of the target field; the target field is combined with the name of the target field, and structured data in a key-value pair form is obtained. By adopting the log analysis method and device, logs of different types can be analyzed in a unified mode, the analysis process is simple and efficient, and it is not needed to develop various log analysis methods, so that the development and maintenance cost is greatly lowered, and service development is promoted.

Description

technical field [0001] The invention relates to the field of network technology, in particular to a log parsing method and device. Background technique [0002] At present, Internet companies have a wide variety of businesses, and different business programs use different programming languages ​​and code frameworks, which will generate different types of logs at runtime. Among them, in the business of Internet companies, common log types include Nginx logs, Log4j logs, Glog logs, and PHP logs. [0003] In order to be analyzed by the subsequent big data system, log parsing is required, that is, unstructured data in the log is converted into structured data. Among them, the unstructured data is the original log, which contains some key information, such as IP address, time, request url, request parameters, return value, response time, etc. These are the keys that may need to be extracted information. After the key information is extracted, it is transformed into structured ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/116G06F16/1815
Inventor 叶炜晨
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap