Log file processing method and device, computer device and storage medium

A log file and processing method technology, applied in the Internet field, can solve the problems of cumbersome processing, inconsistent format, cumbersome log file processing, etc., and achieve the effect of reducing workload and reducing impact

Active Publication Date: 2019-02-12
PING AN TECH (SHENZHEN) CO LTD
View PDF6 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, various applications in the Internet era will generate log files, but the formats and data types of log files are various. Faced with different types of log files, the processing is more cumbersome due to the inconsistent format.
At the same time, the new system and cross-environment will also have log files with different file formats or data formats. As the data in the log files is processed, such as new information in the log data, new field information needs to be added, and the bottom layer needs to be reset. Opening or reparsing, etc., will lead to more cumbersome log file processing
In addition, due to rapid business changes, it is necessary to continuously modify the data processing logic to meet business needs, which will also cause trouble for log file processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log file processing method and device, computer device and storage medium
  • Log file processing method and device, computer device and storage medium
  • Log file processing method and device, computer device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0028] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0029] It should also be understood that the terminology used in the specificati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the abnormal monitoring field of cloud monitoring, in particular to log monitoring, and discloses a log file processing method and device, a computer device and a storage medium. The method comprises the following steps of obtaining log files generated by an application program and identifying a file format corresponding to the log files; determining a file parsing rule corresponding to the recognized file format; parsing the log file according to the determined file parsing rules to obtain a unified coding specification file, and analyzing the unified coding specification file through preset text parsing rules to obtain log fields; generating a data dimension statistical table according to the log field, and comparing the data dimension statistical table with a historical data dimension statistical table to obtain difference information; generating alarm information according to the difference information, and outputting the alarm information. The method improves the processing speed of log files in different formats and reduces the workload of developers.

Description

technical field [0001] The present application relates to the technical field of the Internet, and in particular to a log file processing method, device, computer equipment and storage medium. Background technique [0002] At present, various applications in the Internet era will generate log files, but the formats and data types of log files are various. Faced with different types of log files, the processing is cumbersome due to the inconsistent format. At the same time, the new system and cross-environment will also have log files with different file formats or data formats. As the data in the log files is processed, for example, when the information in the log data is added, new field information needs to be added, and the bottom layer needs to be reset. Opening or reparsing, etc., will lead to more cumbersome log file processing. In addition, due to rapid business changes, it is necessary to continuously modify the data processing logic to meet business needs, which wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/18
CPCY02D10/00
Inventor 陈健鹏林林
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products