Log data analysis method and device, computer equipment and storage medium

A data analysis and log technology, applied in the field of data processing, can solve problems such as inability to process fields

Active Publication Date: 2019-04-05
PING AN TECH (SHENZHEN) CO LTD
View PDF7 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, it is necessary to provide a log data analysis method, device, computer equipment and s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log data analysis method and device, computer equipment and storage medium
  • Log data analysis method and device, computer equipment and storage medium
  • Log data analysis method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0041] Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the description of the present invention refers to the presence of said features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and / or groups thereof.

[0042] figure 1 It is a flow chart of the log data parsing method in one emb...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing, in particular to a log data analysis method and device, computer equipment and a storage medium. The method comprises the following steps: collecting a plurality of log files, calling a preset log matching table, obtaining an extractor name, calling a field extractor corresponding to the extractor name, and analyzing fields in the log files through the field extractor to obtain a plurality of pieces of effective field information; And converting the effective field information through a field converter to obtain corresponding data information, and storing the data information after the data information is added into a log file. collecting log files in each subsystem; By calling the log configuration table, different extractors are adopted to extract information in the log file to obtain effective field information, data in the original log file are enriched through further processing of re-conversion of the analyzed effective field information, and valuable log data are provided for subsequent analysis of the log file.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a log data analysis method, device, computer equipment and storage medium. Background technique [0002] Now the operating system kernel, network mobile devices, application servers, etc. will generate a large amount of log data in various formats. It is easy to carry out structured processing for the log types of json and fixed delimiters, but the current log processing platform can only Regular parsing is performed on the entire log, and further processing and conversion cannot be performed on the parsed multiple fields. [0003] If the occurrence of log events depends on external data source information, such log events will appear to be somewhat stretched when analyzing the cause. If you want to classify logs by the entries of the subsystems, since the original logs generally only contain the user names that can be distinguished to log in to the server, altho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/34G06F16/18G06F16/178
CPCG06F11/3476
Inventor 曹越
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap