Log analyzing method and log analyzing device

An analysis method and log technology, applied in the field of data processing, can solve problems such as complex analysis process, unclear logical relationship, and failure to reflect log relationship, etc., to achieve the effect of solving complex process, simplifying the analysis process, and weakening heterogeneity

Inactive Publication Date: 2017-06-09
CHINA RAILWAY TRIP SCI & TECH +1
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In a distributed system, there is a logical relationship between several logs generated by each application itself, but the logical relationship between several logs generated by multiple applications is not obvious. For several logs generated by multiple applications, use the existing The separate and independent parsing methods often used in technology cannot reflect the relationship between several logs, and the parsing process is complicated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log analyzing method and log analyzing device
  • Log analyzing method and log analyzing device
  • Log analyzing method and log analyzing device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] figure 1 It is a flow chart of Embodiment 1 of the log parsing method provided by the embodiment of the present invention, figure 2 The overall flow chart of Embodiment 1 of the log parsing method provided by the embodiment of the present invention, as shown in figure 1 and figure 2 As shown, the log parsing method provided by the embodiment of the present invention may specifically include the following steps:

[0041] 101. Collect pending logs from various heterogeneous data sources.

[0042] Most distributed systems have a multi-level network structure, and each level of the network has at least one application, and each application generates corresponding data, which exists in the application in the form of logs. For example, a railway ticketing system may include a webpage ticketing platform, applications installed on terminals, and a background database. The corresponding webpage ticketing platform generates webpage ticketing platform logs. The database gene...

Embodiment 2

[0068] image 3 A schematic structural diagram of Embodiment 1 of the log parsing device provided by the embodiment of the present invention, as shown in image 3 As shown, the log analysis device in this embodiment may include: a collection module 11 , a conversion module 12 , an analysis module 13 and an output module 14 .

[0069] The collection module 11 is configured to collect logs to be processed from various heterogeneous data sources.

[0070] The conversion module 12 converts the logs to be processed in each heterogeneous data source into standard logs according to the log template corresponding to each heterogeneous data source.

[0071] The parsing module 13 is configured to input all standard logs converted by the conversion module 12 into corresponding workflows for scheduling and parsing.

[0072] The output module 14 is configured to output the result analyzed by the analysis module 13 .

[0073] In a specific implementation process, the conversion module 12...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a log analyzing method and a log analyzing device. The log analyzing method provided by the embodiment of the invention comprises the following steps: collecting to-be-treated logs from heterogeneous data sources; converting the collected to-be-treated logs into standard logs meeting the requirement of a log template according to the log template; inputting the converted standard logs to a corresponding workflow, dispatching and analyzing; and outputting an analysis result. The technical scheme provided by the invention is beneficial to uniform analysis, dispatching and management for the logs; meanwhile, the logs are analyzed by adopting a uniform format; the analyzing process is simplified; the heterogeneity of the logs from different log sources is weakened.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a log parsing method and device. Background technique [0002] In a distributed system, different applications generate logs in a variety of ways. These logs have prominent heterogeneity, strong independence, large amount of data, and relatively scattered distribution. For example, some logs are generated regularly according to time, some logs are generated quantitatively according to size, and some logs are intercepted irregularly. [0003] In a distributed system, there is a logical relationship between several logs generated by each application itself, but the logical relationship between several logs generated by multiple applications is not obvious. For several logs generated by multiple applications, use the existing The separate and independent parsing methods often used in technology cannot reflect the relationship between several logs, and the parsing process is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 阎志远朱建生单杏花王富章李贝贝吴刚戴琳琳朱建军苗凡祝红光贾成强江琳汪健雄王洪业王芳
Owner CHINA RAILWAY TRIP SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap