Log processing method and device, computer device and storage medium

A processing method and log technology, applied in the network field, can solve the problems of high distortion rate, occupation of large storage resources, incomplete links, etc., and achieve the effect of reducing the amount of storage, solving the large consumption of storage resources, and reducing the distortion rate.

Active Publication Date: 2019-11-26
北京思维造物信息科技股份有限公司
View PDF4 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, the first method requires a large amount of storage resources, and subsequent analysis requires a large amount of computing resources
However, the links collected by the latter three methods are incomplete, and even the logs of some nodes are not collected. What is more serious is that wrong requests are not collected and stored, resulting in a high distortion rate.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log processing method and device, computer device and storage medium
  • Log processing method and device, computer device and storage medium
  • Log processing method and device, computer device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] figure 1 It is a flow chart of a log processing method in Embodiment 1 of the present invention. This embodiment is applicable to the case of collecting and storing log data. The method can be executed by the log processing device provided in the embodiment of the present invention. The device can It is implemented by means of software and / or hardware, and generally can be integrated into computer equipment, such as a server. Such as figure 1 As shown, the method of this embodiment specifically includes:

[0028] S110. Obtain link log data of at least one call chain respectively; wherein, the link log data of the call chain is formed by statistically integrating log data collected in a full collection manner.

[0029] The call chain is used to describe the call path of the service node associated with the process from receiving the request initiated by the client to responding to the client. Exemplarily, the invocation path of a resource is encapsulated into a node, ...

Embodiment 2

[0069] Figure 2a It is a flow chart of a log processing method in Embodiment 2 of the present invention. This embodiment is embodied on the basis of the above embodiments, and the link log data of at least one call chain is respectively obtained, and is embodied as: from Reading the log data in the message queue; according to the link identification information in the multiple pieces of the log data, statistically integrating each of the log data to form link log data of at least one call chain. Such as Figure 2a As shown, the method of this embodiment specifically includes:

[0070] S210, read log data from the message queue.

[0071]Message queues are used to store messages during their transmission. Log data is used as pending data stored in the message queue, waiting to be read and processed.

[0072] In the message queue mechanism, the message producer (Producer): sends a message to the message queue. In this embodiment, the log collector is a message producer.

...

Embodiment 3

[0124] image 3 It is a schematic diagram of a log processing device in Embodiment 3 of the present invention. Embodiment 3 is a corresponding device for implementing the log processing method provided by the above embodiments of the present invention. The device can be implemented in the form of software and / or hardware, and can generally be integrated into computer equipment, such as a server.

[0125] Correspondingly, the device of this embodiment may include:

[0126] The link log data acquisition module 310 is configured to obtain link log data of at least one call chain respectively; wherein, the link log data of the call chain is formed by statistically integrating log data collected in a full collection mode;

[0127] A service node status analysis module 320, configured to analyze the status of service nodes associated with each of the call chains according to the link log data;

[0128] An exception storage module 330, configured to store the call chain generated b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a log processing method and device, a computer device and a storage medium. The method comprises the following steps: respectively acquiring link log data ofat least one calling chain; wherein the link log data of the call chain is formed by counting and integrating log data collected in a full-amount collection mode; according to the link log data, carrying out state analysis on the service nodes associated with the call chains; if the service node has an abnormal state in the working process, storing a call chain generated by the service node in theworking process; and if each service node is in a stable state in the working process, selecting a part of call chains from all call chains generated by each service node in the working process for storage. According to the embodiment of the invention, the log storage amount can be reduced, and the distortion rate of acquired data is reduced.

Description

technical field [0001] The embodiments of the present invention relate to the network field, and in particular to a log processing method, device, computer equipment and storage medium. Background technique [0002] In order to support increasingly complex businesses and growing requests, the industry uses a large number of microservice architectures. In the microservice architecture, distributed systems are usually used to deploy microservices. These microservices may be developed by different teams using different programming languages ​​and deployed on thousands of servers across multiple different data centers, making the entire distributed system increasingly complex. [0003] At present, the distributed link tracking system is used to solve the problems of microservice fault location, capacity assessment, link sorting and performance analysis. Specifically, the distributed link tracking system completes full link tracking by collecting, storing, and analyzing trace d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/18G06F16/182G06F16/172
CPCG06F16/1815G06F16/182G06F16/172
Inventor 欧二强邓鑫鑫沈仁奎
Owner 北京思维造物信息科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap