Distributed log processing system and method

A processing system and distributed technology, applied in the field of log processing, can solve the problems of long call log link, low query efficiency, and long log link, etc., to achieve the effect of improving efficiency and improving log processing efficiency

Pending Publication Date: 2021-09-24
JIANGSU CHUANGYUAN ELECTRON CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] When an abnormal problem occurs, you need to check the relevant log files from the server container, that is, the log link corresponding to the abnormal link is too long, and the link query is performed through the common query method, and the link to call the log will be very long. This leads to inefficient query

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed log processing system and method
  • Distributed log processing system and method
  • Distributed log processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] For the above questions, please refer to the figure 1 , figure 1A schematic structural diagram of a distributed log processing system provided by an embodiment of the present application is shown, and the distributed log processing system includes a client 100 , a gateway 200 , a microservice platform, a log collection module 400 and a search server 500 . Wherein, the microservice platform includes a microservice module A301, a microservice module B302 and a microservice module C303. It can be understood that the microservice platform includes several microservice modules, where microservice module A301, microservice module B302, and microservice module C303 are the number of microservice modules used to execute the current operation instruction.

[0042] Specifically, the client 100 receives an operation instruction executed by the user on the webpage, and sends an operation request carrying an operation identifier corresponding to the operation instruction to the mic...

Embodiment 2

[0072] figure 2 It is a flow chart of a distributed log processing method provided by the embodiment of the present application. Such as figure 2 As shown, the distributed log processing method provided by the embodiment of the present application includes:

[0073] Step S101: the client receives an operation instruction executed by a user on a web page, and sends an operation request carrying an operation identifier corresponding to the operation instruction to the microservice platform.

[0074] Step S102: Multiple target microservice modules in the microservice platform execute the processing operation indicated by the operation instruction corresponding to the operation identifier in the operation request, record the log file of each target microservice module executing the processing operation, and record the operation identifier and recorded log files are sent to the search server.

[0075] Step S103: The search server constructs a log database storing the operation...

Embodiment 3

[0084] Embodiments of the present application provide a solution for customizing log collection, search and display in a distributed system. The steps to implement the solution are:

[0085] (1) Abstract an independent log collection module, automatically inject custom beans through springboot framework tools, configure related interceptors, annotations and aspect logic configurations, and generate public lockback.xml log files;

[0086] (2) Every time the front end (ie, the client page) receives an operation instruction from the user, the UUID corresponding to the operation instruction is set in the header file;

[0087] (3) Based on AOP logic, define the package name that needs to be processed and the logic that needs to be woven, that is, add dependencies to the pom of the target microservice module used to respond to operation instructions, and point the log configuration file of the microservice module to the log collection module log configuration file;

[0088] (4) Bu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of log processing, in particular to a distributed log processing system and method. The method comprises the steps that a client receives an operation instruction executed by a user in a webpage and sends an operation request to a micro-service platform; a plurality of target micro-service modules in the micro-service platform execute a processing operation indicated by an operation instruction corresponding to the operation identifier in the operation request, and record a log file of the processing operation executed by each target micro-service module; the search server constructs a log database in which the operation identifier and a log file corresponding to the operation identifier are stored; when determining that the operation instruction is abnormal, the client sends an abnormal query request to a search server; and the search server obtains a log file corresponding to the abnormal query request from a log database, and sends the obtained log file to the client. By means of the mode, the search link for querying the log file corresponding to the abnormal operation instruction can be shortened, and the efficiency of querying the abnormal log link is improved.

Description

technical field [0001] The present application relates to the technical field of log processing, and in particular to a distributed log processing system and method. Background technique [0002] In the prior art, if an abnormality occurs in the online link in the interface of the client, it is necessary to obtain the authority of the server to query the log file corresponding to the abnormality. [0003] When an abnormal problem occurs, you need to check the relevant log files from the server container, that is, the log link corresponding to the abnormal link is too long, and the link query is performed through the common query method, and the link to call the log will be very long. This leads to low query efficiency. Contents of the invention [0004] In view of this, embodiments of the present application at least provide a distributed log processing system, a distributed log processing method, an electronic device, and a computer-readable storage medium. [0005] Thi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/14G06F16/17G06F16/18
CPCG06F16/148G06F16/1734G06F16/1815
Inventor 张跃吴哲
Owner JIANGSU CHUANGYUAN ELECTRON CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap