Log analysis-based micro-service performance optimization system and analysis method

Abstract

The invention discloses a micro-service performance optimization method based on log analysis. The micro-service performance optimization method comprises the following steps that a key interface of amicro-service module records an access log called by an interface through a log sdk; The log collection agent module collects performance monitoring information of the service system at regular intervals; The unified log analysis platform carries out extraction and analysis according to the access logs to obtain performance bottleneck points of the system; The micro-service gateway updates the routing strategy of the intelligent routing module at regular intervals through the performance indexes of the micro-service modules; Meanwhile, the API monitoring module extracts the external request number and the throughput through log analysis system processing, and then obtains the external current limiting weight of the microservice gateway according to the external request number, the throughput and the performance bottleneck point. According to the method, through automatic extraction and analysis of logs, a complete calling chain topology is generated, hidden performance doubtful pointsare found, performance bottleneck points of the system are quickly found out, and the actual workload of development and operation maintenance personnel can be effectively reduced.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a microservice performance optimization system and analysis method based on log analysis. Background technique [0002] With the maturity of cloud computing and a large number of open source lightweight technologies, a new architectural design style-microservice architecture has emerged. The microservice architecture is characterized by fine-grained service boundaries, which is conducive to independent development, testing, deployment, and expansion. However, as the service scale becomes larger and the service call chain becomes longer, performance issues will become more and more important. The intuitive performance of the service is the response time and throughput of the request. [0003] like figure 1 As shown, in a microservice system, one front-end request may correspond to multiple requests from multiple back-end systems, which is intricate. When a s...

AI Technical Summary

Problems solved by technology

First of all, in a distributed system, because the technology stack of each system may be different, and the log implementation method may also be different, it is very difficult to view and analyze the overall call chain; secondly, when some nodes are found to have non-design performance bottlenecks , dynamically adjusting the routing strategy of the microservice gateway is also cumbersome

Images