Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed big data log link tracking method and system under micro-service architecture

A link tracking and micro-service technology, applied in the field of distributed big data log link tracking methods and systems, can solve the problem that operation and maintenance personnel cannot quickly identify and locate, log query efficiency and accuracy are not high, and micro-service chains cannot be realized To improve the efficiency of storage and retrieval query, improve the efficiency of development and operation and maintenance, and save hardware costs

Active Publication Date: 2021-04-06
山东经伟晟睿数据技术有限公司
View PDF16 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Due to the large number of microservice modules and distributed deployment, the operation logs of each microservice are scattered to different storage locations, so the inventor found that under the microservice architecture The computer system of the company faces the following technical problems: 1) It is impossible to realize the link tracking of the complex call relationship between microservices, so that developers cannot accurately plan the boundaries of microservice modules
2) Operation and maintenance personnel cannot quickly identify and locate system performance bottleneck modules from a large number of microservices
3) The existing technology can query the operation log file data of the microservice module, but there is a problem that the query process of the operation log is relatively cumbersome, and the query efficiency and accuracy of the log are not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed big data log link tracking method and system under micro-service architecture
  • Distributed big data log link tracking method and system under micro-service architecture
  • Distributed big data log link tracking method and system under micro-service architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Microservice link tracking technology generally generates the traceID identifier of this call request through the request source and initiates the request. The target microservice that receives the request parses the traceID and generates the spanID corresponding to the calling method and additional information (such as the name of the called method , upper-level SpanID, node IP address, etc.), through these link ID information, the entire microservice call dependency can be constructed. For example, the Spring Cloud Sleuth framework is implemented using this technical solution, such as figure 2 shown.

[0043] 1) This technical solution relies on the abstract traceID to generate trace link information between services. When the system has a performance or functional failure, the operation and maintenance or developer often finds the traceID in the exception log by searching the log file first, and then Then use traceID to retrieve the complete operation log, the efficie...

Embodiment 2

[0080] This embodiment provides a distributed big data log link tracking system under the microservice architecture, which includes:

[0081] The service module calls the judgment module, which is used to judge whether the current microservice module is called for the first time after the microservice module receives the call request, and if so, generate the unique identifier traceID of the link, and then generate the unique identifier spanID of the business method; otherwise , directly generate spanID, and mark the corresponding traceID and start timestamp information at the same time;

[0082] The business method calls judgment module, which is used to judge whether the current business method is the business method called for the first time according to whether there is a parentSpanID uniquely identified by the parent business method in the request, and update the spanID relationship in the call chain;

[0083] The cache module is used to cache the IP address of the server ...

Embodiment 3

[0092] This embodiment provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the distributed big data log link tracking method under the micro-service architecture as described above are implemented .

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed big data log link tracking method and system under a micro-service architecture. The method comprises the steps of: after receiving a calling request, enabling a micro-service module to judge whether the current micro-service module is called for the first time or not, and obtaining a trace ID and a span ID; judging whether the current service method is a service method called for the first time or not, and updating the span ID relationship in the call chain; caching the IP address of the server where the micro-service module is located, the name of the micro-service module, the name of the service method, the traceID, the spanID, the parentSpanID and the starting execution time information of the service method; executing a log tracking record according to the link log tracking mark, binding the log information with the calling link information and the micro-service module operation performance information respectively, and sorting the log information according to the calling link information; and binding the performance data operated by the micro-service module with the calling link information, compressing the sorted log records, sending the compressed log records to a log storage server, deleting cache data corresponding to the calling link, and releasing the memory space.

Description

technical field [0001] The invention belongs to the technical field of computer micro-service distributed systems, and in particular relates to a distributed big data log link tracking method and system under a micro-service architecture. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] As the business requirements of the system become more and more complex, large-scale business systems have to split the system into various modules according to business functions, and then through the dynamic combination of modules, finally provide rich business functions while improving system flexibility and scalability , especially with the rise of microservice architecture and container technology in computer software technology, a seemingly simple application may be supported by dozens or even hundreds of microservices in the background, and a simple f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/30G06F11/32G06F11/34
CPCG06F11/3006G06F11/302G06F11/3051G06F11/328G06F11/3409G06F11/3476
Inventor 刘宏亮李铭张丽丽张辉贾立平
Owner 山东经伟晟睿数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com