Business call log relation analysis method and system based on memory cache

A relational analysis and memory caching technology, applied in special data processing applications, database distribution/replication, instruments, etc., can solve problems such as complex relationships, huge amount of relational log data, and inconvenience in locating business services in a timely manner. The effect of reducing resource consumption and reducing the time-consuming effect of manual troubleshooting and positioning

Pending Publication Date: 2022-01-07
北京思特奇信息技术股份有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] After the system is cloudified and containerized, the output system service call relationship log data volume becomes huge and the relationship is complicated, making it difficult to locate problems in the business service call process in a timely manner

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Business call log relation analysis method and system based on memory cache
  • Business call log relation analysis method and system based on memory cache
  • Business call log relation analysis method and system based on memory cache

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0054] Such as figure 1 As shown, a kind of memory cache-based service call log relationship analysis method provided by the present invention includes:

[0055] S1. Connect the log stream data of the business service call process to the stream processing platform;

[0056] Among them, the stream processing platform can choose flink or storm stream processing platform.

[0057] S2. Filter out data that does not meet the requirements in the log stream data;

[0058] Among them, including:

[0059] Unified serial number (Trace_ID) format is incorrect;

[0060] The gap between the date and time in the unified serial number (Trace_ID) and the log output timestamp exceeds 8 hours. This situation indicates that the data corresponding to the unified serial number is backlog data. Therefore, the call relationship has not been obtained to determine whether there is a problem necessary;

[0061] The operation code (OP code) of the business service is not within the scope of analysi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a business call log relationship analysis method and system based on memory cache, and relates to the technical field of distributed data relationship processing. The method comprises the steps of accessing log stream data in a business service call process to a stream processing platform; storing the data in a memory cache, taking the unified serial number as streaming data to continue to flow, and distributing a time window grouping mark for the streaming data; judging whether a time window corresponding to the stream data is opened or not according to the time window grouping mark, if so, adding the stream data into the corresponding time window, and otherwise, creating a new time window; closing the time window after the time window reaches the opening duration, and triggering the analysis of all stream data in the time window; and storing an analysis result. The method has the advantages that online data flow analysis is carried out on clouded and containerized business service calling process logs by utilizing an extremely small time window by utilizing a memory caching technology, a business calling relation result is acquired and stored in quasi real time, and an efficient means is provided for quickly discovering business system faults.

Description

technical field [0001] The present invention relates to the technical field of distributed data relational processing, in particular to a method and system for analyzing relational business call logs based on memory cache. Background technique [0002] After the system is cloudified and containerized, the output system service call relationship log data volume becomes huge and the relationship is complicated, making it difficult to locate problems in the business service call process in a timely manner. [0003] Based on this, the present invention designs an analysis method based on the memory cache to realize the relationship between business call logs, and analyzes the problems of log data online under the condition of low delay, so as to realize the timely positioning of problems in the business service process. Contents of the invention [0004] In view of the above problems, the present invention provides a method and system for analyzing business call log relationsh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2457G06F16/2455G06F16/27
CPCG06F16/2457G06F16/24552G06F16/27
Inventor 王金龙
Owner 北京思特奇信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products