Dynamic Microservice Troubleshooting Through Structured Log Aggregation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional logging systems in network environments face challenges with unstructured log data, leading to difficulty in parsing and analyzing issues in microservices, loss of crucial details due to limited storage, and inefficiencies in troubleshooting, especially in systems with security concerns preventing log offloading.
Innovation Solution
A system and method for dynamically troubleshooting microservices by converting log information into structured data, publishing accessible notices through a bulletin board system, and enabling automated remediation, including self-diagnosis and self-healing capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If log data is collected in unstructured format from multiple devices, then comprehensive troubleshooting information can be obtained, but parsing and analysis become difficult and time-consuming
Solution Approach 1:
The patent transforms log data from unstructured format to structured format with standardized fields and schemas. This parameter change in data organization enables automated parsing and analysis while preserving comprehensive troubleshooting information from multiple devices
Solution Approach 2:
The patent introduces a log aggregation service as an intermediary that receives, standardizes, and processes logs from multiple devices before analysis. This mediator component handles the complexity of parsing diverse log formats, making the overall system easier to operate
2Volume of stationary object
If log queue capacity is limited on devices, then storage space is preserved, but crucial log details are lost when the queue fills up
Solution Approach 1:
The patent combines log queues from multiple devices into a centralized aggregation service. This merging allows the system to preserve comprehensive log details across the network while individual devices maintain limited local storage capacity
Solution Approach 2:
The patent moves log storage from a single-device dimension to a network-wide dimension. By distributing log collection across multiple devices and aggregating them centrally, the system achieves effective unlimited storage while individual devices maintain small local queues
3Device complexity
If manual analysis of unstructured log data is performed, then troubleshooting can be conducted without additional infrastructure, but the process becomes extremely time-consuming
Solution Approach 1:
The patent implements automated log analysis capabilities within the aggregation service that perform troubleshooting actions without requiring manual intervention. The system self-analyzes structured logs, identifies issues, and executes remediation, dramatically reducing troubleshooting time while maintaining manageable infrastructure complexity
4Productivity
If logs are offloaded to cloud for analytics, then advanced analysis capabilities are available, but security concerns prevent log offloading
Solution Approach 1:
The patent introduces an on-premises log aggregation service as an intermediary that provides cloud-level analysis capabilities while keeping logs within the organization's security boundary. This mediator delivers advanced productivity without compromising security constraints
5Quantity of substance
If multiple formats of log data from multiple devices are collected, then comprehensive system snapshot is obtained, but it becomes difficult for technicians to analyze different formats
Solution Approach 1:
The patent standardizes log data parameters across multiple devices by imposing a common schema during aggregation. This parameter normalization transforms diverse log formats into a unified structure, enabling technicians to analyze data from multiple sources without format-related difficulties
Data Source
AI summary
Systems and methods for troubleshooting software within a network microservices architecture are provided. A method, according to one implementation, includes the step of obtaining log information from a plurality of customer level devices and microservices in a network. The method also includes the step of converting the log information into data having a common format. Also, the method includes analyzing the data to determine issues with respect to the microservices. The method further includes the step of publishing an accessible notice to allow software troubleshooting of the issues with respect to the microservices.


