Log Management System for Distributed Computing Noise Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed computing environments, traditional log record analysis techniques are burdensome due to high processing overhead and noise, making it difficult to identify and troubleshoot issues within large quantities of elements, as they require filtering through numerous log records to find relevant information.
Innovation Solution
A log management system that associates log records with element records in a searchable database, using a NoSQL database and Elasticsearch search engine, allowing for efficient retrieval of log messages by starting with a known set of elements and filtering out irrelevant data, thus reducing noise and improving analysis efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional log record analysis techniques are used in distributed computing environments, then comprehensive log data can be collected from all elements, but the processing overhead increases and noise increases making it difficult to identify relevant information
Solution Approach 1:
The patent segments the log management system into distinct components: element records stored in a database, log records associated with specific elements, and a user interface for querying. This segmentation allows users to query specific elements rather than processing all log records, reducing processing overhead while maintaining comprehensive log data availability.
Solution Approach 2:
The patent implements preliminary action by pre-storing element records with identifying information in a database before log analysis is needed. This allows the system to quickly retrieve relevant element records and associated log messages based on user queries, avoiding the need to process and filter through all log records in real-time.
2Reliability
If all log records are processed to ensure complete coverage, then no relevant information is missed, but the analysis time and computational resources increase significantly
Solution Approach 1:
The patent extracts only the necessary log records by allowing users to query specific elements through the user interface. The system retrieves element records matching the query criteria and obtains only the log messages associated with those specific elements, rather than processing all log records. This extraction approach maintains reliability for targeted analysis while significantly reducing analysis time.
3Ease of manufacture
If log records are stored separately from element information, then data storage is organized, but retrieving relevant log messages requires filtering through numerous records
Solution Approach 1:
The patent merges element information and log records by associating log messages with specific element records. The database stores element records with identifying information, and log messages are linked to these elements. When users query the system, it retrieves both the element records and their associated log messages together, eliminating the need to filter through numerous unrelated log records while maintaining organized data storage.
Data Source
AI summary
A log management system includes a computing system that executes a set of instructions to receive one or more search terms from a database, and identify one or more element records that match the search terms. The element records are associated with the elements of a distributed computing environment. For each matched element record, the instructions obtain any of multiple log messages associated with the matched element record from a log message database, and facilitates the display of the one or more identified element records and their associated log messages on a display.