Log Retrieval via Joint Semantic and Syntactic Similarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current log retrieval methods in computer system maintenance and monitoring often suffer from low precision and recall, leading to false positives and missed true positives during fault diagnosis, as they fail to effectively utilize both semantic and syntactic information from logs.
Innovation Solution
A method and system that utilize joint semantic and syntactic similarities to retrieve historical logs by defining and computing similarities between query logs and historical logs, using semantic content and syntactic information to rank and select the most relevant logs for fault diagnosis, incorporating adaptive learning approaches to handle large-scale log data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional log retrieval methods are used, then the system is simple to operate, but retrieval precision and recall are low
Solution Approach 1:
The patent combines semantic similarity and syntactic similarity computations into a unified retrieval framework. The semantic component captures the meaning of log messages while the syntactic component captures the structural patterns, and both are integrated to produce a comprehensive similarity measure that improves retrieval precision without requiring completely separate systems
Solution Approach 2:
The patent divides the log retrieval task into two distinct components: semantic analysis (extracting meaning from log messages) and syntactic analysis (extracting structural patterns). This segmentation allows each component to be optimized independently while maintaining overall system manageability and improving retrieval accuracy
2Measurement precision
If traditional log retrieval methods are used, then the system is fast to execute, but retrieval recall is low
Solution Approach 1:
The patent pre-computes and stores syntactic patterns from historical logs before retrieval operations. By preparing syntactic templates in advance and organizing them for efficient matching, the system can quickly compare new logs against pre-processed patterns, improving recall without proportionally increasing query time
Solution Approach 2:
The patent merges semantic and syntactic similarity computations into a single integrated retrieval process. This combination allows the system to leverage both meaning-based and structure-based matching simultaneously, improving recall while maintaining efficient execution through unified optimization
3Reliability
If only semantic similarity is used for log retrieval, then the system is simple to implement, but false positives increase
Solution Approach 1:
The patent creates a composite retrieval approach that combines semantic similarity (capturing meaning) with syntactic similarity (capturing structure). This composite method reduces false positives by requiring both semantic and structural alignment, improving diagnosis accuracy while maintaining reasonable system complexity through modular implementation
Data Source
AI summary
A method for diagnosing computer system faults using log retrieval based on joint semantic and syntactic similarities includes receiving a set of query logs, defining joint semantic and syntactic similarities between the set of query logs and respective ones of multiple sets of historical logs based on semantic content and syntactic information obtained for the set of query logs and the multiple sets of historical logs, the multiple sets of historical logs being associated with historical computer system fault diagnoses, retrieving a set of historical logs from the multiple sets of historical logs to obtain a retrieved set of historical logs for computer system fault comparison based on a similarity measure corresponding to each of the multiple sets of historical logs derived from the joint semantic and syntactic similarities, and transmitting the retrieved set of historical logs to one or more computing devices to perform the computer system fault comparison.