Coherent Log File Representation for Reliable Industrial Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for analyzing log files in complex industrial systems are manual, error-prone, time-consuming, and expensive, and automated approaches using regular expressions are also inefficient due to the need for expert-defined pattern matching.
Innovation Solution
A computer-implemented method that extracts additional information from diverse log files and combines them into a coherent representation, which can be used to generate a knowledge graph for efficient analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual analysis of log files is performed by experts, then analysis accuracy and reliability are improved, but time consumption and cost increase significantly
Solution Approach 1:
The system performs self-service by automatically analyzing log files using machine learning models without requiring expert intervention. The trained model autonomously processes diverse log formats, extracts patterns, and generates insights, eliminating the need for manual expert analysis while maintaining high reliability through the learned patterns from training data.
Solution Approach 2:
The patent replaces the mechanical system of manual expert analysis with an automated machine learning-based system. The mechanical process of experts manually examining log files is substituted by computational algorithms that automatically process, parse, and analyze log data, significantly reducing time consumption while maintaining or improving analysis reliability.
2Productivity
If automated log analysis using regular expressions is implemented, then time consumption is reduced, but accuracy and reliability deteriorate due to error-prone pattern definition
Solution Approach 1:
The system performs preliminary action by pre-training machine learning models on diverse log file data before actual analysis. During the training phase, the model learns correct patterns and relationships from labeled examples, so that during deployment, it can automatically apply these learned patterns without the errors associated with manual regular expression definition. This preliminary training ensures both speed and accuracy.
Solution Approach 2:
The patent changes the fundamental parameters of log analysis from rule-based regular expressions to machine learning models. This parameter change transforms the analysis approach from static pattern matching to dynamic, adaptive pattern recognition that learns from data, improving both accuracy and reliability while maintaining automated processing speed.
3Adaptability or versatility
If diverse log file formats from multiple sources are processed, then comprehensiveness of analysis is improved, but system complexity increases due to varying structures and formats
Solution Approach 1:
The patent implements universality by designing a single machine learning model that can process multiple diverse log file formats. The model is trained on various log structures and formats, enabling it to universally handle different logging systems and sources without requiring separate processing pipelines for each format, thus maintaining versatility while controlling complexity.
Solution Approach 2:
The machine learning model acts as an intermediary layer between diverse log file formats and the analysis process. Instead of creating complex conversion pipelines for each format pair, the model serves as a universal mediator that can ingest various formats and output standardized insights, simplifying the overall system architecture while maintaining broad compatibility.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention is directed to a Computer-implemented method for Receiving the at least two log files (S1); wherein each log file of the at least two log files comprises at least one log entry with at least one time stamp and at least one message; wherein the at least two log files differ from one another with respect to at least one distinctive criteria; Extracting at least one additional information of each log file of the at least two log files (S2); and Combining each log file of the at least two log files with the extracted additional information into at least two processed log files (S3); wherein the at least two processed log files comply with a coherent representation. Further, the invention relates to a corresponding computer program product and generating unit.