Log Entry Classification via Markup Generation and Ranked Event Lists
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack an efficient method for classifying and determining the types of events associated with log entries, which hinders effective log analysis and event categorization.
Innovation Solution
A system is developed that generates a markup for log entry instances, creates definitions for log entry types, and retrieves reference documents to generate a ranked list of event types, allowing for the selection and association of event types with log entry definitions, enabling the processing of log entries based on these definitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual classification methods are used for log entries, then classification accuracy may be maintained, but the complexity and time consumption increase significantly
Solution Approach 1:
The system enables self-service classification by automatically generating event type definitions from log entry instances and their associated documents. The classification process serves itself by using the log data to create the classification rules, eliminating the need for complex manual configuration while maintaining accuracy.
Solution Approach 2:
The system performs preliminary action by pre-generating event type definitions and classifications before actual log analysis is needed. Reference documents and event type frameworks are created in advance, so when log entries need classification, the systematic framework is already in place to guide accurate classification without ad-hoc complexity.
2Productivity
If automated classification systems are implemented, then processing efficiency improves, but classification accuracy and precision deteriorate
Solution Approach 1:
Documents serve as intermediaries between raw log entries and classification rules. The system extracts event types from documents that describe the log entries, creating a mediating layer that translates unstructured log data into structured classifications. This intermediary process maintains accuracy while enabling automated processing.
Solution Approach 2:
The system replaces manual mechanical classification processes with automated text processing and pattern recognition. By substituting human analysis with systematic document-based extraction, the system achieves both high processing efficiency and maintained accuracy through consistent application of extraction rules.
3Manufacturing precision
If comprehensive log analysis is performed to ensure accurate event type determination, then classification quality improves, but the time required for analysis increases
Solution Approach 1:
The classification process is segmented into distinct phases: document generation from log instances, event type extraction from documents, and final classification application. This segmentation allows each phase to be optimized independently, with document generation occurring quickly and classification quality ensured through the structured extraction process, reducing overall analysis time.
Solution Approach 2:
Event type definitions and document frameworks are prepared in advance through preliminary action. By pre-establishing the classification vocabulary and document structures, the system eliminates the need for time-consuming analysis during actual log processing, as the classification framework is already in place to guide rapid accurate classification.
Data Source
AI summary
Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a log entry instance for creating a definition for a log entry type. The program further generates a markup associated with the log entry instance. The program also generates a document based on the markup associated with the log entry instance. The program further retrieves a set of reference documents. Each reference document is associated with a particular type of event. The program also generates a ranked list of types of events based on the document and the set of reference documents.