Centralized Log File Search via Metadata Indexing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In grid computing, accessing and identifying relevant log files across multiple computer nodes is slow and inefficient due to their decentralized storage, making it difficult for human operators to locate and analyze error logs in a user-friendly manner.
Innovation Solution
A system and method that utilize meta data to search for log files based on attributes, allowing for efficient identification and presentation of log file locations within a centralized computer-readable storage medium, using an input device to receive attributes, a log searcher to identify matching files, and an output device to display their locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If log files are stored in a centralized data storage location, then accessibility of log files is improved, but time required to identify relevant log files increases
Solution Approach 1:
The patent applies preliminary action by pre-processing and organizing log files into categories during storage, creating an indexed structure that enables rapid retrieval. Log files are pre-sorted by attributes such as error type, component, and time period, so that when a search is initiated, the system can quickly locate relevant files without scanning the entire centralized repository.
Solution Approach 2:
The patent segments the centralized log file storage into multiple categorized groups or buckets based on attributes like error type, system component, and time period. This segmentation allows the search function to target specific segments rather than searching through all log files, significantly reducing identification time while maintaining centralized accessibility.
2Ease of manufacture
If multiple computer nodes independently generate and store log files, then log file generation is simplified, but accessibility and ease of locating log files deteriorates
Solution Approach 1:
The patent introduces an intermediary centralized storage system that receives log files from multiple distributed computer nodes. This intermediary repository consolidates logs while maintaining organized categorization, allowing nodes to independently generate logs without managing distributed access complexity. The centralized location acts as a mediator that simplifies both generation and retrieval operations.
Solution Approach 2:
The patent merges log files from multiple independent computer nodes into a single centralized storage location while preserving organizational structure. This combining approach maintains the simplicity of independent log generation at each node while achieving centralized accessibility, allowing operators to search and retrieve logs from all nodes in one location rather than accessing multiple distributed sources.
3Reliability
If a large number of log files are stored centrally, then comprehensive logging is achieved, but difficulty in presenting relevant log file locations increases
Solution Approach 1:
The patent applies preliminary action by pre-organizing and indexing log files with metadata tags during the storage process. Attributes such as error type, component name, and time period are pre-assigned to each log file, creating a structured index that simplifies the presentation of relevant locations. When a search is performed, the system can quickly retrieve and present organized results rather than displaying raw file paths.
Solution Approach 2:
The patent segments the presentation of log file locations by organizing results into categorized groups based on attributes like error type or system component. Instead of presenting a flat list of file locations, the system divides results into meaningful segments, making it easier for operators to navigate and understand which logs are relevant to their inquiry while maintaining comprehensive coverage.
Data Source
AI summary
Systems and methods are provided for finding a log file generated by an application during an execution of the application on at least one computer node. The computer node is one of a plurality of computer nodes of a distributed computer that has a computer-readable storage medium that contains therein both a plurality of log files and meta data describing attributes of the log files. In one implementation, a method includes receiving at least one attribute describing a log file that has been generated by the computer node of the distributed computer. The meta data is searched to identify one or more log files described by the received attribute. Locations of the identified log files in the computer-readable storage medium are presented based on the results of the searching step.