Distributed Log Analysis Using Logging Duration Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing log data analysis systems face challenges in efficiently identifying and retrieving log data from multiple distributed devices, as the device storing each log data piece and the time of generation are not easily identifiable, leading to complex preparation operations for analysis.
Innovation Solution
A log data analysis support system that includes multiple logging devices generating log data and a support device connected to these logging devices. The support device provides indication, reception, and acquisition means to identify and select logging durations, acquire log data, and associate it with identification information, simplifying the analysis process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If log data is stored in multiple distributed devices, then the recording capacity is increased, but the complexity of identifying the device and time of log data generation increases
Solution Approach 1:
The system performs preliminary actions by having each logging device generate and store metadata (device identification information and time information) along with the log data before analysis is requested. This preliminary organization of information eliminates the need for complex sequential identification operations during data retrieval, as all necessary identification data is already prepared and associated with the log data in the distributed storage system.
2Quantity of substance
If log data is stored in multiple distributed devices, then the recording capacity is increased, but the preparation operation for analyzing log data becomes complex
Solution Approach 1:
The system introduces an intermediary mechanism where a central management device or coordination layer collects and integrates metadata from multiple distributed logging devices. This intermediary consolidates device identification information and time information from various sources, presenting a unified view to users that simplifies the selection and retrieval of log data without requiring users to navigate the complexity of distributed storage manually.
3Ease of operation
If sequential reading operations are performed on individual devices, then data can be retrieved, but the time required for analysis preparation increases
Solution Approach 1:
The system performs preliminary actions by having each logging device generate and store metadata (device identification information and time information) along with the log data before analysis is requested. This preliminary organization of information eliminates the need for complex sequential identification operations during data retrieval, as all necessary identification data is already prepared and associated with the log data in the distributed storage system.
Solution Approach 2:
The system introduces an intermediary mechanism where a central management device or coordination layer collects and integrates metadata from multiple distributed logging devices. This intermediary consolidates device identification information and time information from various sources, presenting a unified view to users that simplifies the selection and retrieval of log data without requiring users to navigate the complexity of distributed storage manually.
Data Source
AI summary
A log data analysis support system includes multiple logging devices to generate log data by logging control data about device control, and a support device to support analysis of the log data. The logging devices provide logging durations to the support device. Each logging duration is a duration of logging of the control data. The support device includes an indicator that indicates each logging duration in a manner associated with a device ID identifying the corresponding logging device, a receiver that receives selection of at least one logging duration from the indicated logging durations, and a communicator that acquires the log data generated during the logging duration corresponding to the selection and generated by a logging device corresponding to the device ID associated with the logging duration. The indicator indicates information about the log data acquired by the communicator.


