Operation Log Visualization with Screen Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
It is challenging for work analysts to understand the actual work states of workers when operation logs from information terminals are directly visualized as flowcharts, as they lack context about the tasks or work represented by the logs.
Innovation Solution
An operation log visualization device that stores and processes operation logs with captured images and operation location information, generating highlighted images and flowcharts to arrange the logs in chronological order, allowing analysts to visualize the actual work states without requiring prior knowledge of the operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If operation logs are directly visualized as flowcharts using geometric figures and edges, then the operation procedure can be displayed in sequence, but it becomes difficult for work analysts to understand the actual work states without prior knowledge of the operation log contents
Solution Approach 1:
The patent introduces captured images of operation screens as intermediary elements between the abstract operation logs and the human analyst. These images serve as a visual mediator that translates technical operation data into comprehensible visual context, allowing analysts to understand actual work states without needing to interpret raw operation log contents
Solution Approach 2:
The patent transitions from a one-dimensional text-based operation log representation to a two-dimensional visual representation by incorporating captured images and highlighted operation locations. This dimensional change provides spatial and visual context that makes the operation flowchart comprehensible to analysts without technical expertise
2Loss of information
If operation logs are visualized with detailed information about tasks and work contents, then work analysts can understand actual work states, but the complexity of the visualization system increases
Solution Approach 1:
The system performs preliminary actions by automatically capturing operation screens and storing them alongside operation logs during the actual operation process. This pre-capturing of visual context eliminates the need for complex real-time analysis systems, as the visual information is already prepared and stored for later visualization
Solution Approach 2:
The patent uses captured images as copies of the actual operation screens, preserving the visual context of operations without requiring the original complex system state. These image copies serve as sufficient representations for analysis purposes, simplifying the visualization system while retaining essential operational context
Data Source
AI summary
An operation log visualization device includes processing circuitry configured to store operation logs each containing a captured image of an operation screen captured during an operation and information identifying a position of an operation location in an operation target window on the operation screen, generate images in each of which a portion corresponding to the position in the captured image is highlighted, and generate a flowchart by arranging the generated images in an order of processing of operation logs corresponding to the images.