GUI Copy Image Acquisition for Troubleshooting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems face challenges in easily checking and investigating user operations on Graphical User Interfaces (GUIs) for troubleshooting application failures or unintended processing results, as relying solely on log information can be cumbersome and insufficient.
Innovation Solution
An information processing apparatus that acquires and stores copy images of the GUI at predetermined intervals or specific events, allowing for easier verification of user operations by storing these screenshots with associated timing information, facilitating the investigation of failures and processing results.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If only log information is used to check user operations, then storage space is saved and system complexity is reduced, but the ease of checking and investigating user operations deteriorates
Solution Approach 1:
The patent applies the copying principle by creating visual copies (screenshots) of the GUI at specific moments when operations occur. Instead of storing complex detailed logs, the system captures image copies of the screen state, which are easier to visually inspect and analyze. This allows investigators to directly see what was displayed and interacted with, significantly improving the ease of checking user operations while maintaining manageable system complexity through selective capture rather than continuous recording.
2Reliability
If detailed log information is recorded to improve troubleshooting capability, then the ability to investigate failures is improved, but the ease of operation and time required to analyze operations worsens
Solution Approach 1:
The patent creates visual copies of the GUI state at operation moments, providing immediate visual evidence of what was displayed and interacted with. This eliminates the need to manually parse through detailed text logs, significantly reducing the time required to analyze operations while maintaining strong troubleshooting capability through direct visual inspection of screen captures associated with specific operations.
Solution Approach 2:
The patent employs visual differentiation through color coding and highlighting in the screenshots to indicate important elements, selected items, or state changes. This visual encoding allows investigators to quickly identify key information in the captured images without having to read through detailed logs, thereby reducing analysis time while preserving comprehensive troubleshooting information.
3Reliability
If screenshots are captured at every operation to improve investigation capability, then the ability to check user operations is improved, but the loss of time for processing and storing images increases
Solution Approach 1:
The patent implements periodic screenshot capture triggered by specific events or time intervals rather than continuously capturing every single GUI change. Screenshots are taken at predetermined moments when operations occur or at regular intervals, which reduces the total number of images processed and stored while still providing sufficient information for investigation. This periodic approach balances investigation capability with reduced processing and storage time compared to continuous capture.
Solution Approach 2:
The patent performs preliminary filtering and selection of which operations warrant screenshot capture, capturing images only for significant or predefined operation types. This preliminary action prevents unnecessary screenshots from being taken, processed, and stored, thereby reducing the time and resources required for image processing while maintaining effective investigation capability for important operations.
Data Source
AI summary
An information processing apparatus includes a processor configured to acquire a copy image, that is a copy of an image displayed on a display device, every time a predetermined timing occurs, and store the acquired copy image in a storage device in association with information indicating the predetermined timing that triggers the acquisition.