Image Processing Apparatus Screen Capture for Error Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing apparatuses face challenges in error analysis due to unclear log data regarding screen transitions, user operations, and timing, with manual recording often obscured by camera shake and mistakes, leading to time-consuming analysis processes.

Innovation Solution

An image processing apparatus that captures screen images at predetermined intervals, generates log data, and associates it with time information, allowing for efficient reproduction of user operations and screen transitions, thereby enhancing error analysis by creating reproduction data for display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If manual recording of user operations is performed, then user operations can be recorded, but the recording may be obscured by camera shake and recording mistakes

Engineering Contradiction:

Improveuser operation recording clarityVSAvoidrecording accuracy

Core Design Contradiction:

Loss of informationVSReliability

Solution Approach 1:

The patent replaces the mechanical manual recording system (camera-based video recording) with an automated digital logging system. The image processing apparatus automatically captures screen images and generates log data through software-based automation, eliminating the need for manual camera operation and thus removing sources of error such as camera shake and human recording mistakes.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The image processing apparatus performs self-recording of its own operations. The system automatically generates log data and captures screen images of its own operation state without requiring external manual intervention. This self-service capability ensures consistent, accurate recording of user operations and system state transitions.

Inventive Principle:

Principle #25Self-service

2Loss of information

If log files are used for error analysis, then operations are recorded, but certain events such as screen transitions and timing may not be clear

Engineering Contradiction:

Improveoperation detail clarityVSAvoidevent timing and state precision

Core Design Contradiction:

Loss of informationVSMeasurement precision

Solution Approach 1:

The patent segments the operation recording into multiple distinct data components: screen images capturing visual state, log data recording operational events, and time information marking precise timestamps. This segmentation allows each component to specialize in capturing specific aspects of the operation, with screen images showing visual transitions and log data providing structured event information with precise timing.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent adds temporal dimension by associating precise time information with each log entry and screen capture. This transforms the traditional log file from a simple sequential record into a time-synchronized multi-dimensional dataset that correlates visual screen state with operational events and precise timing, enabling accurate reconstruction of the operation sequence.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Loss of information

If recorded images are used for error analysis, then user operations can be reviewed, but the user's operation may be obscured by hands and analysis takes time

Engineering Contradiction:

Improveoperation visibilityVSAvoiderror analysis time

Core Design Contradiction:

Loss of informationVSLoss of time

Solution Approach 1:

The patent creates a digital copy of the screen display through automated screen image capture. This digital copy preserves the exact visual state of the interface without the physical constraints of video recording, allowing clear viewing of user interactions with the screen without obstruction from hands or camera instability.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical video recording and manual review process with an automated digital logging and screen capture system. The generated log data and screen images can be automatically processed and analyzed by computers, dramatically reducing the time required for error analysis compared to manually reviewing video recordings.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10338866B1Image processing apparatus configured to generate and store data representing user operations so that user operations can be reproduced using such data

Publication Date: 2019.07.02 KK TOSHIBA

AI summary

An image processing apparatus according to an embodiment includes a communication interface, a user interface, a display device, a storage device, and a printer. A processor determines if an operation event occurs. If the operation event occurs, the processor generates log data corresponding to the operation event, captures, at predetermined capture intervals over a predetermined period, a screen image corresponding to the information currently displayed on the display device, and controls the storage device to store: the generated log data, time information indicating a time of the operation event, and each screen image captured over the predetermined interval. When at least one screen image is stored in the storage device in association with time information corresponding to a received reproduction start time, the processor generates reproduction data including each screen image and text corresponding to the associated log data and the time information, and outputs the reproduction data for display.