Touch Panel Gesture Logging for Accurate Operation Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for recording and playing back operations on image forming apparatuses using touch panels are not effective, as they do not accurately capture and replay touch events and gestures, leading to complex operations and inadequate user guidance.
Innovation Solution
An image forming apparatus with a controller that determines gestures from touch events and stores log data, allowing for precise display control processing in both normal and playback modes, enabling reliable playback of touch panel operations by using gesture and touch event log data to recreate screen transitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional methods (mouse or key-based logging) are used to record and playback operations, then basic operation logging is achieved, but the playback does not accurately reflect touch panel gestures and multi-touch events
Solution Approach 1:
The touch panel surface is divided into multiple distinct areas (first area for gesture input, second area for object selection), allowing different input methods to be recorded and played back according to their respective areas. This segmentation enables accurate representation of both gesture-based and object-based operations in the playback log.
Solution Approach 2:
The system changes the parameters of operation recording based on the input device and interaction type. For touch events in the first area, gesture parameters (swipe direction, tap count, hold duration) are recorded; for events in the second area, object position and selection parameters are recorded. This parameter adaptation ensures accurate playback across different interaction modes.
2Adaptability or versatility
If the number of functions and processing variations in the image forming apparatus is increased, then more capabilities are provided to users, but the operation complexity increases
Solution Approach 1:
Model operations are recorded in advance and stored as playback logs. Users who want to learn how to perform operations can watch the pre-recorded playback sequences, which show the exact screen transitions and操作步骤. This preliminary action eliminates the need for users to navigate through complex functions themselves, reducing operational complexity while maintaining full functionality.
3Ease of operation
If gesture recognition and multi-touch support are added to the touch panel, then more operation methods are enabled, but the difficulty of accurately capturing and replaying these operations increases
Solution Approach 1:
The touch panel is segmented into functional areas with different recording rules. The first area captures gesture events (swipes, taps, holds) with their specific motion parameters, while the second area captures object selection events. This segmentation simplifies the detection and measurement process by applying area-specific capture rules, making it easier to accurately record and replay complex touch operations.
Data Source
AI summary
An image forming apparatus includes a display and a touch panel, and is provided with a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, and the image forming apparatus includes a controller configured to determine a gesture represented by a series of touch events, store gesture log data and touch event log data to a storage unit, and determine display control processing. In the normal mode, the display control processing is determined on the basis of the gesture or an object. In the play back mode, the display control processing is determined on the basis of the gesture log data or the touch event log data. The determined display control processing is executed.