Touch Operation Reproduction with Gesture Trajectory Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to accurately reproduce touch operations on image formation apparatuses, particularly for gestures like pinch and flick, as they cannot faithfully represent the timing, strength, and direction of gestures, leading to a lack of understanding for users and incorrect interpolation of operations.
Innovation Solution
An image formation apparatus with a touch panel, a touch event accepting unit, a gesture determination unit, and a screen control unit that stores and reproduces touch events by adding visual information such as marks or arrows to display the gesture trajectory and direction, allowing users to understand the exact nature of the touch operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If touch operations are reproduced using existing technologies, then operation history can be displayed, but the trajectory and direction of gestures cannot be accurately represented
Solution Approach 1:
The patent creates a visual copy of the gesture trajectory by displaying a series of operation position images along the path connecting touch points. This copy preserves the spatial and temporal characteristics of the original gesture, allowing accurate representation of trajectory and direction without losing gesture information.
Solution Approach 2:
The patent adds a temporal dimension to the display by showing operation position images in time sequence along the gesture path. This transforms the two-dimensional touch surface coordinates into a three-dimensional representation that includes time progression, enabling accurate visualization of gesture trajectory and direction.
2Loss of information
If operation position images are displayed for gesture operations, then operation history is visible, but the continuous nature of gestures causes points to be too close to display effectively
Solution Approach 1:
The patent displays operation position images at selected intervals along the gesture path rather than at every possible point. This partial display approach prevents overcrowding of visual elements while still capturing the essential trajectory and direction of the gesture, maintaining both information completeness and visual clarity.
Solution Approach 2:
The continuous gesture path is segmented into discrete operation position images that are displayed at intervals. This segmentation transforms the continuous gesture into a series of readable discrete points, making the trajectory visible and understandable without the visual clutter that would result from displaying every intermediate position.
3Productivity
If touch events are reproduced automatically, then operation content can be replayed, but users cannot understand which key is pressed or what operation is performed
Solution Approach 1:
The patent provides visual feedback by displaying operation position images that show users exactly where and how touch operations are being reproduced. This feedback mechanism transforms the invisible automatic reproduction process into a visible, understandable sequence of events, allowing users to comprehend the reproduced operation content in real-time.
Solution Approach 2:
The patent uses visual differentiation through display characteristics to make reproduced operations distinguishable from normal operations. By presenting operation position images in a distinctive visual format along the gesture path, users can easily identify and understand the nature of reproduced touch operations.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An information processing apparatus (100) includes a display unit displaying a screen which accepts a touch operation on the information processing apparatus (100), a touch operation unit (110) accepting the touch operation, a touch event issuance unit (120) issuing one or more touch events respectively corresponding to one or more touch operations on the touch operation unit (110), and a gesture control unit (151) capable of performing each of a mode for performing corresponding processing based on the one or more touch events issued by the touch event issuance unit, and a reproduction mode for reproducing the touch event stored beforehand. The gesture control unit is configured to add an operation image indicating the touch operation corresponding to the stored touch event, to a region associated with the touch event in the reproduction mode, and to cause the display unit to display the operation image.