Compound Gesture Processing for Touchscreen Selection Precision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current sensitive interfaces, particularly those for visually impaired users or 'eyes-free' situations, face challenges with precision and fluidity in gestural interactions due to the need for absolute positioning, which can lead to errors and inconsistency between absolute and relative positioning modes, limiting the ability to select and navigate graphical elements effectively.
Innovation Solution
A method that allows seamless switching between absolute and relative positioning modes during a continuous gesture, enabling users to select and adjust graphical elements without lifting their finger, with adjustable tolerance and notification signals for validation, facilitating intuitive and precise interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If absolute positioning mode is used for selecting graphic elements, then selection precision is improved, but gesture fluidity and ease of operation deteriorate due to the need for high precision without correction possibility
Solution Approach 1:
The system dynamically switches between absolute positioning mode (for precision selection) and relative positioning mode (for fluid navigation) during a continuous gesture. The user can transition from exploratory mode to sequential mode without lifting the finger, allowing the interaction mode to adapt to the user's needs in real-time, thus maintaining both precision and fluidity
Solution Approach 2:
The system changes the positioning parameter from absolute to relative positioning during the gesture based on gesture phase. In the initial phase, absolute positioning is used for accurate element selection, while in subsequent phases, relative positioning enables smooth navigation and adjustment without requiring high precision, thus resolving the contradiction between precision and fluidity
2Speed
If sequential mode is used for navigation, then gesture speed is improved, but the ability to combine with exploratory mode deteriorates, requiring finger lifting to switch modes
Solution Approach 1:
The system enables continuous gesture execution without requiring finger lifting to switch between exploratory and sequential modes. The mode transition occurs seamlessly during the gesture based on gesture phase detection, maintaining the continuity of the useful action (navigation and selection) while allowing flexible mode combination
Solution Approach 2:
The interaction mode dynamically transitions from exploratory to sequential mode during a continuous gesture without interrupting the finger contact. This dynamic adaptation allows the system to combine both modes within a single gesture, improving both gesture speed and mode combination capability
3Adaptability or versatility
If exploratory mode is used for element location, then adaptability is improved, but selection precision deteriorates due to trial and error approach
Solution Approach 1:
The system performs preliminary action by first locating the target element using exploratory mode (speech synthesis and trial positioning), then transitions to sequential mode for precise selection and adjustment. This preliminary exploration phase prepares the system for the subsequent precise selection phase, combining adaptability with precision
Solution Approach 2:
The system maintains continuous gesture execution while transitioning from exploratory mode (for adaptability) to sequential mode (for precision). The uninterrupted finger contact allows the user to smoothly transition from element location to precise selection, combining both exploratory flexibility and selection accuracy in a single continuous action
Data Source
Figure 1~2
Figure 3A~3C
Figure 3D~3F
AI summary
The method involves selecting a graphical element (T0) during execution of gesture by a user, and toggling graphical interaction mode to absolute-positioning mode based on detection of static pointing to a spatial position on a sensitive pad during a preset period of time. The graphical element is selected when the pointing position is located at a distance below a predetermined threshold from a graphical element displayed on the screen. The interaction mode is toggled (T1, 2) to the relative-positioning mode of sequential interaction without raising a pointing tool. Independent claims are also included for the following: (1) a device for processing a compound gesture, made by a user using a pointing tool on a sensitive pad for a piece of terminal equipment (2) a computer program comprising instructions to implement a method for processing a compound gesture, made by a user by using a pointing tool on a sensitive pad for a piece of terminal equipment (3) a processor readable recording medium for recording a computer program comprising instructions to implement a method for processing a compound gesture, made by a user by using a pointing tool on a sensitive pad for a piece of terminal equipment.