Indirect Multi-Touch Interaction Visual Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current indirect interaction techniques are not well suited for multi-touch input, as users cannot clearly visualize their gestures, leading to inaccurate inputs and limited support for reliable multi-touch gestures.
Innovation Solution
The use of cursors and touch regions that provide visual feedback on the relative positions of the user's digits, allowing users to understand and visualize multi-touch inputs, with the cursor and touch region moving together in the user interface based on data from cursor control devices and digit movement sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multi-touch input is used with indirect interaction devices, then the user can perform complex gestures, but the user cannot clearly visualize the gestures leading to inaccurate inputs
Solution Approach 1:
The patent implements visual feedback by displaying a touch region with digit representations that mirror the user's finger positions on the indirect interaction device. This feedback loop allows users to see exactly how their physical gestures are being interpreted in the digital domain, enabling them to adjust and refine their input accuracy while performing complex multi-touch gestures.
Solution Approach 2:
The patent creates a visual copy of the user's physical finger positions by rendering representations of digits within the touch region. This digital replica allows users to visualize and verify their gesture configuration without directly touching the display, bridging the gap between indirect physical input and digital interpretation.
2Adaptability or versatility
If multi-touch gestures are supported on indirect interaction devices, then gesture complexity increases, but visualizability of gestures decreases
Solution Approach 1:
The patent introduces an intermediary visual representation system between the indirect interaction device and the user interface. The touch region with digit representations acts as a mediator that translates complex multi-touch gestures into visible, understandable forms, allowing users to comprehend sophisticated gestures without direct visual contact with the interaction device.
3Ease of operation
If traditional cursor control is used, then simple pointing is achieved, but fine motor control of fingers and thumb cannot be utilized
Solution Approach 1:
The patent segments the traditional unified cursor into multiple independent digit representations within the touch region. Each finger and thumb can be independently represented and controlled, allowing fine motor control of individual digits while maintaining the overall cursor positioning capability. This segmentation enables simultaneous control of multiple degrees of freedom that were previously unavailable in traditional pointing devices.
Data Source
AI summary
Indirect multi-touch interaction is described. In an embodiment, a user interface is controlled using a cursor and a touch region comprising a representation of one or more digits of a user. The cursor and the touch region are moved together in the user interface in accordance with data received from a cursor control device, such that the relative location of the touch region and the cursor is maintained. The representations of the digits of the user are moved in the touch region in accordance with data describing movement of the user's digits. In another embodiment, a user interface is controlled in a first mode of operation using an aggregate cursor, and switched to a second mode of operation in which the aggregate cursor is divided into separate portions, each of which can be independently controlled by the user.