Local Coordinate Frame for Multitouch Finger Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multitouch-enabled devices are unable to distinguish between fingers and are limited to performing single actions with gestures, lacking the capability to detect which finger or fingers are used for a gesture, restricting the complexity and versatility of user interactions.
Innovation Solution
A local coordinate frame user interface is provided, allowing users to place all five digits on a multitouch device to create five input points, which are detected and mapped to specific fingers, enabling the construction of a coordinate frame that is agnostic to finger order, orientation, and hand used, allowing for continuous motion detection and update, and enabling digit-specific user interface elements to be displayed and manipulated.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional gesture recognition is used, then the device can perform basic gestures, but it cannot distinguish which finger or fingers are used for the gesture
Solution Approach 1:
The patent segments the hand into five distinct digits (thumb, index, middle, ring, and pinky fingers) and assigns a unique identifier to each digit. The system tracks each digit independently by monitoring its position and movement patterns, enabling precise identification of which specific fingers are used for gestures while maintaining manageable system complexity through modular tracking approaches.
Solution Approach 2:
The patent introduces an intermediary coordinate system that maps physical finger positions to virtual control locations. This intermediary layer translates complex multi-finger touch data into meaningful gesture commands, allowing the system to identify specific fingers without requiring overly complex direct detection mechanisms.
2Adaptability or versatility
If gestures are made agnostic to which finger is used, then the interface is simpler, but the versatility of user interactions is limited
Solution Approach 1:
The patent assigns different functional properties to different fingers, creating a local quality differentiation where each finger can trigger specific actions or controls. For example, the thumb might control playback functions while the index finger controls volume, allowing versatile interactions without requiring a complex overall interface structure.
Solution Approach 2:
The patent creates a universal finger identification framework that can be applied across multiple applications and gesture types. The same finger tracking infrastructure supports various gesture complexities from simple single-finger taps to complex multi-finger chords, providing versatility while reusing the same core detection mechanisms.
3Ease of operation
If digit-specific controls are displayed, then user interaction becomes more intuitive, but the interface requires more elements to manage
Solution Approach 1:
The patent implements dynamic control panels that adapt their content and layout based on which fingers are currently active. When a user places specific fingers on the screen, the system dynamically generates and displays relevant controls for those fingers, keeping the interface simple at any given moment while providing comprehensive functionality when needed.
Solution Approach 2:
The patent pre-defines a library of possible controls and actions associated with each finger. When a user places their hand on the screen, the system preliminarily prepares and displays the relevant controls before the user actually interacts with them, reducing the cognitive load of managing interface elements by having options ready in advance.
Data Source
AI summary
Methods and apparatus for providing a local coordinate frame are described. A user may place the tips of all five digits on a multitouch user interface with a natural gesture to provide five touch points. A local coordinate frame may be constructed from the touch points. A local coordinate frame may be computed relative to the entire hand and/or relative to each individual digit. The technique may be agnostic in regard to the orientation of the device and to which hand is used. The user may move or rotate their hand, and the local coordinate frame is adjusted to the new positioning relative to the device. The technique may also infer a relative position of the palm from the digit input points, allowing the display of user interface elements where the elements are visible rather than occluded by the hand.