Virtual Construct Gestures for Precise Free-Space Interface Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current input mechanisms such as mice, touch pads, and touch screens are cumbersome, inconvenient, and often require users to be in close proximity to the device, leading to restricted motion and discomfort, with touch detection being unreliable and prone to errors.
Innovation Solution
A system that interprets the motions and position of control objects relative to virtual control constructs in free space, allowing for engagement and disengagement gestures to control user interfaces without physical contact, using image-capture devices to track and map movements to virtual controls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based control is used, then ease of operation is improved, but measurement precision deteriorates due to finger size causing erroneous selection
Solution Approach 1:
The patent replaces physical touch contact with optical field-based gesture recognition. Image capture devices detect hand and finger positions, orientations, and movements through optical fields, eliminating the need for physical contact with the device surface. This allows precise gesture recognition without the precision loss inherent in touch-based control where fingers naturally cover multiple interface elements.
2Ease of operation
If mice are used for control, then ease of operation is improved, but device complexity increases due to required flat surface and mouse pad
Solution Approach 1:
The patent extracts the control function from physical input devices like mice and touch pads, placing it directly into the three-dimensional space above the display. Gesture recognition occurs in free space using optical tracking, eliminating the need for separate physical control devices, flat surfaces, or specialized mouse pads. The display surface itself becomes both the interaction plane and the control interface.
Solution Approach 2:
The display screen serves multiple functions simultaneously: it displays visual content, acts as the reference plane for gesture recognition, and provides the interface for control operations. The same optical field that captures the display also tracks hand gestures, eliminating the need for separate control device surfaces and reducing overall system complexity.
3Ease of operation
If touch screens are used, then ease of operation is improved, but reliability deteriorates due to unreliable touch detection requiring repeated motions
Solution Approach 1:
The patent replaces mechanical touch detection with optical field-based gesture recognition. Image capture devices continuously track hand and finger positions, orientations, and movements through optical fields, providing reliable detection without the reliability issues of touch screens. The optical system can detect gestures from a distance with high consistency, eliminating the need for repeated motions to ensure proper detection.
4Ease of operation
If mice are positioned sub-optimally, then ease of operation deteriorates, but device complexity increases to accommodate multiple positioning options
Solution Approach 1:
The patent transitions control from a two-dimensional surface (mouse pad or keyboard surface) to three-dimensional free space above the display. Users can perform gestures at various distances and angles from the screen, providing natural ergonomic positioning without requiring optimal mouse placement. The optical tracking system captures gestures from multiple spatial positions, eliminating the need for complex positioning mechanisms or multiple device configurations.
Data Source
AI summary
During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The technology disclosed includes determining from the motion information whether a motion of the control object with respect to the virtual control construct is an engagement gesture, such as a virtual mouse click or other control device operation. The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.