Velocity Field Gesture Control for 3D Free-Space Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Interpreting user gestures in a three-dimensional (3D) free space in front of a device is challenging due to the lack of clear indication of engagement and determining the specific portion or hierarchical level of interaction, especially when using gestures in 3D space.
Innovation Solution
The technology senses a control object's movement and orientation in a 3D sensor space, defines a control plane tangential to its surface, and interprets gestures based on the movement's normality or parallelism to this plane, allowing navigation of multi-layer presentation trees and control of virtual objects without requiring the object to exit the sensor space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gestures are interpreted in 3D free space, then interaction versatility is improved, but gesture interpretation accuracy deteriorates due to lack of clear engagement indication
Solution Approach 1:
The patent transitions from 2D touch screen interaction to 3D free space interaction by introducing depth as an additional dimension. The control object moves in three-dimensional space in front of the touch screen, allowing gestures to be performed without physical contact. This dimensional expansion enables versatile interactions while the system resolves accuracy challenges through velocity field analysis and control plane definitions that interpret gesture intent in 3D space.
Solution Approach 2:
The patent introduces a control object (such as a virtual cursor or pointer) as an intermediary between the user's hand gestures and the interface elements. This control object serves as a mediator that translates 3D gestures into meaningful commands, providing clear engagement indication through its position, velocity, and orientation relative to the touch screen and interface elements.
2Productivity
If control object remains in sensor space, then interaction efficiency is improved, but control precision deteriorates without clear engagement indication
Solution Approach 1:
The patent implements feedback mechanisms where the control object's velocity field and trajectory provide continuous information about gesture progress and intent. The system analyzes the control object's movement characteristics (velocity, acceleration, direction) to determine engagement status and gesture completion, providing precise control indication without requiring the control object to exit the sensor space.
Solution Approach 2:
The patent uses parameter changes in the control object's motion (velocity, orientation, position) to indicate different interaction states. By monitoring changes in these parameters, the system can distinguish between browsing, selecting, and confirming actions, achieving precise control interpretation while maintaining the control object within the sensor space throughout the interaction.
3Measurement precision
If velocity field interaction is implemented, then gesture interpretation accuracy is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal velocity field analysis mechanism that handles multiple gesture types (browsing, scrolling, selecting, confirming) through a single integrated framework. The same control object and velocity field analysis principles apply across different interaction contexts, reducing the need for separate recognition systems for each gesture type while maintaining high interpretation accuracy.
Data Source
AI summary
The technology disclosed relates to automatically interpreting motion of a control object in a three dimensional (3D) sensor space by sensing a movement of the control object in the (3D) sensor space, interpreting movement of the control object, and presenting the interpreted movement as a path on a display. The path may be displayed once the speed of the movement exceeds a pre-determined threshold measured in cm per second. Once the path is displayed, the technology duplicates a display object that intersects the path on the display. In some implementations, the control object may be a device, a hand, or a portion of a hand (such as a finger).