3D Gesture UI for Intuitive Item Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interfaces, such as tactile devices and touch screens, require direct physical interaction, limiting intuitive and efficient interaction with multiple interactive items on a display, especially in three-dimensional space.
Innovation Solution
A non-tactile zoom-based user interface utilizing three-dimensional sensing technology, where a 3D sensor captures hand movements to associate and manipulate interactive items on a display, allowing users to select and resize items through continuous gestures, enabling intuitive interaction without precise aiming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If tactile interface devices (keyboard, mouse, joystick) are used, then direct physical interaction is achieved, but interaction intuitiveness and efficiency are limited
Solution Approach 1:
The patent replaces mechanical tactile input devices (keyboard, mouse, joystick) with a 3D sensing system that captures hand gestures in three-dimensional space. The depth-perceptive sensor detects hand position, orientation, and movement without physical contact, substituting mechanical interaction with optical/depth-based sensing to improve both intuitiveness and efficiency
Solution Approach 2:
The patent transitions from two-dimensional touch screen interaction to three-dimensional gesture recognition by incorporating depth perception. The 3D sensor captures spatial coordinates (x, y, z) and hand orientation, adding a dimensional aspect to user interaction that enables more intuitive and efficient control
2Adaptability or versatility
If touch screens are used, then direct physical contact detection is achieved, but interaction is limited to the display surface
Solution Approach 1:
The patent extends interaction beyond the two-dimensional display surface into three-dimensional space by using depth-perceptive sensors to detect hand gestures at various distances from the display. This allows users to interact with the interface using natural hand movements in 3D space rather than requiring physical contact with the screen surface
Solution Approach 2:
The patent introduces a 3D sensing field as an intermediary between the user and the display interface. The depth sensor creates a virtual interaction zone in 3D space that mediates between the user's hand gestures and the on-screen elements, eliminating the need for direct physical contact while maintaining versatile interaction capabilities
3Ease of operation
If 3D gesture recognition is implemented, then intuitive hand gesture control is achieved, but precise aiming becomes unnecessary
Solution Approach 1:
The patent applies partial action by detecting only the essential features of hand gestures (position, orientation, movement direction) rather than requiring precise aiming at specific screen coordinates. The system interprets gross hand movements and directional gestures without demanding high precision in hand positioning, reducing the aiming precision requirement while maintaining adequate measurement accuracy for effective control
Data Source
AI summary
A user interface method, including presenting by a computer executing a user interface, multiple interactive items on a display. A first sequence of images is captured indicating a position in space of a hand of a user in proximity to the display, and responsively to the position, one of the interactive items is associated with the hand. After associating the item, a second sequence of images is captured indicating a movement of the hand, and responsively to the movement, a size of the one of the items is changed on the display.