AR/VR Hand Gesture Navigation for Nested Menu Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR/VR systems face inefficiencies in menu navigation due to the lack of physical keyboards, leading to resource waste and user fatigue from continuous pointing gestures, especially when accessing deeply nested menu options.
Innovation Solution
Implement a hand gesture-based menu navigation system that allows users to perform multiple gestures simultaneously, mapping combinations to specific functions, reducing the need for continuous navigation and resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users navigate through menu options using continuous pointing gestures in AR/VR systems, then menu navigation can be performed, but user fatigue increases and time consumption increases
Solution Approach 1:
The system pre-configures gesture-to-menu-item mappings before user interaction. When a user performs a gesture, the system immediately translates it to the corresponding menu item without requiring sequential navigation through multiple menu levels. This preliminary mapping of gestures to functions enables direct access to menu options, significantly reducing navigation time and eliminating the need for continuous pointing through multiple levels.
2Ease of operation
If users continuously point to navigate through menu options, then menu navigation is achieved, but resource consumption increases
Solution Approach 1:
The patent replaces the mechanical/physical continuous pointing gesture system with a gesture-recognition-based system. Instead of requiring continuous tracking of finger movements through multiple menu levels, the system captures discrete hand gestures (such as hand shapes or movements) and translates them directly to menu selections. This substitution reduces the computational burden of continuous gesture tracking while achieving the same navigation function more efficiently.
3Productivity
If physical keyboards are used for menu navigation, then navigation efficiency is improved, but device complexity increases
Solution Approach 1:
The system creates a virtual representation of keyboard functionality through gesture recognition. Instead of physically incorporating a keyboard into the AR/VR device, the system copies the functional capability of a keyboard by mapping hand gestures to keyboard-like navigation patterns. Users can press virtual 'keys' through gesture movements, achieving keyboard-level efficiency without the physical complexity of a real keyboard hardware component.
Data Source
AI summary
Aspects of the present disclosure involve a system for navigating menus and selecting options using hand gestures. The system detects a first hand gesture depicted in a video, the first hand gesture performed by a first hand of a person. The system, in response to detecting the first hand gesture, accesses a first menu comprising a plurality of options. The system detects, within a threshold period of time from when the first hand gesture is detected, a second hand gesture depicted in the video. The system, in response to detecting, within the threshold period of time from when the first hand gesture is detected, the second hand gesture, performs an operation associated with an individual option of the plurality of options of the first menu.