Gaze-Based VR Menu Navigation Using Head Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality head-mounted displays (VR-HMDs) require manual operation for menu selection and information access, which detracts from the immersive experience and convenience, especially when multiple menu selections are needed.
Innovation Solution
A method for generating images on VR-HMDs that uses head tracking to determine the user's line-of-sight direction, allowing for automatic placement of information arrays relative to the user's gaze, eliminating the need for manual operation by displaying relevant information in a three-dimensional, gaze-centered manner.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual operation with game controller is used for menu selection, then precise control is achieved, but ease of operation deteriorates due to requiring manual input during immersive VR experience
Solution Approach 1:
The system automatically determines the selected object by detecting the line-of-sight direction from the VR-HMD, eliminating the need for manual controller operation. The VR system serves itself by using the user's natural gaze direction to identify which object should be selected, making the interaction intuitive and hands-free.
Solution Approach 2:
The patent replaces the mechanical manual operation system (game controller with buttons and joysticks) with an optical detection system (line-of-sight detection through VR-HMD tracking). This substitution allows menu selection to be performed through natural head movement and gaze direction rather than manual controller manipulation.
2Adaptability or versatility
If information is displayed in traditional 2D manner, then ease of operation is maintained, but adaptability to VR environment deteriorates
Solution Approach 1:
The patent transitions from traditional 2D information display to 3D spatial arrangement of information arrays in the virtual space. Information is positioned at multiple depths and angles relative to the user's line of sight, creating a three-dimensional information hierarchy that adapts to the immersive VR environment while maintaining accessibility through natural gaze-based selection.
3Productivity
If multiple menu selections are required, then functionality is improved, but loss of time increases due to repeated manual operations
Solution Approach 1:
The system maintains continuous menu navigation by tracking the user's line-of-sight direction in real-time as they move their head. This allows seamless transitions between different menu items and selections without interrupting the immersive VR experience, enabling multiple menu operations to be performed in a continuous, natural flow rather than through discrete manual inputs.
Data Source
AI summary
A gaze determination area is provided to an image displayed on a VR-HMD. An object that has been displayed within the gaze determination area for a time equal to or longer than a given time is determined to be a gaze object (cup object). First-level menu display objects that respectively represent first-level menu items among menu items having a hierarchical structure that are set to the object are displayed in an array in a reference direction that is defined with respect to the gaze object. When the user has turned his/her head so that the desired first-level menu display object is displayed within the gaze determination area, and the desired first-level menu display object has been detected to be the gaze object, the first-level menu item is selected, and second-level menu display objects that are lower than the selected first-level menu item are displayed.