Gaze-Activated HUD Interface with Head Pose Confirmation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for interacting with computer-generated content in extended reality (XR) environments often result in inadvertent activations of heads-up display (HUD) interfaces, leading to degraded user experience and increased power consumption.
Innovation Solution
The use of a combination of gaze vector and head pose information to activate a HUD interface in an XR environment, where the device displays the HUD interface only when the user gazes in a specific direction and performs a corresponding head motion, thereby reducing false positives and enhancing user training.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gaze-based activation is used to control HUD interface, then ease of operation is improved, but reliability deteriorates due to inadvertent activations
Solution Approach 1:
The patent applies dynamics by transitioning from a static gaze-based activation system to a dynamic multi-modal input system. The system now requires sequential inputs (gaze followed by head motion or voice command) to activate the HUD interface, making the activation process adaptive and context-aware rather than relying on a single static gesture that can be accidentally triggered.
Solution Approach 2:
The patent introduces an intermediary confirmation step between gaze detection and HUD activation. Instead of direct activation, the system uses head motion or voice commands as intermediary actions that confirm user intent. This intermediary layer filters out inadvertent activations while preserving ease of operation for intentional commands.
2Ease of operation
If HUD interface is activated frequently to improve user experience, then ease of operation is improved, but use of energy increases
Solution Approach 1:
The patent changes the activation parameters from a single gesture to a multi-step sequence requiring gaze plus additional confirmation (head motion or voice command). This parameter change reduces the frequency of false activations while maintaining accessibility, thereby optimizing the balance between user experience and power consumption by ensuring the energy-intensive HUD interface is activated only when truly needed.
3Device complexity
If single gesture activation is used, then device complexity is reduced, but reliability deteriorates due to false positives
Solution Approach 1:
The patent segments the activation process into distinct phases: gaze detection phase, confirmation phase (head motion or voice command), and execution phase. This segmentation divides the single complex activation gesture into multiple simpler, more reliable steps, reducing false positives while maintaining manageable system complexity through modular processing.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods for using a gaze vector and head pose information to activate a display interface in an environment. In some implementations, a device includes a sensor for sensing a head pose of a user, a display, one or more processors, and a memory. In various implementations, a method includes displaying an environment comprising a field of view. Based on a gaze vector, it is determined that a gaze of the user is directed to a first location within the field of view. A head pose value corresponding to the head pose of the user is obtained. On a condition that the head pose value corresponds to a motion of the head of the user toward the first location, a user interface is displayed in the environment.