Eye-Gaze Tracking Handoff in Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Eye-Gaze Tracking (EGT) systems in virtual, augmented, and mixed reality applications face challenges in seamlessly transitioning between different EGT systems, particularly when users switch between Head-Mounted Devices (HMDs) and external displays, due to variations in processing capabilities, ambient light conditions, and battery levels, leading to inconsistencies in gaze tracking accuracy and user experience.
Innovation Solution
The implementation of a system and method that detects specific events, such as user interaction, distance from the external display, and ambient light levels, to dynamically select between the EGT system on the HMD and the external display, ensuring optimal gaze vector capture and rendering engine input, thereby enhancing EGT handoff and user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the EGT system on the HMD is used, then gaze tracking is available during immersive experience, but processing capability and battery life are limited
Solution Approach 1:
The patent introduces an event handler as an intermediary component that coordinates between the HMD EGT system and external display EGT system. This mediator detects contextual events (battery level, processing load, user interaction) and dynamically switches between EGT sources, allowing the system to leverage the external display's resources when appropriate while maintaining gaze tracking functionality throughout.
2Power
If the EGT system on the external display is used, then processing capability is sufficient, but seamless transition during immersive experience is difficult
Solution Approach 1:
The patent implements dynamic switching between EGT systems based on real-time detection of contextual events. The system adapts its EGT source selection according to current operating conditions (battery level, processing load, user interaction state, ambient light), enabling seamless transitions that maintain immersive experience while leveraging appropriate processing resources.
Solution Approach 2:
The event handler continuously monitors system state (battery level, processing load, user interaction) and uses this feedback to determine when to switch between EGT systems. This feedback mechanism ensures that transitions occur at optimal moments, maintaining immersive experience while adapting to changing system conditions.
3Productivity
If dynamic switching between EGT systems is implemented, then optimal performance is achieved, but system complexity increases
Solution Approach 1:
The patent segments the EGT functionality into distinct components: the HMD EGT system, the external display EGT system, and an event handler coordinator. This segmentation allows each component to operate independently while maintaining clear interfaces, simplifying the overall system architecture despite the dynamic switching capability.
Data Source
AI summary
Embodiments of systems and methods for Eye-Gaze Tracking (EGT) handoff are described. In an illustrative, non-limiting embodiment, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: detect an event during a virtual, augmented, or mixed reality (xR) application, where a user wears a Head-Mounted Device (HMD) comprising a first Eye-Gaze Tracking (EGT) system, and where the user operates an external display comprising a second EGT system; and in response to the event, select the first or second EGT system.