Gaze-Based UI Immersion Control for Mixed-Reality Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and leading to errors and energy waste.
Innovation Solution
The system adjusts and controls the level of immersion in user interfaces based on user gaze, allows independent control of immersion levels for different interfaces, resumes previous immersion levels upon request, and enables visibility of the physical environment through the interface, reducing the need for additional user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional input methods are used to interact with virtual reality environments, then user interaction capability is maintained, but cognitive burden increases and interaction efficiency decreases
Solution Approach 1:
The system automatically adjusts immersion levels based on detected user gaze direction without requiring explicit user commands. The electronic device monitors whether the user is looking at UI elements or the physical environment and autonomously modifies the immersive experience, eliminating the need for users to manually control immersion parameters.
Solution Approach 2:
The patent replaces traditional mechanical input devices (buttons, switches, gestures) with a gaze-based control system. Instead of requiring physical interactions to adjust immersion, the system uses optical detection of eye direction to automatically modify display characteristics, substituting mechanical control with optical sensing and automated processing.
2Reliability
If multiple input steps are required to achieve desired outcomes, then precise control is achieved, but interaction time increases and energy is wasted
Solution Approach 1:
The system continuously monitors user gaze direction in advance, preparing to adjust immersion levels before users would need to request such changes. By detecting gaze direction toward UI elements or the physical environment in real-time, the system proactively modifies display parameters, eliminating the need for users to initiate separate control actions.
Solution Approach 2:
The system implements a closed-loop feedback mechanism where user gaze direction is continuously detected and used to dynamically adjust immersion levels. This real-time feedback allows the system to respond automatically to user intent, maintaining precise control while eliminating multiple manual input steps that would otherwise be required.
3Ease of operation
If high immersion levels are maintained, then virtual environment engagement is improved, but visibility of physical environment is reduced and energy consumption increases
Solution Approach 1:
The patent implements dynamic adjustment of immersion levels based on real-time detection of user gaze direction. Instead of maintaining a static high immersion state, the system continuously adapts display characteristics - increasing immersion when users focus on virtual UI elements and decreasing immersion when users look toward the physical environment, optimizing both engagement and energy efficiency.
Solution Approach 2:
The system changes display parameters (immersion level, transparency, brightness) based on detected gaze direction. When the system detects that the user is looking at the physical environment through the display, it automatically adjusts parameters to reduce immersion and improve physical visibility, thereby reducing energy consumption while maintaining usability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In some embodiments, an electronic device emphasizes and/or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and/or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and/or physical environment of the electronic device.