Attention-Driven OST Rendering for Lower-Power Object Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing optical see-through (OST) display systems face challenges in reducing energy consumption while maintaining visibility of computer-generated objects, particularly when background light is significant, as they often focus on removing perceivable details rather than adjusting object appearance based on user attention.
Innovation Solution
The system predicts which computer-generated objects are outside the user's focus and adjusts their appearance to reduce energy consumption by changing display characteristics, such as reducing illumination, rendering quality, or switching to secondary displays, ensuring perceptible differences for the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the rendering quality and illumination of computer-generated objects are maintained at high levels, then the visibility and user experience are improved, but the energy consumption increases
Solution Approach 1:
The patent applies local quality by differentiating the rendering quality and illumination levels of computer-generated objects based on their spatial relationship to the user's focal point. Objects within the focal region are rendered with high quality and full illumination, while objects outside the focal region use reduced rendering quality and lower illumination, thereby reducing overall energy consumption while maintaining visibility where needed.
Solution Approach 2:
The system dynamically adjusts the appearance and rendering parameters of computer-generated objects in real-time based on the user's changing gaze and attention. As the user moves their focus between different objects, the rendering quality and illumination levels are dynamically modified to match the current focal state, optimizing energy consumption adaptively rather than using static settings.
2Use of energy by moving object
If the rendering quality of computer-generated objects is reduced to save energy, then the energy consumption decreases, but the visibility and perceptibility of objects deteriorates
Solution Approach 1:
The patent ensures reliability of object visibility by applying high rendering quality and full illumination to objects within the user's focal region, while using reduced quality only for objects outside the focal region. This localized approach maintains perceptibility where the user is actually looking while reducing energy consumption for peripheral objects.
Solution Approach 2:
The system performs preliminary rendering of objects in reduced quality states before they enter the focal region, and pre-prepares high-quality rendering for objects predicted to enter the focal region. This allows smooth transitions between quality states without noticeable artifacts or delays, maintaining perceived reliability.
3Use of energy by moving object
If foveated rendering is applied to reduce energy consumption, then the energy efficiency improves, but the complexity of the rendering system increases
Solution Approach 1:
The patent integrates foveated rendering functionality into the existing rendering pipeline, allowing the same rendering system to handle both standard and foveated rendering modes. The system uses a unified approach that combines gaze tracking data with the rendering process, rather than requiring separate dedicated systems, thereby reducing overall complexity while achieving energy savings.
Solution Approach 2:
The system introduces an intermediary layer that processes gaze information and translates it into rendering parameter adjustments. This intermediary module acts as a bridge between the gaze tracking system and the rendering engine, simplifying the integration by providing a standardized interface rather than requiring direct complex interactions between multiple subsystems.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Various implementations disclosed herein include devices, systems, and methods that are capable of adjusting the appearance of computer-generated objects (e.g., augmentations) that are predicted to be outside the current focus of an optical-see-through HMD user's attention. In some implementations, a method includes displaying a first computer-generated object and a second computer-generated object on an optical-see-though display of a HMD. In some implementations, the first computer-generated object is identified based on a prediction that the attention of a user is directed to the first computer-generated object, and an appearance of the second computer-generated object is adjusted to change from a first state to a second state.