Selective Peripheral Display Rendering for Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional mixed-reality computer systems face limitations in rendering detailed peripheral visual content, leading to discomfort and unnecessary burdens on computer systems due to the use of low-resolution sparse peripheral displays, which are continuously active and not adapted to user behavior.
Innovation Solution
The system selectively renders peripheral visualizations based on detected user movements and focus, activating only salient elements with low-resolution peripheral displays initially set to an 'off' configuration, reducing power consumption and improving the natural feel of the mixed-reality environment by dynamically illuminating pixels in response to user interaction and scene changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sparse peripheral displays are continuously active to provide contextual awareness, then user comfort and situational awareness are improved, but power consumption and system operational burden increase
Solution Approach 1:
The peripheral display system transitions from a static continuous operation mode to a dynamic adaptive mode. The display dynamically adjusts its activation state based on real-time detection of user movements and scene changes, activating only when necessary to provide contextual awareness while conserving power during stable periods
Solution Approach 2:
The system changes the operational parameter of the peripheral display from a constant 'on' state to a variable state controlled by detection thresholds. By monitoring user movement parameters and scene change parameters, the system adjusts display activation to match actual informational needs, reducing unnecessary power consumption while maintaining reliability
2Reliability
If sparse peripheral displays are continuously active to provide contextual awareness, then user comfort and situational awareness are improved, but unnecessary distractions and system burden increase
Solution Approach 1:
The system implements a feedback mechanism where user movements and scene changes are continuously detected and fed back to control the peripheral display activation. This closed-loop control ensures the display activates only when there is actual informational value to convey, eliminating unnecessary distractions while maintaining contextual awareness
Solution Approach 2:
The system performs preliminary detection of user movements and scene changes before activating the peripheral display. By anticipating when contextual information will be needed through movement detection, the system activates the display proactively only when relevant, preventing unnecessary distractions while ensuring awareness is available when needed
3Loss of information
If detailed peripheral visual content is rendered to improve user experience, then visual information quality is improved, but processing burden and system complexity increase
Solution Approach 1:
The system applies different quality levels to different regions of the visual field. High-resolution rendering is applied only to the central foveal region where the user is directly looking, while peripheral regions use lower resolution or are completely disabled when not needed. This local differentiation reduces overall processing burden while maintaining visual information quality where it matters most
Solution Approach 2:
The system renders visual content partially rather than completely across the entire peripheral display. By activating only the necessary portion of the peripheral display based on detected user movements and scene relevance, the system reduces processing burden while providing sufficient visual information quality for the current context
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Peripheral visualizations are based on user movements and/or interactions with elements in a scene. Various user movements are detected while a scene is being rendered. Afterwards, the embodiments determine whether one of the movements corresponds with an increase in a level of focus by the user to the one or more elements and/or an interaction by the user with the one or more elements. Thereafter, peripheral visualizations are rendered on one or more peripheral displays proximate elements that correspond with the user movements/interactions/focus. In some instances, the selective rendering is performed in response to a determination that the user movement does correspond with the increase in the level of focus by the user to the one or more elements and/or the interaction by the user with the one or more elements.