Head-Mounted AR Display Control for Motion Blur and Vergence Comfort
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Challenges exist in producing augmented reality technology that facilitates a comfortable, natural-feeling, rich presentation of virtual image elements amidst real-world imagery due to complexities in human visual perception.
Innovation Solution
A display system with a wearable or head-mounted device that includes an imaging device and a processor to capture images, determine motion blur, and adjust operating parameters to enhance user perceptibility, such as changing exposure times or wavefront divergence based on user eye movements and accommodation-vergence mismatches.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the display system presents virtual content with high brightness and contrast to improve visibility, then the virtual content becomes more perceptible, but it causes increased visual discomfort and accommodation-vergence conflicts for the user
Solution Approach 1:
The display system dynamically adjusts wavefront divergence based on detected user eye movements and accommodation state. When a saccade is detected, the system changes wavefront divergence to reduce accommodation-vergence conflict, making the virtual content brightness and focus adaptable rather than static, thereby reducing visual discomfort while maintaining perceptibility
Solution Approach 2:
The system changes the wavefront divergence parameter in response to detected saccades. By modifying this optical parameter dynamically, the display adapts the light path to match the user's natural eye movement patterns, reducing the harmful accommodation-vergence conflict that arises from fixed high-contrast virtual content presentation
2Illumination intensity
If the imaging device captures images with longer exposure time to improve image quality, then more light is captured for better visibility, but motion blur increases reducing image sharpness
Solution Approach 1:
The imaging device dynamically adjusts exposure time based on detected eye movement states. When a saccade is detected, the system shortens exposure time to freeze motion and maintain sharpness; during stable fixation periods, exposure time is extended to capture sufficient light, making the exposure parameters adaptive rather than static
Solution Approach 2:
The system uses feedback from eye movement detection to control imaging parameters. The imaging device monitors for saccades and adjusts exposure time accordingly, creating a closed-loop system where image capture parameters are continuously optimized based on real-time eye movement feedback
3Device complexity
If the display system maintains fixed operating parameters to simplify device control, then device complexity is reduced, but it cannot adapt to user eye movements causing accommodation-vergence mismatches
Solution Approach 1:
The display system implements feedback control by monitoring user eye movements and automatically adjusting wavefront divergence. The imaging device detects saccades and feeds this information back to the display controller, which then modifies operating parameters, creating an adaptive system that responds to user behavior without requiring complex manual control
Solution Approach 2:
The system performs self-adjustment of display parameters based on automatic eye movement detection. Rather than requiring external control input, the system autonomously monitors its own usage context through eye tracking and adjusts wavefront divergence independently, making the complex adaptation transparent to the user
4Adaptability or versatility
If the system adjusts wavefront divergence frequently to match user eye movements, then accommodation-vergence matching is improved, but visual perceptibility of the adjustments may become noticeable causing distraction
Solution Approach 1:
The system performs wavefront divergence adjustments during saccades, which are natural blind periods in eye movement. By timing the adjustments to coincide with when the user's vision is naturally reduced during eye transitions, the system preemptively makes changes that would otherwise be perceptible, thereby improving accommodation-vergence matching without distracting the user
Data Source
AI summary
Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.