Compensatory Image Rendering for HMD Swift-Eye Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) face latency issues in pupil steering systems, leading to misalignment between display light and pupil position during swift-eye movements, causing vignetting, reduced image resolution, and changes in luminance, which can result in an incomplete or distorted virtual image for the user.
Innovation Solution
A secondary display renders a compensatory image with a similar luminance and spatial frequency spectrum to the primary display, presenting it briefly during swift-eye movements until the primary display can realign with the pupil, using a pseudo-random pattern to minimize noticeable disruptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a steerable display is used to direct display light to the pupil, then image quality can be maintained during eye movements, but latency occurs during swift-eye movements causing misalignment between display light and pupil position
Solution Approach 1:
The system predicts future pupil position based on current eye movement trends and pre-positions the display light accordingly, performing the steering action in advance of the actual pupil arrival at the predicted position. This reduces latency by eliminating the wait time for detection-feedback-steering cycles during rapid eye movements.
Solution Approach 2:
The pupil steering mechanism transitions from static positioning to dynamic adaptive steering that responds to detected eye movement patterns. The system continuously adjusts display light direction based on real-time pupil position feedback, enabling the display to track and maintain alignment with a moving pupil during swift-eye movements.
2Stability of the object's composition
If the display light is steered to track pupil position, then image continuity is maintained, but vignetting and reduced image resolution occur during swift-eye movements
Solution Approach 1:
The system pre-positions display light to anticipate where the pupil will be during swift-eye movements, ensuring the full image remains within the display light cone before the pupil arrives. This prevents vignetting and maintains image resolution by avoiding the need for last-minute steering adjustments that would truncate the image.
Solution Approach 2:
The system uses real-time pupil position detection feedback to continuously adjust steering commands, ensuring the display light remains properly aligned with the pupil throughout eye movements. This closed-loop control maintains both image continuity and resolution by correcting any misalignment that would cause vignetting.
3Measurement precision
If the pupil steering system responds to swift-eye movements, then image alignment is maintained, but the response time is insufficient leading to incomplete virtual image presentation
Solution Approach 1:
The system performs preliminary positioning of display light based on predicted pupil trajectories during swift-eye movements. By anticipating where the pupil is heading and pre-adjusting the display light direction, the system achieves accurate tracking without being limited by response time delays in detection and actuation.
Solution Approach 2:
The pupil steering system operates dynamically with continuous real-time adjustment capabilities, transitioning from discrete step responses to smooth continuous tracking. This enables the system to maintain precise pupil position alignment during rapid eye movements by constantly adapting to changing eye positions rather than reacting with delayed discrete corrections.
Data Source
AI summary
An image is rendered to a display of a head mounted display. A swift-eye movement is identified. A compensatory image is rendered to a secondary display in response to identifying the swift-eye movement.