Head-Mounted Display Motion-to-Photon Latency Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays often experience motion-to-photon latency issues, which can cause user discomfort, including motion sickness and nausea, due to delays in updating visual content in response to user head movements, and other factors like pixel persistence, frame jerkiness, and audio/video synchronization problems.
Innovation Solution
A method and apparatus for testing head-mounted displays that captures images, moves the display, and calculates motion-to-photon latency by comparing image content changes over time, using a test bed with a movement encoder and image sensor to determine the time difference between physical movement and visual updates, while also assessing pixel persistence, frame jitter, and audio/video synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If the display updates visual content quickly to reduce motion-to-photon latency, then user comfort improves, but processing complexity and synchronization requirements increase
Solution Approach 1:
The system performs preliminary actions by pre-synchronizing audio and video streams, pre-processing motion data from sensors, and pre-buffering visual content before it is needed. This allows the display to update visual content quickly without introducing additional latency, as the processing is already completed or in progress. The test bed similarly performs preliminary measurements of motion-to-photon latency to enable proactive adjustments.
Solution Approach 2:
The system continuously monitors motion-to-photon latency through testing and uses this feedback to adjust processing priorities, buffer sizes, and synchronization parameters. The test bed measures latency and provides feedback that enables the display system to optimize its performance dynamically, balancing speed with processing complexity.
2Illumination intensity
If pixel persistence time is increased to improve brightness and contrast, then image quality improves, but motion blur increases causing user discomfort
Solution Approach 1:
The system dynamically adjusts pixel persistence time based on the detected motion state. When the user is stationary or moving slowly, pixel persistence is increased to improve brightness and contrast. When rapid head movements are detected, pixel persistence is reduced to minimize motion blur. This dynamic adjustment is enabled by continuous motion sensing and real-time parameter modification.
Solution Approach 2:
The system changes the pixel persistence parameter adaptively based on viewing conditions and motion state. By modifying this temporal parameter in response to measured motion-to-photon latency and detected head movement, the system optimizes the balance between image quality and motion artifact reduction.
3Speed
If frame update speed is increased to reduce frame jerkiness, then visual smoothness improves, but processing load and energy consumption increase
Solution Approach 1:
The system uses periodic frame updates synchronized with the display refresh rate and motion detection cycles. Instead of continuous high-speed updates, frames are updated at optimized intervals that maintain visual smoothness while reducing unnecessary processing. The test bed similarly uses periodic measurements to monitor frame jerkiness and adjust update timing.
Solution Approach 2:
The processing system handles multiple functions simultaneously including motion detection, frame rendering, audio synchronization, and latency measurement in a unified pipeline. This multi-functionality reduces overall processing load by consolidating operations and sharing computational resources across different tasks.
4Reliability
If audio and video streams are strictly synchronized to improve viewing experience, then perceptual quality improves, but system complexity and synchronization requirements increase
Solution Approach 1:
The system creates a copy of the video frame buffer and compares it with the previously displayed frame to detect motion and determine when updates are necessary. This copying mechanism enables precise synchronization tracking without requiring complex real-time analysis, as the comparison of frame copies provides sufficient information for maintaining audio-video sync.
Solution Approach 2:
Audio and video streams are pre-synchronized during content preparation and buffering, with timing metadata embedded in advance. This preliminary synchronization reduces the complexity of real-time synchronization during playback, as the system only needs to maintain the pre-established timing relationship rather than continuously adjust it.
Data Source
AI summary
Testing a head mounted display includes capturing a set of images shown by a display element; moving the display; and receiving motion information of the movement. A moment of time of the movement is detected as a first time instance. Contents of at least two images of the set of images are compared to determine whether at least a part of the information shown by the display element has been moved to another location. The comparison results are provided as a motion information of the image content. Movement in the set of images is detected on the basis of the motion information of the image content. The moment of the movement in the set of images is detected as a second time instance. A motion to photon latency is determined on the basis of the time difference between the second time instance and the first time instance.