Head-Mounted Display Frame Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The frame refresh rate of head-mounted displays in interactive systems is limited by bandwidth constraints, leading to increased frame latency and delayed frame rendering when the user's head moves.
Innovation Solution
An interactive display system that generates a current frame using current state information, a previous frame, and frame pixel depth information, improving frame refresh rate and reducing latency by allowing the head-mounted display to adjust frames instantly in response to user motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the frame refresh rate of head-mounted display is increased, then the frame latency is reduced and the display responsiveness is improved, but the bandwidth requirement of connection interface increases
Solution Approach 1:
The electronic device performs preliminary rendering of frames and transmits them to the head-mounted display in advance. The head-mounted display then generates additional frames locally using depth information and motion data, eliminating the need to transmit all frames over the connection interface and reducing bandwidth requirements while maintaining high refresh rates
Solution Approach 2:
The head-mounted display creates copies of frame data by generating intermediate frames through depth buffer information and motion compensation algorithms. This allows the system to produce multiple display frames from a single transmitted frame, effectively increasing the frame refresh rate without proportionally increasing bandwidth consumption
2Loss of time
If the frame refresh rate is increased to reduce frame latency, then the display responsiveness to head motion is improved, but the complexity of the display system increases
Solution Approach 1:
The patent extracts the frame generation function from the electronic device and transfers it to the head-mounted display. By taking out the complex rendering computations from the external device and performing them locally using depth buffers and motion data, the system reduces frame latency while distributing computational complexity to where it is most needed
Solution Approach 2:
The head-mounted display serves itself by generating frames locally using its own depth buffer and motion sensing capabilities. This self-service approach allows the display to maintain high refresh rates and low latency without being bottlenecked by external device processing speed or connection bandwidth
Data Source
Figure 1
Figure 2
AI summary
Interactive display system and method are provided, and the interactive display system includes a head-mounted display and an electronic device. The head-mounted display is configured to be worn by a user. The electronic device generates a previous frame and frame pixel depth information and transmits the previous frame and the frame pixel depth information to the head-mounted display so that the head-mounted display displays the previous frame. The head-mounted display generates current state information in response to a motion of the user and generates a current frame according to the current state information, the previous frame and the frame pixel depth information. The head-mounted display displays the current frame.