Localized Image Refresh for VR Display Lag Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR head-mounted display devices suffer from a low refresh rate of 60 Hz, causing perceptible lag and diminishing the immersiveness of the user experience, and increasing the refresh rate can lead to data processing burdens and user fatigue.
Innovation Solution
The method involves localized image processing through interpolation, where a display device acquires an image with higher and lower resolution sub-images, determines an interpolated sub-image based on the difference between frames, and refreshes only the localized area with the interpolated image, maintaining the same backlight brightness, to enhance the refresh rate and smoothness without increasing data processing load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the refresh rate is increased to reduce perceptible lag and enhance immersiveness, then the display smoothness improves, but the data processing burden increases
Solution Approach 1:
The display screen is divided into a first area corresponding to the user's gaze point and a second area. Image processing is performed separately on these two areas, with the first area receiving full processing attention while the second area uses simpler rendering, thereby reducing overall data processing burden while maintaining high refresh rate perception in the critical gaze region.
Solution Approach 2:
Different image processing qualities are applied to different regions: the first area (gaze region) receives high-quality processed images with full resolution and detail, while the second area (non-gaze region) uses lower-quality rendering. This local differentiation allows the system to maintain high perceived quality and smoothness in the important area without the computational cost of processing the entire screen at full quality.
2Speed
If the refresh rate is increased to reduce perceptible lag, then the display smoothness improves, but energy consumption increases
Solution Approach 1:
The display is segmented into gaze-based areas where only the first area (user's gaze region) undergoes complete image processing and refreshing. The second area is updated with reduced processing, which significantly reduces the energy required to maintain high refresh rates while preserving the immersive experience in the critical viewing region.
Solution Approach 2:
Energy-consuming image processing operations are concentrated locally in the first area where the user is actually looking. The second area receives minimal processing, reducing overall energy consumption. This allows the system to achieve high effective refresh rates in the gaze region without the full energy cost of processing the entire display area at the same rate.
3Speed
If the refresh rate is increased to reduce perceptible lag, then the display smoothness improves, but user fatigue increases
Solution Approach 1:
By segmenting the display into gaze-based areas and applying different processing levels, the system reduces the overall computational load and data throughput required for high refresh rates. This reduction in processing intensity directly decreases the heat generation and computational stress that contribute to user fatigue, while maintaining smooth display performance in the critical gaze region.
Solution Approach 2:
The system provides high-quality, smoothly processed images only in the first area where the user is looking, while using simpler rendering in the second area. This reduces the cognitive and visual processing load on the user's brain, as the periphery does not require the same level of detail processing, thereby reducing user fatigue while maintaining the immersive high-refresh-rate experience where it matters most.
Data Source
AI summary
The display technologies relate to a method and computer-readable medium for displaying image and to a display device configured to perform the method for displaying image. The image display method includes acquiring an image for display in an nth frame on a display screen; detecting a first sub-image and a second sub-image within the image, a resolution of the first sub-image being higher than a resolution of the second sub-image; comparing the first sub-image in the nth frame with a corresponding sub-image in an (n−1)th frame; and refreshing a localized area of the display screen positionally corresponding to the first sub-image to display an interpolated sub-image in the localized area.