Foveated Display Image Warping for Low-Latency Head Motion Response
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display devices for augmented and virtual reality experience high latency in image rendering due to changes in head orientation, necessitating improved methods to reduce this delay.
Innovation Solution
A display system and method that utilizes foveated rendering with high-resolution partial images and geometric deformation processing based on sensor inputs to quickly adapt to head movements, incorporating acceleration and eye-tracking sensors to generate and display images with reduced latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If geometric deformation processing is performed on entire image data to adapt to head movements, then image accuracy is improved, but processing time increases causing latency
Solution Approach 1:
The image data is segmented into a first partial image (high-priority region) and a second partial image (low-priority region). The image processing circuit performs geometric deformation processing first on the first partial image data, then on the second partial image data. This segmentation allows critical regions to be processed immediately while less critical regions are processed subsequently, reducing overall latency while maintaining image accuracy for important areas.
Solution Approach 2:
The image processing circuit performs geometric deformation processing on the first partial image data in advance before processing the second partial image data. By prioritizing and pre-processing the first partial image, the system ensures that the most important image regions are ready for display with minimal delay, effectively reducing perceived latency while maintaining processing accuracy.
2Manufacturing precision
If high-resolution image data is processed for the entire image, then image quality is improved, but data transmission and processing load increase
Solution Approach 1:
The system applies different processing priorities to different regions of the image. The first partial image (corresponding to the foveal region where the user is looking) is processed with high priority and high resolution, while the second partial image (peripheral regions) is processed with lower priority. This local quality approach ensures high image quality where the user needs it most while reducing overall data processing load and transmission requirements.
Data Source
AI summary
A display device according to the present disclosure includes: a reception circuit that is configured to receive a piece of first image data, a piece of second image data, and a piece of third image data, the piece of first image data representing an entire image having a first resolution, the piece of second image data representing a peripheral image having a second resolution less than or equal to the first resolution, the peripheral image including an image outside the entire image, the piece of third image data representing a first partial image having a third resolution higher than the first resolution, the first partial image including an image having an image range narrower than an image range of the entire image; a display section that includes a plurality of pixels, and is configured to display an image having a same image range as the image range of the entire image; a first sensor that is configured to detect a change in orientation of the display device; an image processing circuit that is configured to perform a first image processing for generating a piece of display image data by performing a geometric deformation processing on the piece of first image data, the piece of second image data, and the piece of third image data on the basis of a result of detection by the first sensor; and a display drive circuit that is configured to drive the display section on the basis of the piece of display image data.