Adaptive Interleaved Image Warping for VR Headsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual reality, the increasing demand for higher image resolution leads to increased computation loading and data size for image frames, making it challenging to prevent delay in data transmission while maintaining image quality.
Innovation Solution
The method involves generating image frames for a head-mounted device with different resolutions for each eye at the same time point, with one frame at a higher resolution and the other at a lower resolution, which are then restored to regular resolution and interleaved displayed, allowing adaptive adjustment based on computation loading, transmission bandwidth, and user movement speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If image resolution is increased to improve viewing quality, then image quality is improved, but computation loading and data size increase
Solution Approach 1:
The patent segments the image rendering task by generating frames at different resolutions for different eyes. Specifically, the left eye receives full-resolution frames while the right eye receives lower-resolution frames, dividing the computational load and reducing total data size while maintaining overall viewing quality
Solution Approach 2:
The patent applies local quality by providing different resolution qualities to different eyes based on their respective roles in stereoscopic vision. The system determines that one eye can tolerate lower resolution without significant perceptual degradation, allowing quality optimization at the local (eye-specific) level
2Manufacturing precision
If image resolution is increased to improve viewing quality, then image quality is improved, but computation loading increases
Solution Approach 1:
The patent segments the computational workload by assigning different resolution requirements to different eyes. The computing device generates full-resolution frames for one eye and lower-resolution frames for the other eye, thereby reducing total computation loading while maintaining image quality for the critical viewing path
3Speed
If data size is reduced to prevent transmission delay, then transmission speed is improved, but image quality deteriorates
Solution Approach 1:
The patent segments the data transmission by sending frames of different sizes to different eyes. Total data size is reduced through asymmetric resolution allocation, improving transmission speed while the full-resolution frames sent to one eye maintain image quality
Solution Approach 2:
The patent applies partial action by providing full resolution only where necessary (one eye) and reduced resolution where acceptable (other eye). This partial high-quality transmission maintains essential image quality while reducing overall data volume for faster transmission
4Quantity of substance
If asymmetric resolution rendering is applied to reduce data size, then data size is reduced, but system complexity increases
Solution Approach 1:
The patent implements dynamic resolution adjustment where the system can adaptively switch between symmetric and asymmetric resolution modes. The computing device determines whether to render both eyes at full resolution or use asymmetric resolution based on real-time conditions such as motion detection, transmission bandwidth, and computational load, thereby managing system complexity through adaptive control
Data Source
AI summary
A method, system and recording medium for adaptive interleaved image warping are provided. The method is applicable to a display system having a head-mounted device (HMD) and a computing device. In the method, the computing device generates a plurality of image frames to be displayed on the HMD according to a frame rate, wherein the image frames generated to be displayed on a first display and a second display at a same time point comprise a first frame with a first resolution and a second frame with a second resolution lower than the first resolution. The generated image frames are transferred from the computing device to the HMD. The HMD restores the second frames with the second resolution among the image frames to a regular resolution of the first display and the second display, and then interleaved displays the first frames and the restored second frames on the first display and the second display.