Stereo Image Rendering Sequence for Low-Latency Head Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The time delay between head movement and image rendering in AR/VR systems causes user dizziness due to asynchronous head posture information and image data output.
Innovation Solution
Perform a first rendering process on left and right eye images during a first time period, followed by a second rendering process on each eye image during subsequent time periods, and then apply asynchronous time warping during later time periods to align with updated head posture information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If a traditional sequential rendering process is used for left and right eye images, then the rendering process is simple to implement, but the time delay between head movement and image rendering increases causing user dizziness
Solution Approach 1:
The system performs a first rendering process in advance to generate initial left and right eye images. During a first time period, the processor performs the first rendering process on a left eye image and a right eye image, creating preliminary image data that can be quickly adjusted later through asynchronous time warping based on actual head posture changes.
Solution Approach 2:
The rendering process is divided into multiple independent stages: first rendering process (generating initial images), second rendering process (processing individual eye images), and asynchronous time warping (adjusting for head movement). By splitting the fourth time period for left eye warping and fifth time period for right eye warping to overlap with the third time period for right eye rendering, the system reduces total processing time while maintaining image quality.
2Manufacturing precision
If asynchronous time warping is performed immediately after rendering, then image alignment with head posture is improved, but rendering waste increases and real-time frame display is compromised
Solution Approach 1:
The system dynamically adjusts the timing of asynchronous time warping operations based on the rendering cycle progress. The fourth time period for left eye warping and fifth time period for right eye warping are configured to overlap with the third time period for right eye rendering, allowing flexible scheduling that adapts to varying rendering loads and head movement patterns.
Solution Approach 2:
The overlapping time periods ensure that rendering and warping operations continue without idle gaps. While the right eye image is being rendered during the third time period, the left eye image warping proceeds simultaneously during the fourth time period, and the right eye image warping follows during the fifth time period, maintaining continuous productive action throughout the rendering cycle.
Data Source
AI summary
The disclosure discloses an image processing method, an image processing device and a computer readable storage medium. The image processing method comprises: performing a first rendering process on a left eye image and a right eye image during a first time period; performing a second rendering process on the left eye image obtained by the first rendering process during a second time period; performing a second rendering process on the right eye image obtained by the first rendering process during a third time period; performing an asynchronous time warping on the left eye image by the second rendering process during a fourth time period; performing the asynchronous time warping on the right eye image by the second rendering process during a fifth time period. The disclosure can reduce time delay during the rendering process and thereby reducing the user's dizzy feeling.