Motion-Based Image Rendering Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual reality applications, motion-to-photon latency, which is the time delay between user motion and the rendering of motion-based images, negatively affects user experience by increasing the time it takes for users to see their motion-based images, thereby deteriorating the quality of the virtual reality experience.
Innovation Solution
The solution involves determining a rendering time point for each frame between continuous vertical synchronization signals based on an expected rendering time, allowing for the rendering of motion-based images using graphics processing units (GPUs) that obtain and apply motion-related data at this determined time point, ensuring the latest user motion is reflected in the image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion-related data input prior to rendering is applied to a frame, then the rendering process can be completed, but the motion-to-photon latency increases and the quality of virtual reality application deteriorates
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing motion-related data in a buffer before rendering occurs. The system prepares motion data in advance based on predicted rendering time points, so that when rendering is initiated, the data is already ready for immediate use, reducing the overall motion-to-photon latency while ensuring rendering completion
2Stability of the object's composition
If motion data from earlier time points is used for rendering, then rendering stability is maintained, but the realism of user motion reflection deteriorates
Solution Approach 1:
The patent implements dynamics by making the motion data selection adaptive rather than static. The system dynamically selects motion data from different time points based on the actual rendering completion time, allowing it to balance between stability and accuracy in real-time. This enables the system to use the most recent motion data that is still reliable, improving motion reflection accuracy while maintaining rendering stability
Solution Approach 2:
The system uses feedback by monitoring the actual rendering completion time and adjusting the motion data selection accordingly. The rendering time point determination unit receives feedback about when rendering completes and uses this information to select the appropriate motion data from the buffer, ensuring both stability and accuracy are maintained through continuous adaptation
Data Source
AI summary
Disclosed are methods and devices for processing a motion-based image by determining a rendering time point that reflects a recent user motion. The methods include obtaining commands or data used in graphics rendering from a memory; determining a rendering time point of a first frame between continuous vertical synchronization signals based on an expected rendering time of the first frame; and rendering the motion-based image based on the commands or the data, and motion-related data corresponding to the rendering time point of the first frame.