Graphics Processor Warping Command for VR Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual reality applications, the delay time between user motion and its reflection on the display, known as Motion-To-Photon latency, detracts from the sense of reality due to context switching between rendering and warping contexts.
Innovation Solution
A graphics processor that generates a warping command based on timing information, allowing periodic warping without context switches by using previously rendered frame data and sensing information, thereby reducing Motion-To-Photon latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If context switching is performed between rendering and warping contexts to reflect user motion, then user motion can be reflected in the display, but delay time increases due to the context switching process
Solution Approach 1:
The system performs preliminary warping operations using previously rendered frame data and sensor information before the actual display is needed. By pre-calculating the warped images and storing them in buffer memory, the system eliminates the need for time-consuming context switching at the moment of display, thus reducing delay time while maintaining the sense of reality
Solution Approach 2:
The rendering process is segmented into distinct stages: initial rendering of frame data, separate warping operation using sensor information, and final display output. This segmentation allows each stage to be optimized independently and enables the warping to be performed on previously rendered data without requiring context switching during the critical display path
2Productivity
If context switching is performed between rendering and warping contexts, then warping can be executed, but rendering may be incomplete or delayed
Solution Approach 1:
The system completes the rendering of frame data in advance and stores it in buffer memory before the warping operation is initiated. This preliminary completion of rendering ensures that the rendering process is not interrupted or delayed by subsequent warping operations, guaranteeing rendering completeness while enabling efficient warping execution
Solution Approach 2:
Buffer memory serves as an intermediary between the rendering process and the warping operation. The rendered frame data is first written to the buffer, then the warping operation reads from this buffer using sensor information. This intermediary buffer decouples the rendering and warping processes, allowing them to proceed independently without context switching interference
Data Source
AI summary
Provided are a graphics processor that performs warping, a rendering system including the graphics process, and a method of operating the graphics processor. The graphics processor may include an internal command generator and a graphics computing device. The internal command generator may be configured to receive timing information and generate, based on the timing information, a warping command for periodically performing warping. The graphic computing device may be configured to, in response to the warping command, periodically perform the warping, without a context switch by a host, by using sensing information provided from an external source and frame data that have already been rendered.