UV-Space G-Buffer Preservation for Disocclusion Frame Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Frame generation becomes difficult when the optical flow indicates that an object will move such that a previously hidden surface becomes visible, making it challenging to generate accurate data using only screen space source data, which can result in erroneous pixels.
Innovation Solution
Preserving G-buffer and optical flow data in UV space enables frame generation logic to access data that is not available using a purely screen space approach, allowing for more accurate frame generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If screen space source data is used for frame generation, then the process is simple and fast, but accuracy deteriorates when objects move to reveal previously hidden surfaces
Solution Approach 1:
The patent applies preliminary action by pre-rendering and storing G-buffer data (including depth, normal, and material information) and optical flow data in UV space before frame generation occurs. This pre-computed data is stored in buffers and made available for subsequent frame generation operations, eliminating the need for complex real-time calculations when disocclusion events occur.
Solution Approach 2:
The patent transitions from screen space (2D pixel coordinates) to UV space (texture coordinate space) for storing G-buffer and optical flow data. This dimensional transformation allows the data to be accessed in a different coordinate system that better supports frame generation operations, particularly for handling objects that move into previously hidden areas.
2Reliability
If only screen space data is used, then memory usage is low, but erroneous pixels are generated when hidden surfaces become visible
Solution Approach 1:
The patent creates a copy of the G-buffer and optical flow data in UV space coordinates, separate from the original screen space rendering data. This copied data structure allows the system to reference pre-computed information for pixels that will be generated through frame generation, ensuring accuracy without requiring duplicate storage of the entire scene data.
3Measurement precision
If UV space data is preserved for frame generation, then hidden surfaces are rendered accurately, but processing complexity increases
Solution Approach 1:
The patent introduces UV space as an intermediary coordinate system between the original screen space rendering and the frame generation process. This intermediary layer provides a bridge that allows accurate access to hidden surface information without requiring direct complex transformations during the actual frame generation, simplifying the processing pipeline.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Described herein are techniques to preserve G-buffer and optical flow data in UV coordinate space. The G-buffer and optical flow data can be used to correct disocclusion artifacts in frames generated via a neural network.