Temporal Supersampling for Foveated Rendering Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality (VR) applications face computational, memory, and networking bottlenecks due to high-resolution image rendering, leading to reduced frame rates, increased latency, and visual artifacts like pixilation and aliasing, which negatively impact the user experience.
Innovation Solution
The implementation of temporal supersampling in foveated rendering systems allows for the generation of higher resolution pixels in undersampled regions, reducing memory usage and enhancing image quality without substantial increases in memory consumption by sampling pixel values from past frames and projecting them onto higher resolution areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high resolution image rendering is used in VR applications, then image quality is improved, but memory usage and computational cost increase
Solution Approach 1:
The system performs preliminary rendering at low resolution and stores these low-resolution pixel values in a buffer before final display. By pre-rendering at reduced resolution and then using temporal supersampling to reconstruct high-resolution pixels from multiple low-resolution frames, the system achieves high image quality while maintaining low memory usage throughout the rendering pipeline.
Solution Approach 2:
The system creates multiple copies of low-resolution pixel data across different time frames and uses these copies to reconstruct high-resolution pixels. By sampling from multiple temporal copies rather than storing a single high-resolution frame, the system achieves supersampling effects without requiring high-resolution memory storage.
2Manufacturing precision
If high resolution image rendering is used in VR applications, then image quality is improved, but frame rate decreases
Solution Approach 1:
The system performs preliminary rendering at low resolution where computationally expensive operations are avoided. By deferring high-resolution reconstruction to a simpler temporal supersampling process that operates on already-rendered low-resolution frames, the system maintains high frame rates while achieving high output resolution.
Solution Approach 2:
The system applies supersampling selectively only to peripheral regions that require resolution enhancement, rather than applying full supersampling to the entire image. This partial application of the supersampling technique reduces computational overhead while still improving overall image quality, thereby maintaining higher frame rates.
3Quantity of substance
If low resolution rendering is used to reduce memory usage, then memory cost is reduced, but visual artifacts like pixilation and aliasing increase
Solution Approach 1:
The system uses periodic temporal sampling by rendering multiple frames at low resolution with slightly different sampling patterns or jitter offsets. By periodically varying the sampling positions across frames and then combining these samples through temporal supersampling, the system reconstructs high-resolution pixels without requiring high-resolution rendering at each individual frame.
Solution Approach 2:
The system introduces temporal buffering and supersampling reconstruction as an intermediary process between low-resolution rendering and final high-resolution display. This intermediary temporal supersampling stage acts as a bridge that transforms low-resolution sequential data into high-resolution output, eliminating visual artifacts while maintaining low memory usage.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3A~3F
AI summary
Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.