Foveated Rendering Contrast Filter for VR Artifact Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Foveated rendering systems suffer from noticeable artifacts such as temporal aliasing, flicker, and tunnel vision due to contrast loss in peripheral vision, limiting their ability to reduce rendering complexity without degrading image quality, especially in high-resolution and high-field-of-view applications like VR and AR.
Innovation Solution
A method that incorporates a foveated rendering algorithm with post-process filtering using a contrast-enhancing filter, combining techniques like coarse pixel shading, mipmapped texture maps, linear efficient anti-aliased normal maps, exponential variance shadow maps, and temporal anti-aliasing to enhance image contrast and reduce artifacts in the periphery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If foveated rendering is used to reduce computations in peripheral regions, then computational bandwidth is reduced, but image quality deteriorates due to artifacts and contrast loss
Solution Approach 1:
The patent applies different rendering qualities to different regions of the image based on human visual perception characteristics. High-quality rendering is applied to the foveal region (center of vision) while lower-quality rendering is applied to peripheral regions, optimizing the balance between computational efficiency and perceived image quality.
Solution Approach 2:
A contrast-enhancing filter is introduced as an intermediary processing step between the foveated rendering algorithm and the final image output. This filter compensates for the contrast loss and artifacts introduced by peripheral rendering, thereby improving overall image quality without requiring full-resolution rendering across the entire image.
2Loss of energy
If rendering resolution is reduced in peripheral regions, then compute bandwidth is saved, but artifacts such as aliasing and flicker appear
Solution Approach 1:
The contrast-enhancing filter serves as a post-processing intermediary that specifically targets and reduces artifacts in peripheral regions. The filter enhances local contrast and applies adaptive processing to mitigate aliasing and flicker effects while preserving the computational benefits of reduced peripheral rendering resolution.
Solution Approach 2:
The rendering system dynamically adjusts rendering parameters such as resolution and shading rates based on the spatial position in the image and detected eye movement. This allows the system to optimize compute bandwidth usage while maintaining acceptable image quality by adapting to changing viewing conditions.
3Productivity
If aggressive foveated rendering is applied, then computational efficiency is improved, but tunnel vision and extreme blurring occur
Solution Approach 1:
The contrast-enhancing filter acts as a corrective intermediary that processes the aggressively downsampled peripheral regions. By enhancing local contrast and applying adaptive filtering, it prevents the extreme blurring and tunnel vision effects that would otherwise result from aggressive foveated rendering, thereby maintaining both efficiency and acceptable peripheral image quality.
Data Source
AI summary
A method, computer readable medium, and system are disclosed for rendering images utilizing a foveated rendering algorithm with post-process filtering to enhance a contrast of the foveated image. The method includes the step of receiving a three-dimensional scene, rendering the 3D scene according to a foveated rendering algorithm to generate a foveated image, and filtering the foveated image using a contrast-enhancing filter to generate a filtered foveated image. The foveated rendering algorithm may incorporate aspects of coarse pixel shading, mipmapped texture maps, linear efficient anti-aliased normal maps, exponential variance shadow maps, and specular anti-aliasing techniques. The foveated rendering algorithm may also be combined with temporal anti-aliasing techniques to further reduce artifacts in the foveated image.