Multi-Sample Anti-Aliasing with Pre-Resolve Post-Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphics processing units (GPUs) lose information during multi-sample anti-aliasing (MSAA) resolve, which limits the ability to apply post-processing effectively, especially in high dynamic range (HDR) color-space, resulting in compromised visual quality and inability to correctly simulate visual effects like motion blur and depth of field.
Innovation Solution
Performing anti-aliasing and post-processing before or during MSAA resolve, utilizing sampling patterns that include both internal and external pixel samples, and converting between HDR and low dynamic range (LDR) color-spaces to enable accurate visual effects and reduce flicker and ghosting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If MSAA resolve is performed before post-processing, then anti-aliasing is achieved, but information is lost and post-processing cannot be applied to individual samples
Solution Approach 1:
The patent applies post-processing effects to individual pixel samples before the MSAA resolve operation. By performing depth-of-field and motion blur calculations on each sample individually while the sample information is still intact, the system preserves the ability to apply different processing to different samples (e.g., background samples blurred, foreground samples sharp) before they are blended together during resolve.
2Reliability
If box filter is used for MSAA resolve, then anti-aliasing is achieved, but filtering quality is poor
Solution Approach 1:
The patent changes the filtering parameters by using cubic filtering instead of box filtering during the MSAA resolve operation. Cubic filtering uses a weighted average that gives more importance to central samples and less to peripheral samples, creating smoother transitions and higher quality anti-aliasing compared to the uniform weighting of box filtering.
3Reliability
If LDR perceptual color-space is used for MSAA resolve, then anti-aliasing works correctly, but HDR linear color-space required for post-processing is not available
Solution Approach 1:
The patent performs post-processing operations on individual samples in HDR linear color-space before the MSAA resolve operation. This allows the system to work in the physically accurate HDR linear color-space for lighting and shadow calculations, then perform the resolve operation that can output to LDR perceptual color-space for display, thus maintaining both HDR processing capabilities and LDR display compatibility.
4Device complexity
If post-processing is applied after MSAA resolve, then processing is simpler, but visual effects are incorrect and anti-aliasing is removed on edges
Solution Approach 1:
The patent applies post-processing effects to individual pixel samples before the MSAA resolve operation. This preliminary application of depth-of-field and motion blur effects to each sample individually ensures that the visual effects are preserved through the anti-aliasing process, rather than being lost or incorrectly applied after the samples are blended together.
Data Source
AI summary
A system and method for enhanced multi-sample anti-aliasing. The method includes determining a sampling pattern corresponding to a pixel and adjusting the sampling pattern based on a visual effect (e.g., post-processing visual effect). The method further includes accessing a first plurality of samples based on the sampling pattern. The first plurality of samples may comprise a second plurality of samples within the pixel and a third plurality of pixels outside of the pixel. The method further includes performing anti-aliasing filtering of the pixel based on the first plurality of samples and the sampling pattern.