Adaptive Interpolation Circuitry for Graphics Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional nearest-neighbor sampling techniques in graphics processing result in undesirable visual artifacts, such as aliasing, at boundaries between texels due to discontinuous rendering, which is undesirable in non-photorealistic rendering applications like video games.

Innovation Solution

A graphics unit employing adaptive interpolation techniques that use both nearest-neighbor and non-nearest-neighbor interpolation methods to determine pixel attributes for pixels between texels, allowing for a desired visual effect without aliasing by adjusting interpolation width and techniques based on parameters from graphics programs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If nearest-neighbor sampling is used to achieve pixelated visual effect, then the desired blocky appearance is obtained, but aliasing artifacts appear at texel boundaries

Engineering Contradiction:
Improvevisual effectVSAvoidaliasing artifacts
Core Design Contradiction:
Ease of manufactureVSObject-affected harmful factors

Solution Approach 1:

The patent segments the pixel rendering process into two distinct phases: an initial rendering pass using nearest-neighbor sampling to establish the pixelated visual effect, and a subsequent interpolation pass that selectively applies smoothing only to pixels identified as lying on texel boundaries. This segmentation allows the system to preserve the desired blocky appearance while locally eliminating aliasing artifacts at critical boundary regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different interpolation qualities to different spatial regions. Specifically, it performs anti-aliasing interpolation only for pixels determined to be located at texel boundaries, while leaving pixels in the interior regions to maintain their original nearest-neighbor sampled values. This local application of quality enhancement preserves the overall pixelated aesthetic while eliminating harmful artifacts only where they occur.

Inventive Principle:
Principle #3Local quality

2Object-affected harmful factors

If traditional anti-aliasing techniques are applied to eliminate boundary artifacts, then aliasing is reduced, but the desired pixelated visual effect is lost

Engineering Contradiction:
Improvealiasing artifactsVSAvoidvisual effect
Core Design Contradiction:
Object-affected harmful factorsVSEase of manufacture

Solution Approach 1:

The patent divides the pixel set into two segments: boundary pixels that require anti-aliasing treatment and interior pixels that should maintain the pixelated effect. By using the determined pixel attributes to identify which pixels lie on texel boundaries, the system applies anti-aliasing selectively only to the necessary subset of pixels, preserving the visual effect for the majority of pixels while still eliminating artifacts where they occur.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies high-quality anti-aliasing interpolation locally only at texel boundaries rather than uniformly across the entire texture. This localized approach ensures that the smoothing operation is applied precisely where needed to eliminate aliasing, while the rest of the image maintains the crisp, blocky pixelated appearance desired by the application.

Inventive Principle:
Principle #3Local quality

3Productivity

If nearest-neighbor interpolation is used for all pixels, then processing speed is maintained, but visual quality deteriorates due to aliasing

Engineering Contradiction:
Improveprocessing speedVSAvoidvisual quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the pixel processing workload by first performing a rapid nearest-neighbor sampling pass for all pixels, then identifying a smaller subset of boundary pixels that require additional interpolation processing. This segmentation allows the system to maintain high processing speed for the majority of pixels while applying enhanced visual quality processing only where necessary, thus balancing speed and quality requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies the more computationally expensive anti-aliasing interpolation technique only partially, specifically only to pixels identified as being on texel boundaries, rather than applying it to all pixels. This partial application of the enhanced technique provides sufficient visual quality improvement to eliminate aliasing artifacts while avoiding the excessive processing cost that would result from applying the same technique uniformly across the entire image.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9530237B2Interpolation circuitry and techniques for graphics processing
Publication Date: 2016.12.27 APPLE INC
  • US9530237B2 patent drawing
  • US9530237B2 patent drawing
  • US9530237B2 patent drawing

AI summary

Techniques are disclosed relating to interpolation for texture mapping. In some embodiments, a graphics unit includes circuitry configured to map a texture to a screen space such that a set of multiple in the screen space falls between first and second adjacent texels of the texture in a first dimension. In some embodiments, the graphics unit also includes texture processing circuitry configured to perform different types of interpolation for pixels in the group of pixels. In these embodiments, this includes determining pixel attributes for first and second end groups of pixels in the set of pixels using a nearest-neighbor interpolation technique and attributes of the first and second texels respectively. In these embodiments, this also includes determining pixel attributes for an intermediate group of pixels in the set of pixels using a second, different interpolation technique and attributes of both the first and second texels.