Compositing Rendering Layers to Avoid Target Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Graphics systems face performance degradation due to expensive target switching operations, which cause cache thrashing and undesirable rendering effects when applying effects to specific portions of a scene, especially when dealing with transparent objects and layers.

Innovation Solution

The approach involves determining the intent and properties of an effect, copying relevant areas of the target to a surface, continuing rendering without target changes, and then compositing the surface back to apply effects, thereby avoiding costly target switches and ensuring consistent rendering results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the rendering target is switched to an intermediate target to apply effects, then effects can be applied to specific portions of the scene, but performance degrades due to expensive target switching operations and cache thrashing

Engineering Contradiction:
Improverendering accuracyVSAvoidrendering performance
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent uses a render overlay object as an intermediary mechanism. Instead of switching to a completely separate intermediate target, the system creates a specialized overlay object that can be composited with the main rendering target. This overlay object serves as a mediator that allows effect application while maintaining the original rendering target context, thus avoiding expensive target switching operations while still enabling precise effect application to specific scene portions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs copying by creating a render overlay object that copies essential rendering state and geometry information from the main target. Rather than switching targets entirely, the system copies necessary data into the overlay object, applies effects to this copy, then composites it back. This copying approach maintains rendering accuracy while avoiding the performance penalty of full target switching and cache invalidation.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If the rendering target is switched to apply effects, then effects can be applied, but cache thrashing occurs causing further performance degradation

Engineering Contradiction:
Improveeffect application capabilityVSAvoidcache thrashing
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent segments the rendering system into a main rendering target and a separate render overlay object. This segmentation allows effects to be applied to specific portions of the scene in the overlay object without affecting the entire main target. By dividing the rendering workload and maintaining separate but composable rendering contexts, the system enables versatile effect application while minimizing cache thrashing since only the overlay object's data needs to be processed and composited, not the entire main target.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If target switching is performed to apply effects, then effects can be applied to the scene, but undesirable rendering effects occur

Engineering Contradiction:
Improveeffect application capabilityVSAvoidrendering quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent merges the main rendering target with the render overlay object through compositing operations. The overlay object, which contains the applied effects, is composited back with the main target to produce the final rendered image. This merging process ensures that effects are applied correctly while maintaining rendering quality, as the compositing operation preserves the spatial relationships and visual properties of the original scene while incorporating the effect modifications.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS7535480B2Compositing rendering layers
Publication Date: 2009.05.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • US7535480B2 patent drawing
  • US7535480B2 patent drawing
  • US7535480B2 patent drawing

AI summary

Aspects of the subject matter described herein relate to applying effects to a target via compositing rendering layers. In aspects, an intent is determined and a area of a target copied to a surface based on the intent. Then, rendering may continue to the target without changing to another target. Later, the surface is composited back to the target to apply an effect to the target.