Dynamic Multi-Layer Rendering for Frame Budget Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In gaming and virtual reality devices, processing over-budget conditions during graphics rendering can lead to undesirable effects such as dropped frames and frame tearing due to excessive resource usage and time constraints, particularly when rendering multiple layers like backgrounds, scenes, and user interfaces.

Innovation Solution

A method and system for dynamic multi-layer rendering that detects processing over-budget conditions and adjusts rendering parameters for individual layers based on priority profiles, allowing for differential modification of parameters like resolution, anti-aliasing, and sampling rates to prioritize certain layers over others, ensuring rendering stays within budget.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If rendering parameters are maintained at high quality settings for all layers, then rendering quality is improved, but processing time and resource usage exceed the rendering budget

Engineering Contradiction:
Improverendering qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The rendering system divides the frame into multiple layers (e.g., background layer, foreground layer, UI layer) and applies different rendering parameter settings to each layer independently. This segmentation allows the system to maintain high rendering quality for priority layers while using lower quality settings for non-priority layers, thereby reducing overall processing time and staying within the rendering budget.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different rendering parameters (such as resolution, anti-aliasing, shadow quality) are applied locally to different layers based on their priority. Priority layers receive high-quality rendering parameters, while non-priority layers receive reduced-quality parameters. This local quality differentiation maintains visual fidelity where needed while reducing processing overhead in less critical areas.

Inventive Principle:
Principle #3Local quality

2Productivity

If rendering parameters are reduced to stay within processing budget, then processing time is reduced, but rendering quality deteriorates

Engineering Contradiction:
Improveprocessing throughputVSAvoidrendering quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts rendering parameters for each layer based on real-time conditions such as layer priority, current processing budget status, and performance metrics. This dynamic adjustment allows the system to optimize the balance between processing throughput and rendering quality, maintaining high quality for important layers while accepting reduced quality for less important layers to ensure overall frame delivery.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system modifies specific rendering parameters (resolution, anti-aliasing level, sampling rate, shadow quality) on a per-layer basis according to priority profiles. By changing these parameters selectively rather than uniformly across all layers, the system achieves better processing throughput while minimizing the impact on perceived rendering quality.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If uniform rendering parameters are applied to all layers, then system complexity is reduced, but flexibility to prioritize certain layers is lost

Engineering Contradiction:
Improverendering system complexityVSAvoidlayer prioritization capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The rendering system implements layer segmentation with priority profiles, where each layer can be assigned a priority level (e.g., high, medium, low). This segmentation approach adds minimal complexity to the rendering pipeline while enabling flexible prioritization of different layers based on their importance to the overall visual output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The priority profile system serves multiple functions: it determines rendering parameter selection, influences culling decisions, and guides resource allocation across layers. This multi-functional approach allows a single mechanism to provide versatile layer prioritization without proportionally increasing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10360704B2Techniques for providing dynamic multi-layer rendering in graphics processing
Publication Date: 2019.07.23 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10360704B2 patent drawing
  • US10360704B2 patent drawing
  • US10360704B2 patent drawing

AI summary

Examples described herein generally relate to rendering graphics in a computing device. A processing over-budget condition related to rendering a frame can be detected, based on which a value of a rendering parameter for a layer, where the layer is one of multiple layers to render for the frame can be modified. The layer can be rendered based at least in part on the value of the rendering parameter while one or more other layers of the multiple layers can be rendered based on respective values for the rendering parameter. The value of the rendering parameter for the layer can be different from at least one of the respective values of the rendering parameter for the one or more other layers.