Depth Sorting Primitives for Hidden Surface Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics processing systems face inefficiencies due to redundant rendering operations caused by processing primitives sequentially, leading to increased memory bandwidth requirements and reduced frame rates, especially in complex render outputs where 'overdraw' occurs frequently.

Innovation Solution

Implementing a method to depth-sort subsets of primitives before rasterization, ensuring they are processed in depth order, which enhances the efficiency of hidden surface removal processes like early depth-testing and culling, thereby reducing redundant rendering operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If primitives are processed sequentially in the order they are received, then the graphics processing system can maintain simple processing logic, but redundant rendering operations occur leading to increased memory bandwidth requirements and reduced frame rates

Engineering Contradiction:
Improveprocessing logic simplicityVSAvoidframe rate
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing depth sorting of primitives before the rasterization and rendering processes. The system sorts primitives based on their depth values in advance, so that when rendering occurs, primitives are already ordered from front to back. This preliminary sorting enables efficient hidden surface removal during rendering, reducing redundant operations and improving frame rate without significantly complicating the overall processing logic.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If primitives are processed sequentially in the order they are received, then the processing pipeline remains simple, but hidden surface removal efficiency is reduced due to frequent overdraw

Engineering Contradiction:
Improveprocessing pipeline complexityVSAvoidmemory bandwidth
Core Design Contradiction:
Device complexityVSLoss of energy

Solution Approach 1:

The system performs depth sorting as a preliminary action before rendering. By pre-sorting primitives based on depth values, the pipeline prepares the primitive list in advance to minimize overdraw during rendering. This reduces memory bandwidth consumption by avoiding redundant rendering of hidden surfaces while maintaining relatively simple pipeline architecture through the use of standard sorting algorithms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The depth sorting operation continues the useful action of preparing primitives for efficient rendering. By maintaining primitives in depth-sorted order throughout the rendering process, the system ensures that hidden surface removal operations can proceed continuously without interruption or backtracking, maximizing rendering efficiency and minimizing memory bandwidth usage.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If depth sorting is performed on all primitives before rendering, then hidden surface removal efficiency is maximized, but processing time increases due to the sorting operation

Engineering Contradiction:
Improvehidden surface removal efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies segmentation by dividing the set of all primitives into multiple depth bins or ranges. Instead of sorting all primitives uniformly, the system segments the depth space and processes primitives in different depth ranges separately or in parallel. This reduces the complexity and time required for depth sorting while maintaining effective hidden surface removal efficiency for each segment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial action by performing depth sorting only on subsets of primitives that are most likely to cause overdraw, rather than sorting all primitives uniformly. This selective sorting approach reduces processing time while still achieving significant hidden surface removal efficiency improvements for the critical portions of the scene that would otherwise cause redundant rendering.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9552665B2Hidden surface removal in graphics processing systems
Publication Date: 2017.01.24 ARM LTD
  • US9552665B2 patent drawing
  • US9552665B2 patent drawing
  • US9552665B2 patent drawing

AI summary

In a graphics processing pipeline 1, a primitive depth sorting stage 9 is arranged prior to the rasterization stage 3 and rendering stage 6. The primitive depth sorting stage 9 operates to sort successive sub-sets of primitives in a stream of primitives 2 received by the graphics processing pipeline 1 based on their depth values. The so-sorted primitives are then output from the primitive depth sorting stage 9 in their sorted depth order to the rasterizer 3. This makes the depth test stages 4, 13 of the graphics processing pipeline 1 more efficient in their hidden surface removal operations, because the primitives entering the rasterizer 3 will be in depth order.