Ray Tracing Circuit Grouping Rays for Shader Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing graphics processing systems face inefficiencies in performing ray tracing due to the high processing intensity and complexity of determining geometry intersections, particularly when dealing with large scenes and numerous rays.

Innovation Solution

A graphics processor is equipped with a ray tracing circuit that manages multiple rays simultaneously, using acceleration data structures to determine geometry intersections, and groups rays for efficient processing by a programmable execution unit, optimizing shader program execution based on code and data locality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional rasterisation rendering is used, then processing intensity is reduced, but image realism and physical accuracy deteriorate

Engineering Contradiction:
Improveimage realismVSAvoidprocessing intensity
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the ray tracing process into two distinct parts: a dedicated ray tracing circuit handles the computationally intensive geometry intersection testing, while the programmable execution unit handles the shader program execution. This segmentation allows each component to be optimized for its specific function, reducing the overall processing burden on any single unit while maintaining high image realism through accurate ray-traced geometry intersections.

Inventive Principle:
Principle #1Segmentation

2Reliability

If ray tracing is performed with full accuracy, then image quality improves, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces a dedicated ray tracing circuit as an intermediary component between the geometry data and the shader execution. This intermediary circuit performs geometry intersection testing in hardware, producing results that are then consumed by the programmable execution unit for shader program execution. This intermediary approach offloads the time-consuming geometry testing from the main processing pipeline, enabling faster overall rendering while maintaining full ray tracing accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If all rays are processed individually, then processing simplicity is maintained, but throughput decreases

Engineering Contradiction:
ImprovethroughputVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the processing of multiple rays by having the ray tracing circuit manage and process rays in parallel. The circuit maintains a pool of rays to be processed and can dispatch multiple rays simultaneously to the programmable execution unit, combining what would otherwise be sequential individual processing into a parallel throughput-oriented system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements dynamic ray processing where the ray tracing circuit adapts the processing strategy based on the specific characteristics of each ray and scene. The circuit dynamically determines which rays should be processed together and which should be handled individually, optimizing throughput while managing the complexity of varying processing requirements through flexible, adaptive control.

Inventive Principle:
Principle #15Dynamics

4Productivity

If rays are processed in parallel, then throughput improves, but memory access complexity increases

Engineering Contradiction:
ImprovethroughputVSAvoidmemory access complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent employs feedback mechanisms where the ray tracing circuit receives results from shader program execution and uses this feedback to determine the next rays to process. This feedback loop allows the system to dynamically adjust memory access patterns based on actual processing needs, reducing memory access complexity by only accessing memory for rays that need to be processed next, rather than systematically accessing all ray data.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12633036B2Graphics processing
Publication Date: 2026.05.19 ARM LTD
  • US12633036B2 patent drawing
  • US12633036B2 patent drawing
  • US12633036B2 patent drawing

AI summary

A method of operating a graphics processor to perform ray tracing. The graphics processor includes a ray tracing circuit that can be messaged by the graphics processor's programmable execution unit during execution of a program to perform a respective traversal of the at least one ray tracing acceleration data structure to be traversed for that ray. The ray tracing circuit when returning rays' processing to the programmable execution unit is operable to group rays together for continued execution by the programmable execution unit as a respective thread group.