Ray Tracing Node Prefetch for Faster BVH Traversal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ray tracing techniques in graphics processing systems are inefficient due to substantial time spent fetching data for node intersections from external memory, leading to reduced performance and efficiency in ray-volume intersection testing.

Innovation Solution

Implementing a prefetch mechanism for ray tracing acceleration data structure nodes, such as BVH trees, to proactively load data for nodes that will be intersected by rays, reducing the need for speculative fetching and minimizing the 'wasted' cycles associated with data transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional ray tracing is used with external memory fetching, then ray tracing can be performed, but substantial time is spent fetching data for node intersections from external memory, reducing performance and efficiency

Engineering Contradiction:
Improveray tracing performanceVSAvoiddata fetching time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent implements a prefetch mechanism that proactively loads ray tracing acceleration data structure nodes into local memory before they are actually needed for intersection testing. By predicting which nodes will be accessed based on the current ray traversal position and prefetching them in advance, the system eliminates idle waiting time during data fetching operations, thereby improving ray tracing performance while reducing the loss of time spent on memory access.

Inventive Principle:
Principle #10Preliminary action

2Speed

If speculative fetching is used to pre-load data, then data availability is improved, but wasted cycles are incurred due to fetching data that may not be needed

Engineering Contradiction:
Improvedata access speedVSAvoidwasted fetch cycles
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent employs a feedback-driven prefetch mechanism that monitors the actual ray traversal path and intersection results to refine prefetch predictions. By using feedback from previous traversal patterns and intersection outcomes, the system dynamically adjusts which nodes to prefetch, ensuring that prefetching operations are based on actual usage patterns rather than pure speculation. This reduces wasted fetch cycles while maintaining high data availability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts prefetch parameters such as the look-ahead distance in the acceleration structure and the number of nodes to prefetch based on traversal depth and intersection density. By changing these parameters adaptively rather than using fixed speculative values, the system optimizes the balance between data availability and avoiding wasted fetch operations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260065572A1Graphics processing
Publication Date: 2026.03.05 ARM LTD
  • US20260065572A1 patent drawing
  • US20260065572A1 patent drawing
  • US20260065572A1 patent drawing

AI summary

The present disclosure relates to a graphics processor and a method of operating a graphics processing system for rendering a frame that represents a view of a scene comprising one or more objects using a ray tracing process. A traversal of a ray tracing acceleration data structure indicative of the distribution of geometry for the scene being rendered is performed to determine a first end node associated with a first internal node that will be intersected by a ray and requests data associated with the first end node from the local memory as well as requesting a prefetch of data associated with a second node of the plurality of nodes to be stored in the local memory, and determines, by testing the ray for intersection with the first end node, if the first end node is intersected by the ray.