Ray Traversal Units for Graphics Processing Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ray tracing methods are computationally expensive and memory bandwidth-intensive due to the traversal of acceleration structures and intersection tests, leading to degraded performance and high latency when data is not cached.

Innovation Solution

A graphics processing apparatus and method that utilizes multiple traversal units to process ray traversal across subdivisions of the entire space, with a management unit distributing data and managing fit points to optimize cache efficiency and reduce latency by allocating data to the appropriate traversal units based on load balancing and cache capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ray tracing is performed using traversal of acceleration structure and intersection tests, then image quality is improved, but calculation amount and memory bandwidth consumption increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidrendering rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the acceleration structure traversal into multiple independent traversal units, each handling specific portions of the ray tracing workload. This segmentation allows parallel processing of rays and reduces the computational burden on individual units, thereby improving rendering rate while maintaining image quality through comprehensive coverage of the acceleration structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of parallelism by implementing multiple traversal units that can simultaneously process different rays or portions of the acceleration structure. This dimensional expansion from sequential to parallel processing significantly increases productivity without compromising the precision of intersection tests and image quality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If data is read from external memory during traversal operations, then completeness of data access is improved, but latency increases due to long read time

Engineering Contradiction:
Improvedata access completenessVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements a caching mechanism that pre-loads and stores frequently accessed acceleration structure data into local memory before traversal operations begin. This preliminary action ensures that data is readily available during ray traversal, maintaining data access completeness while significantly reducing latency by eliminating repeated external memory reads.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a cache memory as an intermediary between external memory and the traversal units. This intermediary layer holds copies of frequently accessed data, allowing traversal units to retrieve information quickly without directly accessing external memory, thus reducing latency while ensuring data completeness through cache coherence mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If multiple traversal units are used to process ray traversal, then processing speed is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent designs traversal units with universal functionality, where each unit can handle multiple types of traversal operations and access various portions of the acceleration structure. This multi-functionality allows a smaller number of versatile units to achieve high processing speeds without proportionally increasing device complexity, as each unit can be dynamically assigned to different tasks.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic resource allocation and management for the multiple traversal units, allowing the system to adaptively assign workloads based on current processing needs. This dynamic approach optimizes processing speed by balancing the workload across units while managing complexity through centralized control logic that coordinates unit operations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9367949B2Apparatus and method for scheduling of ray tracing
Publication Date: 2016.06.14 SAMSUNG ELECTRONICS CO LTD
  • US9367949B2 patent drawing
  • US9367949B2 patent drawing
  • US9367949B2 patent drawing

AI summary

A graphic processing apparatus and method for processing ray tracing may include a plurality of traversal units to process traversal of a ray. A management unit of the graphics processing apparatus may distribute data of the ray processed by the graphics processing apparatus to the plurality of traversal units. Each of the plurality of traversal units may process ray traversal with respect to a subdivision of the entire space.