Buffer Memory Unit for Ray Tracing Pipeline Stall Prevention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ray tracing schemes face performance issues due to high computational requirements and cache misses during acceleration structure traversal and intersection tests, leading to pipeline stalls and latency in image rendering.

Innovation Solution

An image rendering apparatus and method that utilizes a buffer memory unit to store input ray data and shape data, allowing for cache address storage and occupancy management, enabling the processor to fetch and store data efficiently, thereby reducing cache misses and enhancing processing speed by using ray coherence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ray tracing scheme is used to generate high quality image, then image quality is improved, but calculation speed deteriorates due to large number of calculations

Engineering Contradiction:
Improveimage qualityVSAvoidcalculation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the ray tracing process into distinct stages: ray generation, acceleration structure traversal, and intersection testing. Each stage is handled by specialized processing units that can operate independently and in parallel, reducing the overall calculation time while maintaining image quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary organization of scene geometry data into acceleration structures (such as BVH or kd-trees) before ray tracing begins. This pre-processing step structures the data to enable faster traversal during actual rendering, reducing the computational burden during the ray tracing process itself

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If cache is positioned between external memory and operation apparatus, then data access is facilitated, but pipeline stall occurs due to cache misses

Engineering Contradiction:
Improvedata accessVSAvoidpipeline stall
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent introduces a buffer memory unit as an intermediary component between the cache and the operation apparatus. This buffer temporarily stores ray data and shape data, allowing the operation apparatus to continue processing even when the cache experiences misses, thereby reducing pipeline stalls

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent ensures continuous processing by maintaining multiple data streams in the buffer memory unit. When one data access encounters a cache miss, the operation apparatus can switch to processing other data that is already available in the buffer, keeping the pipeline full and avoiding stalls

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If buffer memory unit is used to store ray data, then cache misses are reduced, but device complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the buffer memory unit with the existing cache structure, creating a unified memory hierarchy. The buffer is integrated into the data flow path between cache and operation apparatus, sharing control logic and physical infrastructure where possible, which minimizes the increase in device complexity while maintaining performance benefits

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9342919B2Image rendering apparatus and method for preventing pipeline stall using a buffer memory unit and a processor
Publication Date: 2016.05.17 SAMSUNG ELECTRONICS CO LTD
  • US9342919B2 patent drawing
  • US9342919B2 patent drawing
  • US9342919B2 patent drawing

AI summary

An image rendering apparatus may include a buffer memory unit and a processor. The buffer memory unit may store input ray data for image rendering according to a ray tracing scheme while shape data corresponding to the input ray data is being fetched from a cache. The processor may output the received shape data together with the input ray data to an operation apparatus.