Adaptive Sampling for Ray Tracing Rendering Bottlenecks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing methods for rendering three-dimensional models using ray tracing require significant computational resources due to the need for extensive collision checking, especially for reflective objects, which can be resource-intensive and inefficient.

Innovation Solution

The implementation of adaptive sampling techniques, where the sampling rate for a second frame is determined based on the rendering result of a first frame, allowing for selective use of ray tracing or interpolation to obtain geometric information for intermediate pixels, thereby optimizing computational resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If ray tracing is performed on all pixels to obtain accurate geometric information, then image quality is improved, but computational load and rendering time increase significantly

Engineering Contradiction:
Improvegeometric information accuracyVSAvoidrendering time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies local quality by differentiating processing approaches for different regions. Tiles are classified into first tiles (requiring full ray tracing for high accuracy) and second tiles (using adaptive sampling with interpolation for lower computational cost). This allows high geometric information accuracy where needed while reducing rendering time in other regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by performing ray tracing only on reference pixels rather than all pixels in second tiles. The sampling rate is adjusted adaptively based on tile characteristics, performing minimal necessary ray tracing operations while using interpolation for intermediate pixels, thus reducing rendering time while maintaining acceptable accuracy.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If ray tracing is performed on all pixels to obtain accurate geometric information, then image quality is improved, but computational resources and power consumption increase

Engineering Contradiction:
Improvegeometric information accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating processing approaches for different regions. Tiles are classified into first tiles (requiring full ray tracing for high accuracy) and second tiles (using adaptive sampling with interpolation for lower computational cost). This allows high geometric information accuracy where needed while reducing power consumption in other regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by performing ray tracing only on reference pixels rather than all pixels in second tiles. The sampling rate is adjusted adaptively based on tile characteristics, performing minimal necessary ray tracing operations while using interpolation for intermediate pixels, thus reducing power consumption while maintaining acceptable accuracy.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If adaptive sampling with lower sampling rate is used for second tiles, then computational load is reduced, but image quality may deteriorate

Engineering Contradiction:
Improverendering efficiencyVSAvoidimage quality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by classifying tiles into first and second tiles before rendering based on predicted geometric information similarity. This pre-classification allows the system to apply appropriate processing strategies (full ray tracing vs. adaptive sampling) to different tile types, ensuring that tiles requiring high precision receive adequate processing while maintaining overall rendering efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by interpolating geometric information from reference pixels to obtain geometric information for intermediate pixels in second tiles. This allows the system to avoid performing expensive ray tracing operations on all pixels while still obtaining sufficient geometric information for rendering, thus maintaining image quality while improving productivity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9865078B2Image processing method and apparatus with adaptive sampling
Publication Date: 2018.01.09 SAMSUNG ELECTRONICS CO LTD
  • US9865078B2 patent drawing
  • US9865078B2 patent drawing
  • US9865078B2 patent drawing

AI summary

According to a method of processing an image, respective sampling rates of each tile included in a second frame is determined based on a corresponding rendering result of a first frame, and a pixel rendering process to implement rendering of pixels included in the second frame is selected by using geometric information of reference pixels of the second frame. The reference pixels of the second frame may be selected based on the respectively determined sampling rates.