Streaming Light Propagation for Interactive Global Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional ray tracing renderers are inefficient for complex scenes with large data sets, requiring significant time and resources to re-render lighting changes, limiting interactive visualization and quality in feature film applications.

Innovation Solution

The system employs streaming light propagation by recording light propagation data, including emission samples and radiance samples, which allows for interactive visualization of lighting changes by reconstructing the output image without re-rendering the entire scene, utilizing parallel processing to achieve fast relighting at full rendering quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional ray tracing renderer is used to provide global illumination, then lighting quality is improved, but rendering time and computational resources increase significantly

Engineering Contradiction:
Improvelighting qualityVSAvoidrendering time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary rendering of the scene to capture light propagation data (emission samples, radiance samples, and propagation records) before any lighting changes occur. This pre-computed data is stored and can be quickly re-utilized when lighting needs to be adjusted, avoiding the need to re-render the entire scene from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of re-rendering the entire scene when lighting changes, the system creates a copy of the light propagation data structure and modifies only the relevant lighting parameters. The output image is reconstructed by processing the modified light propagation data, which is much faster than complete re-rendering while maintaining full rendering quality.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If conventional ray tracing renderer is used to render complex scenes with large data sets, then lighting accuracy is improved, but processing overhead increases and re-rendering becomes less suitable

Engineering Contradiction:
Improvelighting accuracyVSAvoidprocessing overhead
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The light propagation data is segmented into distinct components: emission samples (light sources), radiance samples (surface reflections), and propagation records (light paths). This segmentation allows the system to store and process only the essential lighting information separately from the complete scene geometry, reducing processing overhead when lighting changes occur.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts only the necessary light propagation information (emission samples, radiance samples, propagation records) from the complete scene rendering process and stores it in a specialized data structure. This extracted data can be quickly processed to generate new lighting configurations without re-processing the entire complex scene geometry.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If the entire scene is re-rendered to show lighting changes, then lighting visualization is updated, but the process is time consuming and resource intensive

Engineering Contradiction:
Improvelighting visualizationVSAvoidrendering efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The complete light propagation data is captured in advance during the initial rendering pass. This pre-computed data structure serves as a foundation that can be quickly adapted to show different lighting configurations by modifying only the lighting parameters, not the entire scene rendering process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables dynamic lighting visualization by allowing real-time or near-real-time modification of lighting parameters in the stored light propagation data. The output image can be reconstructed with updated lighting conditions much faster than complete re-rendering, providing interactive visualization capabilities.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9053582B2Streaming light propagation
Publication Date: 2015.06.09 DISNEY ENTERPRISES INC
  • US9053582B2 patent drawing
  • US9053582B2 patent drawing
  • US9053582B2 patent drawing

AI summary

A method is provided for streaming light propagation with particular application for feature films and other demanding content creation using scenes of high complexity requiring art directed global illumination. By attaching a data recording shader or equivalent functionality to any tracing based renderer that can provide multi-pass global illumination, the complete set of light bounce propagation records and the set of emissive samples for a particular rendering can be recorded to memory or disk. A user may edit the emissive samples to adjust the lighting environment, including modifying light source color and intensity and even moving and adding new emissive samples. To relight the scene, the edited emissive samples are processed through the propagation records using a streaming multiply-and-add operation amenable to high levels of parallelization, avoiding a costly re-rendering of the scene and providing a final quality result in interactive time.