Lighting Probe Placement Using ML Scene Geometry Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for global illumination and reflection probe placement in virtual environments are laborious, computationally intensive, and require significant artist supervision, leading to unnecessary probe placements and increased computational overhead.

Innovation Solution

A machine learning system is trained to automatically determine optimal lighting probe positions within a virtual environment using geometry data and optionally surface color data, reducing the need for manual supervision and minimizing the number of probes required.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual probe placement and elimination process is used, then visual quality can be achieved, but labor time and computational overhead increase significantly

Engineering Contradiction:
Improvevisual qualityVSAvoidlabor time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system enables automatic probe placement where the computer system performs the placement task autonomously without requiring artist supervision. The machine learning model automatically determines optimal probe positions based on scene geometry, eliminating the need for manual placement and elimination processes while maintaining visual quality standards.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of artist supervision and probe elimination is replaced with an automated machine learning system. The ML model substitutes the human-in-the-loop workflow with algorithmic decision-making, automatically placing probes in optimal positions without requiring iterative manual adjustment and scene re-evaluation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If more probes are placed to ensure visual quality, then lighting accuracy improves, but computational overhead and memory usage increase

Engineering Contradiction:
Improvelighting accuracyVSAvoidnumber of probes
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system applies different probe placement strategies to different regions of the scene based on local characteristics. The machine learning model analyzes scene geometry and determines that certain regions require denser probe placement while other regions can use fewer probes, optimizing the distribution of probes to match actual lighting requirements rather than using uniform placement.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts probe placement parameters based on scene characteristics. The machine learning model modifies probe positions, densities, and distributions according to the specific geometry and lighting requirements of each scene, achieving optimal lighting accuracy with minimized probe quantities through adaptive parameter optimization.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If automated probe placement is implemented, then productivity increases, but manufacturing precision may deteriorate without proper training data

Engineering Contradiction:
Improveprobe placement speedVSAvoidprobe placement accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary training of the machine learning model using extensively curated training data before deployment. This preliminary action ensures that the automated placement system is pre-trained with optimal probe placement patterns and scene understanding, enabling it to achieve high accuracy automatically when deployed without requiring manual intervention during actual probe placement operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4089643B1Lighting probe placement system and method
Publication Date: 2025.12.17 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP4089643B1 patent drawingFigure 1~2
  • EP4089643B1 patent drawingFigure 3

AI summary

A lighting probe placement system for estimating lighting probe positions within a virtual environment comprises a geometry input processor configured to receive geometry of at least part of the virtual environment and prepare it for input to a machine learning system; a processor configured to implement the machine learning system, which has been trained to output lighting probe positions upon receiving input geometry of the at least part of the virtual environment; and an association processor configured to associate the output lighting probe positions with the at least part of the virtual environment for subsequent rendering.