AR Illumination Effects for Luminous Inserted Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in generating realistic illumination effects for inserted luminous content, which can reduce contrast and amplify noise in the surrounding image, and require efficient processing to maintain high frame rates and minimize power usage.

Innovation Solution

The system determines a location within an image to insert content, generates a bounding box and illumination center point, and renders an illumination entity using pixel values based on the illumination center point location, applying radial falloff and scaling illumination effects inversely to the brightness of underlying image pixels to maintain contrast and prevent overexposure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If illumination effects are generated for inserted luminous content, then realism of the augmented reality scene is improved, but image contrast is reduced and noise is amplified

Engineering Contradiction:
Improverealism of illumination effectsVSAvoidcontrast reduction and noise amplification
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by selectively adjusting illumination parameters in different regions of the image. The system calculates illumination values based on the distance from the luminous content, applying stronger illumination effects closer to the content and weaker effects farther away. This localized approach maintains realism near the inserted content while preserving contrast in distant regions, thereby resolving the contradiction between illumination realism and overall image contrast.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying illumination effects only to specific regions surrounding the inserted luminous content rather than the entire image. The illumination is concentrated in the vicinity of the content where it is most needed for realism, while leaving other areas unchanged. This selective application reduces the overall impact on image contrast and noise levels while maintaining the desired realistic illumination effect locally.

Inventive Principle:
Principle #16Partial or excessive action

2Illumination intensity

If complex illumination rendering is performed for each frame, then illumination realism is improved, but processing speed decreases and power consumption increases

Engineering Contradiction:
Improveillumination rendering qualityVSAvoidframe rate and power efficiency
Core Design Contradiction:
Illumination intensityVSProductivity

Solution Approach 1:

The patent applies segmentation by dividing the illumination rendering process into distinct computational stages: calculating the illumination center point, determining the bounding box, computing distance-based illumination values, and applying radial falloff. This segmented approach allows the system to perform only the necessary calculations for each frame, avoiding redundant computations and optimizing processing efficiency while maintaining illumination quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent utilizes parameter changes by dynamically adjusting illumination parameters such as the radial falloff exponent and illumination intensity based on the distance from the luminous content. Instead of using fixed complex rendering parameters, the system modifies these parameters according to the specific geometric relationship between the inserted content and surrounding pixels, reducing computational complexity while preserving realistic illumination effects.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11164367B2Illumination effects from luminous inserted content
Publication Date: 2021.11.02 GOOGLE LLC
  • US11164367B2 patent drawing
  • US11164367B2 patent drawing
  • US11164367B2 patent drawing

AI summary

Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.