Augmented Reality White Point Compensation for Synthetic Content

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Augmented reality systems face challenges in rendering synthetic content that matches the white point of the real-world scene, leading to unnatural appearances when lighting conditions change, as existing methods often require manual intervention or fail to account for optical properties of display hardware.

Innovation Solution

An augmented reality system that includes a camera, display device, and processor to estimate the white point of the real-world scene and adjust the rendering of synthetic content accordingly, using techniques such as temporal smoothing to ensure a natural appearance by matching the synthetic content's color to the real-world illuminant, and optionally considering the optical transmission properties of the display equipment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual intervention is used to adjust white point, then color accuracy can be maintained, but operation complexity and time consumption increase

Engineering Contradiction:

Improvewhite point accuracyVSAvoidmanual adjustment requirement

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically estimates the white point by analyzing the captured image of the real-world scene, eliminating the need for manual operator intervention. The processor independently determines the illuminant characteristics and adjusts synthetic content rendering accordingly

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system continuously monitors the real-world scene through the camera, estimates white point changes, and dynamically adjusts the rendering of synthetic content in real-time, creating a closed-loop feedback system that maintains color accuracy without manual input

Inventive Principle:

Principle #23Feedback

2Measurement precision

If existing rendering methods are used, then device complexity is reduced, but color accuracy deteriorates under changing lighting conditions

Engineering Contradiction:

Improvecolor accuracyVSAvoidrendering system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The existing augmented reality system components (camera, processor, display) are extended to perform white point estimation and adaptive rendering functions, making the system multi-functional without requiring entirely new specialized hardware

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system pre-estimates the white point from the captured scene image and proactively adjusts rendering parameters before displaying synthetic content, ensuring color accuracy is maintained preemptively rather than reactively

Inventive Principle:

Principle #10Preliminary action

3Adaptability or versatility

If existing methods are used, then implementation simplicity is maintained, but adaptability to changing lighting conditions deteriorates

Engineering Contradiction:

Improvelighting condition adaptabilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The rendering system dynamically adapts to changing lighting conditions by continuously estimating white point from the scene and adjusting synthetic content parameters in real-time, transitioning from static to dynamic operation

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system replaces manual mechanical adjustment mechanisms with automated computational image analysis and processing, using software-based white point estimation to achieve adaptability without physical intervention

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11593971B2Apparatus and methods for dynamic white point compensation to improve perceived color of synthetic content

Publication Date: 2023.02.28 INTERDIGITAL VC HOLDINGS INC

AI summary

The invention pertains to methods and apparatus for compensating the rendering of virtual content in an augmented reality scene as a function of the white point, spectral distribution, color or other optical parameter of the real content in the scene.