Mixed Reality Lighting Adaptation for User Comfort

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In mixed reality (MR) and augmented reality (AR) systems, users often feel uncomfortable when viewing virtual objects in real spaces because the pre-assumed optimal lighting environment of the virtual object does not match the actual lighting conditions of the real space.

Innovation Solution

An information processing system that includes one or more processors configured to control the lighting environment in a real space based on lighting information of a virtual object displayed on a head-mounted display (HMD). This system obtains lighting information from a network and adjusts the real-space lighting to match the virtual object's optimal lighting environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a virtual object is displayed in a real space using MR or AR technology, then the user can view the virtual object in the real environment, but the user feels uncomfortable when the virtual object's pre-assumed optimal lighting environment differs from the actual real-space lighting conditions

Engineering Contradiction:
Improveadaptability of virtual object to real-space environmentVSAvoiduser discomfort
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent changes the lighting parameters (intensity, color temperature, direction) of the virtual object to match the detected real-space lighting conditions. The system adjusts these parameters dynamically based on the environment, allowing the virtual object to adapt to different real-world lighting scenarios and eliminate user discomfort caused by lighting mismatches.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system implements a feedback mechanism by detecting the actual lighting conditions in the real space using sensors or image analysis, comparing them with the virtual object's current lighting parameters, and automatically adjusting the virtual object's lighting to match the detected environment. This closed-loop feedback ensures continuous adaptation to real-space conditions.

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If the lighting environment of the real space is adjusted to match the virtual object's optimal lighting, then the user comfort is improved, but additional control mechanisms and sensors are required

Engineering Contradiction:
Improveuser discomfortVSAvoidlighting control system complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system enables the virtual object to self-adjust its lighting parameters automatically based on detected environmental conditions. The virtual object monitors the real-space lighting environment and autonomously modifies its own appearance without requiring external manual intervention or complex centralized control, thereby reducing overall system complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent employs a multi-functional approach where a single integrated system performs multiple tasks: detecting real-space lighting conditions, analyzing the virtual object's current parameters, calculating the optimal adjustment, and applying the changes. This consolidation of functions into one system reduces the need for separate specialized components and simplifies the overall architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250182429A1Information processing system that allows user to view virtual object without feeling uncomfortable, control method, and storage medium
Publication Date: 2025.06.05 CANON KK
  • US20250182429A1 patent drawing
  • US20250182429A1 patent drawing
  • US20250182429A1 patent drawing

AI summary

A mechanism that allows a user to view a virtual object without feeling uncomfortable is provided. An information processing system includes one or more processors and/or circuitry configured to execute a control processing that, based on lighting information of a virtual object displayed on a display device in a superimposed manner on a real space, performs control of a lighting environment in the real space, and execute an obtainment processing that obtains information about the virtual object used in display of the virtual object via a network. The lighting information of the virtual object is included in the information about the virtual object.