Mixed Reality System Physical Light Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional mixed reality systems struggle to realistically simulate virtual object to physical object interactions, such as light reflections and shadows, due to computational intensity and adaptability issues, especially with unpredictable movements in real-time environments.

Innovation Solution

A mixed reality system that synchronizes virtual and physical articles by using a physical article module to generate real-world effects, like lighting, and a motion determination module to track and coordinate movements, allowing virtual and physical elements to interact and adapt in real-time, enhancing realism without requiring computationally intensive virtual simulations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual light interactions are simulated computationally in traditional mixed reality systems, then virtual object to physical object interactions can be generated, but the computational intensity and time required increase significantly

Engineering Contradiction:
Improverealism of virtual object interactionsVSAvoidcomputational intensity
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system segments the interaction simulation into two parts: virtual object rendering remains computational, while physical light effects (shadows, reflections) are generated by actual physical light sources positioned according to virtual object locations. This division reduces computational burden while maintaining interaction realism.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Physical light sources act as intermediaries between virtual objects and physical surfaces. Instead of computationally simulating light paths, the system uses real light sources to physically illuminate surfaces, creating authentic shadows and reflections that naturally represent virtual object interactions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If traditional mixed reality systems use see through displays for additive effects, then virtual objects can be added to the scene, but subtractive effects like shadows are difficult to produce realistically

Engineering Contradiction:
Improveadditive effects capabilityVSAvoidsubtractive effects realism
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

Instead of attempting to create shadows computationally through software processing, the system inverts the approach by using physical light sources to generate shadows in the real world. The physical shadows naturally appear in the camera view and are captured as part of the augmented reality scene, making subtractive effects as easy as additive effects.

Inventive Principle:
Principle #13The other way round (Inversion)

3Adaptability or versatility

If traditional techniques are used to adapt to unpredictable movements in real-time, then adaptability is improved, but quality is sacrificed

Engineering Contradiction:
Improveadaptability to movementVSAvoidrendering quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

Physical light sources continuously and automatically adjust their positions and orientations in response to virtual object movements without requiring complex real-time rendering calculations. The physical light effects naturally adapt to movement through simple positional updates, maintaining high quality while being highly adaptable to unpredictable motion.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach creates a more realistic and immersive mixed reality experience by leveraging physical effects to supplement virtual ones, reducing computational burdens and enhancing the authenticity of virtual object interactions, including lighting and movement, in real-time environments.

Implementation Method 1

actuating a light source to project light on to a location within a physical environment

Methodology Applied
Scientific EffectLight: Light

Data Source

PatentUS11354852B2Real-time projection in a mixed reality environment
Publication Date: 2022.06.07 DISNEY ENTERPRISES INC
  • US11354852B2 patent drawing
  • US11354852B2 patent drawing
  • US11354852B2 patent drawing

AI summary

The present disclosure relates generally to systems and methods for creating a mixed reality environment. A mixed reality system includes a performance area for generating a mixed reality environment, a motion determination module that determines and tracks the motion of an object within the performance area, a physical article module that generates a physical article within the performance area, and a mixed reality display that displays a virtual article within the performance area, wherein the physical article and the virtual article are correlated to the motion of the object.