Virtual Shadow Spotlight for See-Through Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality applications using see-through displays, virtual objects often appear less realistic due to lack of depth cues and harsh contrasts, especially when viewed from different positions or orientations, as the virtual shadows can be occluded or lack spatial context.

Innovation Solution

Creating a virtual shadow for virtual objects in see-through displays by increasing the relative brightness of the real-world background around the shadow, using a virtual spotlight fixed relative to the vantage point, and applying a vignette pattern to attenuate brightness, which enhances the realism and blends the display with the background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual objects are displayed with see-through display, then virtual objects appear in front of real-world background, but virtual objects appear less realistic due to lack of depth cues and harsh contrasts

Engineering Contradiction:
Improverealism of virtual objectVSAvoidcomplexity of shadow rendering
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent changes the brightness parameter of the real-world background in a vignette pattern, increasing relative brightness around the virtual shadow. This parameter modification creates the illusion of a spotlight and virtual shadow without requiring complex physical lighting systems, thereby improving realism while maintaining manufacturing simplicity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary brightness adjustment layer that mediates between the virtual object and the real-world background. By modifying the perceived brightness of the background around the virtual shadow, this intermediary element creates depth cues and reduces harsh contrasts, enhancing realism without adding physical complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If virtual shadow is created without spotlight fixed to vantage point, then rendering is simpler, but virtual shadow can be occluded or lack spatial context when viewed from different positions

Engineering Contradiction:
Improvespatial context of virtual shadowVSAvoidcomplexity of spotlight positioning system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic spotlight system that is fixed relative to the vantage point of the see-through display. As the user's viewing position changes, the spotlight and virtual shadow dynamically adjust their positions to maintain proper spatial relationships. This dynamic approach ensures the virtual shadow remains visible and spatially correct from any viewing angle, improving reliability while the software-based implementation keeps device complexity manageable.

Inventive Principle:
Principle #15Dynamics

3Reliability

If relative brightness is increased uniformly, then virtual shadow becomes visible, but harsh contrasts remain and blending with background is poor

Engineering Contradiction:
Improvevisibility of virtual shadowVSAvoidharsh contrast
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by increasing relative brightness in a non-uniform vignette pattern specifically around the virtual shadow area, rather than uniformly across the entire display. This localized brightness adjustment makes the virtual shadow visible while gradually transitioning to normal brightness levels in surrounding areas, thereby reducing harsh contrasts and improving blending with the real-world background.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3063739B1Mixed reality spotlight
Publication Date: 2021.09.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3063739B1 patent drawingFigure 1
  • EP3063739B1 patent drawingFigure 2
  • EP3063739B1 patent drawingFigure 3

AI summary

Various embodiments relating to creating a virtual shadow of an object in an image displayed with a see-through display are provided. In one embodiment, an image of a virtual object may be displayed with the see-through display. The virtual object may appear in front of a real-world background when viewed through the see-through display. A relative brightness of the real-world background around a virtual shadow of the virtual object may be increased when viewed through the see-through display. The virtual shadow may appear to result from a spotlight that is fixed relative to a vantage point of the see-through display.