Mirror-Based Tele-Immersion for Shared 3D Collaboration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tele-immersive collaboration systems are limited in accommodating multiple participants, lack a suitable mechanism for shared workspace manipulation of virtual objects, and do not provide a natural way for participants to monitor their appearance to remote participants, often relying on distracting small pictures.

Innovation Solution

A tele-immersive environment using a mirror metaphor, where each participant's local set-up includes mirror functionality, either physical semi-transparent mirrors or simulated mirrors, to create a three-dimensional virtual space allowing multiple participants to appear as if they are at the same location, with the ability to manipulate virtual objects and view their appearance naturally.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a window metaphor is used to create a shared-space experience, then two participants can interact as if physically present together, but the system cannot accommodate more than two participants

Engineering Contradiction:
Improvenumber of participantsVSAvoidmetaphor structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent inverts the traditional window metaphor by using a mirror metaphor instead. In the mirror metaphor, participants look at themselves and others in a shared virtual space reflected in the mirror, allowing any number of participants to be accommodated while maintaining the illusion of physical co-presence. This inversion resolves the limitation of the window metaphor which only supports two participants.

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If a window metaphor is used, then a shared-space experience is created, but the system does not readily accommodate a shared workspace for manipulating virtual objects

Engineering Contradiction:
Improveworkspace functionalityVSAvoidmetaphor deviation
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The mirror metaphor provides a universal framework that simultaneously supports multiple functions: visual interaction, shared workspace manipulation, and self-monitoring. The virtual workspace is integrated into the mirrored reflection, allowing participants to manipulate virtual objects naturally while maintaining the immersive experience, without requiring deviation from the core metaphor.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If a small picture is shown in the peripheral region to monitor local participant appearance, then remote participants can see the local participant, but the local participant finds it distracting and unnatural

Engineering Contradiction:
Improveself-appearance feedbackVSAvoiduser comfort
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent merges the self-view and the view of remote participants into a single unified mirrored reflection. The local participant sees themselves and remote participants together in the mirror, creating a natural and non-distracting self-monitoring experience. This eliminates the need for separate peripheral displays and integrates self-appearance feedback seamlessly into the main visual field.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a scalable and intuitive shared virtual space for multiple participants to interact and manipulate virtual objects, providing a natural mechanism for self-visualization, thus enhancing collaboration and user experience.

Implementation Method 1

a physical semi-transparent mirror placed in front of a display device. The semi-transparent mirror presents a virtual image of the local participant, while the display device presents a virtual image of the remote participant(s)

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS9325943B2Providing a tele-immersive experience using a mirror metaphor
Publication Date: 2016.04.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9325943B2 patent drawing
  • US9325943B2 patent drawing
  • US9325943B2 patent drawing

AI summary

A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.