Tele-Immersive Mirror Metaphor for Multi-Participant Collaboration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tele-immersive collaboration systems are limited in accommodating multiple participants, do not easily allow for manipulation of virtual objects, and lack a natural mechanism for participants to see how they appear to others, often relying on distracting peripheral images.

Innovation Solution

A tele-immersive environment using a mirror metaphor, where each participant's local set-up includes mirror functionality, either with a physical semi-transparent mirror or a simulated one, allowing for a three-dimensional virtual space where participants can see each other and manipulate virtual objects as if they are in the same physical space, with the option to omit their own image and include a shared workspace for object interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a window metaphor is used to provide a shared-space experience, then two participants can interact as if in the same physical space, but the system is not well suited for more than two participants

Engineering Contradiction:
Improvenumber of participantsVSAvoidmetaphor structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent inverts the conventional window metaphor by using a mirror metaphor instead. In the mirror metaphor, participants look at themselves and others in a shared mirror space, which naturally accommodates any number of participants rather than being limited to two positions (front and back of a window pane). This inversion resolves the contradiction by enabling scalability to multiple participants while maintaining an intuitive spatial model.

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If a window metaphor is used, then a shared-space experience is provided, but it does not readily accommodate a shared workspace for manipulating virtual objects

Engineering Contradiction:
Improveworkspace functionalityVSAvoidmetaphor deviation
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The mirror metaphor provides a universal framework that simultaneously supports multiple functions: visual interaction among participants, shared workspace for virtual objects, and self-monitoring capabilities. The mirror surface serves as both the interaction medium and the workspace boundary, allowing participants to manipulate virtual objects on the mirror surface while maintaining natural hand-eye coordination. This multi-functionality resolves the contradiction without requiring significant deviation from the core metaphor.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If a small picture is included in the peripheral region to show the local participant's image, then remote participants can see the local participant, but it is distracting and unnatural

Engineering Contradiction:
Improveself-view visibilityVSAvoiduser experience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent extracts the self-view function from the peripheral corner picture and integrates it directly into the main mirror space. Instead of showing a small inset image in the corner, the system renders the local participant's reflection as part of the primary mirror view, allowing them to see themselves naturally as they would in an actual mirror. This extraction resolves the contradiction by providing complete self-view visibility without the distracting peripheral presentation.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a scalable, intuitive, and immersive experience for multiple participants, allowing natural interaction and manipulation of virtual objects without distracting self-view mechanisms, enhancing collaboration and immersion.

Implementation Method 1

a physical semi-transparent mirror placed in front of a display device. The semi-transparent mirror presents a virtual image of the local participant

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP3687164B1Providing a tele-immersive experience using a mirror metaphor
Publication Date: 2022.08.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3687164B1 patent drawingFigure 1
  • EP3687164B1 patent drawingFigure 2
  • EP3687164B1 patent drawingFigure 3

AI summary

A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.