AR Eyewear Video Communication Using Mirror Reflection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality (AR) eye wear devices cannot utilize their integrated cameras for video communication, as the camera faces away from the wearer, making it impossible to simultaneously view the user interface and capture one's own image without removing the device.

Innovation Solution

A method and system that utilize the AR eye wear's camera by determining a data structure, such as an ar-bound-box, to delimit the camera's field of view and send formatted video, allowing for video communication without additional external devices and without needing to remove the eye wear.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the AR eye wear camera is used for video communication, then the device can capture the wearer's image, but the camera faces away from the wearer making it impossible to simultaneously view the user interface and capture one's own image

Engineering Contradiction:
Improvevideo communication capabilityVSAvoidsimultaneous viewing and capturing
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a mirror to reflect the wearer's image back to the camera, effectively adding a spatial dimension that allows the camera to capture the wearer's face despite facing away. This dimensional change enables the camera to see around the wearer's head by capturing the mirror reflection, resolving the contradiction between camera orientation and self-capture capability

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The mirror acts as an intermediary object between the wearer and the camera. By placing a mirror in front of the wearer, the system mediates the optical path so that the camera can capture the wearer's image indirectly through the mirror reflection, enabling video communication without requiring the camera to face the wearer directly

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a separate physical camera is used in conjunction with AR eye wear for video communication, then video communication is enabled, but the user must carry an additional device

Engineering Contradiction:
Improvevideo communication capabilityVSAvoidnumber of devices to carry
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the AR eye wear device multi-functional by enabling its existing camera to serve dual purposes: capturing the real-world view for AR overlay and capturing the wearer's image for video communication. By using the mirror reflection technique, the single device performs multiple functions without requiring additional cameras or external equipment

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The AR eye wear device serves itself by using its own camera and processor to handle video communication tasks. The device's existing hardware components (camera, display, processor) are utilized in a creative configuration with the mirror to enable video communication, eliminating the need for separate dedicated video communication devices

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11195337B2Augmented reality video communications
Publication Date: 2021.12.07 TREMOLANT
  • US11195337B2 patent drawing
  • US11195337B2 patent drawing
  • US11195337B2 patent drawing

AI summary

A method of augmented reality video communications between a remote system having a camera and a local system having a display. The remote and local systems are in communication with each other. A select portion of a remote camera video from the remote system is communicated to the local system. A local overlay is provided at the local system corresponding to a target portion of the local display field of view. Interpolation between the local overlay and the local display field of view specifies a local augmented reality portion of a local display corresponding to the local overlay. The select portion of the remote camera video is displayed onto the local augmented reality portion of the local display.