Telepresence Window Simulation via Steerable Beam Deflectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current devices fail to effectively replicate the experience of face-to-face interaction in remote scenarios, lacking the ability to capture and display eye-related information and gaze direction accurately to create a window-like effect for real-time communication.

Innovation Solution

A system comprising a steerable array of beam-deflecting facets combined with a large area camera and a window-simulation controller, which captures and processes eye-related information to simulate the view of a remote user, allowing for real-time image presentation and capture, mimicking a window-like experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a conventional display device is used for video conferencing, then the basic display function is provided, but the ability to accurately capture and display eye-related information and gaze direction is lost

Engineering Contradiction:
Improveeye-related information capture accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The display device is segmented into multiple functional layers: a display panel for image output, a camera array for capturing eye-related information, and a beam-deflecting facet array for directing light. Each component performs a specific function, allowing the system to accurately capture gaze direction while maintaining a relatively simple overall structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The camera array and beam-deflecting facet array are integrated behind the display panel, creating a nested structure where multiple functional elements are contained within the display device housing. This nesting approach enables complex functionality without significantly increasing the external dimensions or visual complexity of the device.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Adaptability or versatility

If a window-like effect is implemented for real-time communication, then the face-to-face interaction experience is improved, but the device complexity increases due to multiple integrated components

Engineering Contradiction:
Improvereal-time communication capabilityVSAvoidintegrated component complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display device is designed to perform multiple functions: displaying video images, capturing eye-related information through the camera array, and directing light through beam-deflecting facets. This multi-functionality enables the device to create a window-like effect for real-time communication while consolidating multiple capabilities into a single integrated system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The display panel, camera array, and beam-deflecting facet array are merged into a single integrated device. The camera array and beam-deflecting facets are positioned behind the display panel, combining capture and display functions in one unit, thereby enabling real-time communication with a window-like effect without requiring separate devices.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If beam-deflecting facets are used to direct light for accurate gaze capture, then the measurement precision of eye information is improved, but the device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improvegaze direction detection accuracyVSAvoidbeam-deflector fabrication ease
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The beam-deflecting facet array replaces complex mechanical eye-tracking systems with an optical approach. By using fixed geometric facets that passively direct light based on incident angle, the system achieves accurate gaze detection without requiring moving parts or complex mechanical adjustment mechanisms, thereby simplifying manufacturing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless communication by accurately capturing and displaying eye-related information, creating a window-like effect that simulates the view of a remote user, enhancing the remote interaction experience.

Implementation Method 1

a first optical beam deflector switchable between a first non-deflecting state and a second deflecting state; a second optical beam deflector switchable between a first non-deflecting state and a second deflecting state

Methodology Applied
Scientific EffectLight transmission and reflection: Reflection

Data Source

PatentEP3205088B1Telepresence experience
Publication Date: 2022.10.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3205088B1 patent drawingFigure 1
  • EP3205088B1 patent drawingFigure 2
  • EP3205088B1 patent drawingFigure 3

AI summary

The description relates to creating a window-like experience during video communication scenarios. One example can include a spatial light deflector including a steerable array of light deflecting elements. The example can also include a wedge device positioned relative to the spatial light deflector. The example can also include a camera positioned at an end of the wedge device to receive the captured light.