Telepresence Camera FOV Alignment for Videoconferencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional videoconferencing systems fail to provide a natural and realistic telepresence experience due to camera field of view (FOV) misalignment with the display FOV, resulting in blind spots and incomplete capture of users' images, especially when users approach the display.

Innovation Solution

Aligning the camera's FOV with the display's FOV to capture image data covering a substantial portion of the display area without capturing images displayed on the screen, using partially transparent displays and optical subsystems to minimize ghosting effects and ensure complete user image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the camera is positioned to capture users clearly, then user image capture is improved, but the display area may be outside the camera's field of view creating blind spots

Engineering Contradiction:
Improveuser image capture completenessVSAvoidcamera field of view coverage
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent employs a dual-camera system where one camera captures images from a first direction (front-facing) and another camera captures images from a second direction (rear-facing or side-facing). This multi-dimensional capture approach ensures complete coverage of the user and display area, eliminating blind spots that would occur with a single camera positioned only at the front.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The camera system is divided into multiple independent camera units, each capturing images from different directions. The processing system then combines these segmented views to reconstruct a complete image of the user and display, ensuring no area is missed while maintaining clear capture quality.

Inventive Principle:
Principle #1Segmentation

2Area of stationary object

If the camera captures the entire display area, then field of view coverage is improved, but display content may be captured instead of user images

Engineering Contradiction:
Improvefield of view coverageVSAvoiddisplay content contamination
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

Each camera in the system is positioned and oriented to capture specific local regions. The processing system identifies which cameras should capture user images versus display content based on their spatial positioning and capture direction. By controlling the local capture characteristics of each camera, the system ensures comprehensive coverage while preventing display content from being mistakenly captured as user images.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The processing system acts as an intermediary that receives images from multiple cameras and intelligently determines which images represent users and which represent display content. It filters and selects appropriate images based on spatial information and capture direction, preventing display content contamination while maintaining complete field of view coverage.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If a single camera is used, then device complexity is reduced, but blind spots occur when users approach the display

Engineering Contradiction:
Improvecamera system configurationVSAvoidtelepresence experience quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent transitions from a single-camera front-facing setup to a multi-dimensional camera arrangement where cameras capture images from multiple directions (front, rear, or side). This dimensional expansion eliminates blind spots that occur when users approach the display, as cameras positioned at different angles maintain continuous coverage of the user and display area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The processing system performs multiple functions: it combines images from different cameras, determines which cameras should capture user images versus display content, and reconstructs a complete telepresence view. This multi-functional approach ensures reliable telepresence experience while managing the added complexity through intelligent processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11102449B2Methods and systems for a natural and realistic telepresence experience
Publication Date: 2021.08.24 ZIMMERMAN NOAH
  • US11102449B2 patent drawing
  • US11102449B2 patent drawing
  • US11102449B2 patent drawing

AI summary

Embodiments of the present invention are directed towards methods and systems for providing an enhanced telepresence experience to users participating in a videoconferencing session (VCS). In the embodiments a camera is configured and arranged to capture image data covering objects within a substantial portion of the field of view (FOV) of a display device, without capturing image data encoding images displayed on the display device. That is, the camera's FOV is aligned with the display device's FOV. As such, the camera captures image data encoding images in a substantial portion of the display's FOV. According, users within a VCS may approach their display without falling outside their camera's FOV. This provides an enhanced telepresence experience, where the users may interact with each other through what appears to be a transparent window or barrier.