Telepresence Robot Visual Superposition for Remote Engagement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current videoconferencing technologies lack the ability to effectively create a realistic telepresence illusion, where remote participants appear to be present in the same physical environment as other participants, especially when the remote participant is not physically located in the same room, leading to a lack of engagement and contribution in discussions.

Innovation Solution

The implementation of a telepresence robot system that uses a naturalizing server to generate the illusion of the remote participant's presence by superimposing their video image onto the background environment, allowing the robot to move and adjust its position within the conference room, and utilizing a network-centric approach to handle complex processing tasks, such as scaling, modifying, and synchronizing images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a telepresence robot system with naturalizing server is implemented to create a realistic telepresence illusion, then the engagement and contribution of remote participants in discussions is improved, but the device complexity and processing requirements increase

Engineering Contradiction:
Improveengagement of remote participantsVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

A naturalizing server acts as an intermediary between the videoconferencing system and client devices. The server receives video feeds from multiple sources, processes them to create a realistic telepresence illusion by superimposing remote participants into the local environment, and distributes the processed video to clients. This intermediary approach improves engagement quality while managing system complexity centrally rather than at each client device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the remote participant's environment and superimposes it with the participant's video feed to generate a composite image. This copying technique allows the remote participant to appear as if physically present in the local environment, enhancing engagement without requiring the participant to be physically transported.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If the telepresence robot moves and adjusts its position dynamically within the conference room, then the realism of the telepresence illusion is improved, but the difficulty of detecting and measuring environmental changes increases

Engineering Contradiction:
Improvedynamic adaptation to environmentVSAvoidenvironmental change detection
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system captures still images of the conference room environment in advance before the remote participant arrives. These pre-captured background images are stored and later used as the base environment into which the remote participant's video is superimposed. This preliminary action simplifies environmental detection by using a static pre-captured background rather than requiring real-time environmental monitoring during the conference.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system allows the telepresence robot to move and adjust its position dynamically during the conference, and the background image is updated accordingly to reflect the robot's new position. This dynamic updating maintains the realism of the telepresence illusion as the robot moves around the conference room, allowing adaptability while managing environmental detection through periodic or event-triggered background updates.

Inventive Principle:
Principle #15Dynamics

3Productivity

If complex processing tasks such as scaling, modifying, and synchronizing images are handled by a network-centric server, then the processing burden on client devices is reduced, but the loss of information during transmission increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidvideo data loss
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The video processing system divides the conference feed into separate components: the local environment background and the remote participant's video feed. These segmented components are processed independently - the background is captured separately, the participant video is processed separately for scaling and modification - and then composited together. This segmentation allows efficient processing while maintaining data integrity by handling each component independently with appropriate processing parameters.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10257441B2Methods, systems, and products for telepresence visualizations
Publication Date: 2019.04.09 AT&T INTELLECTUAL PROPERTY I L P
  • US10257441B2 patent drawing
  • US10257441B2 patent drawing
  • US10257441B2 patent drawing

AI summary

Methods, systems, and products generate telepresence visualizations for a remote participant to a videoconference. A central server superimposes the remote participant onto images or video of the teleconferencing environment. The central server thus generates an illusion that the remote participant is in the same conferencing environment as other conferees.