Superimposing Human Elements in Real-Time Composite Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video call technologies do not effectively simulate mutual physical presence and lack integration of augmented reality elements, making remote interactions feel impersonal and lacking in excitement.

Innovation Solution

A computer-implemented method and system that superimposes live video feeds from multiple users, allowing human elements to interact and occupy any position within a shared frame, with the option to incorporate augmented reality objects, environments, and effects, enabling users to simulate physical contact and interactive experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of moving object

If video call technology is used to enable remote communication, then users can communicate over great distances, but users cannot feel as though they are in close proximity to the person being called

Engineering Contradiction:
Improvecommunication distanceVSAvoidsense of physical presence
Core Design Contradiction:
Length of moving objectVSReliability

Solution Approach 1:

The patent creates a virtual copy of the remote user by capturing their video feed and superimposing it onto the local user's environment. This virtual representation allows the remote user to appear physically present in the local user's space, maintaining the sense of physical presence while enabling long-distance communication

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from traditional 2D video call interfaces to a 3D spatial experience by projecting the remote user's video feed into the local user's physical environment. This dimensional transformation allows users to perceive each other in three-dimensional space, enhancing the realism and presence of remote interactions

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If standard video calling is used, then users can see and speak with each other, but the interaction lacks fun and excitement

Engineering Contradiction:
Improvevideo call functionalityVSAvoidinteractive experience
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent enhances the basic video call functionality by integrating multiple features including augmented reality filters, virtual object insertion, and environmental interaction capabilities. This multi-functionality transforms a simple communication tool into a versatile platform for entertainment and engagement

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically processes and enhances video feeds in real-time by applying augmented reality effects, detecting user actions, and dynamically adjusting the virtual environment. This self-service capability allows the system to provide interactive entertainment features without requiring manual configuration or intervention from users

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3507978B1Systems and methods for providing real-time composite video from multiple source devices featuring augmented reality elements
Publication Date: 2022.05.11 HOLMES RUSSELL
  • EP3507978B1 patent drawingFigure 1
  • EP3507978B1 patent drawingFigure 2
  • EP3507978B1 patent drawingFigure 3

AI summary

Systems and methods for superimposing the human elements of video generated by computing devices (20), wherein a first user device and second user device capture and transmit video to a central server (30) which analyzes the video to identify and extract human elements (216, 218), superimpose these human elements upon one another, adds in at least one augmented reality element (410), and then transmits the newly created superimposed video back to at least one of the user devices.