Real-Time Video Background Segmentation in Conferences

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current video conferencing technologies do not allow for real-time transformations of video streams, limiting participants' ability to enhance their video presentations with images or videos in the background or foreground during a conference.

Innovation Solution

A method and system that enable participants to request and generate modified video streams by identifying foreground and background within a video stream, allowing images or videos to be inserted into the background or foreground, which are then transmitted to all participants for an aesthetically appealing or humorous effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If real-time video transformations are implemented, then participant engagement and visual experience are improved, but system complexity and processing requirements increase

Engineering Contradiction:

Improvevideo transformation capabilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The video stream is segmented into foreground and background components using image processing techniques. This segmentation allows independent manipulation of background elements while preserving the foreground video feed, enabling transformation capabilities without requiring complete reprocessing of the entire video stream.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A virtual background layer is introduced as an intermediary element between the camera feed and the display output. This virtual layer can be dynamically modified with images or videos, allowing transformation effects to be applied without directly altering the original video stream, thus reducing system complexity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If real-time video transformations are implemented, then participant engagement and visual experience are improved, but processing speed and computational resources are consumed

Engineering Contradiction:

Improvevideo transformation capabilityVSAvoidprocessing speed

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

Background segmentation and virtual background preparation are performed in advance or in parallel with video capture. By pre-processing background elements and preparing transformation materials before they are needed, the system minimizes real-time processing requirements and maintains high frame rates during the actual video conference.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system applies transformation effects selectively to only the background portion of the video stream rather than processing the entire frame. This partial processing approach significantly reduces computational overhead while still achieving the desired visual enhancement effect.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS20160073055A1Real-time video transformations in video conferences

Publication Date: 2016.03.10 GOOGLE LLC

AI summary

Systems and methods are disclosed for real-time video transformations in video conferences. A method includes receiving, by a processing device, a request from a first participant of a video conference to modify a video stream. The method further includes identifying, by the processing device, a foreground and a background within the video stream. The method further includes generating, by the processing device, a modified video stream including a video or image inserted into the background.