Composite Video Superimposition for Group Conference Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video communication techniques fail to optimize the limited video view by equally presenting each location in a group setting, leading to a disadvantageous focus on recent or frequent speakers, which does not allow for a continuous view of all users, including those who have not spoken.

Innovation Solution

The system determines peers in a video communication, analyzes their video streams to identify users and static locations, modifies the image content of secondary peers by changing shapes, resizing, and removing background or foreground, and superimposes modified video streams onto primary peers to create a composite video that accommodates all participants, ensuring a tailored and seamless view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If video streams of all peers are equally presented in a group video communication, then all users can be continuously displayed, but the limited video view cannot accommodate all participants effectively

Engineering Contradiction:
Improvevisibility of all participantsVSAvoidvideo view area
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The system segments the video communication participants into primary peers and secondary peers. Primary peers occupy the main video view area while secondary peers are integrated through superimposition. This segmentation allows all participants to be visible simultaneously by allocating different spatial roles, resolving the contradiction between showing all users and maintaining adequate video quality within limited view area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system embeds video streams of secondary peers within the video stream of primary peers through superimposition. The modified video stream of a secondary peer is nested onto the primary peer's video stream, creating a composite video where multiple participants coexist in a hierarchical spatial arrangement. This nesting enables continuous display of all participants without requiring equal display area for each.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Loss of information

If the video stream of a secondary peer is superimposed onto the primary peer, then all participants can be displayed simultaneously, but the image quality and clarity may be compromised

Engineering Contradiction:
Improvecompleteness of participant displayVSAvoidimage quality
Core Design Contradiction:
Loss of informationVSManufacturing precision

Solution Approach 1:

The system extracts specific image content from the secondary peer's video stream (such as background or non-essential foreground elements) before superimposition. By removing certain portions of the secondary peer's video content, the system reduces visual conflict and maintains better overall image quality while still achieving simultaneous display of all participants.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies different processing treatments to different regions of the composite video. The primary peer's video stream maintains full quality in its primary display area, while the superimposed secondary peer content is selectively modified. This local differentiation of quality ensures that critical visual information remains clear while still achieving comprehensive participant visibility.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If conventional video communication equally presents each location, then all users are visible, but the focus defaults to recent or frequent speakers rather than maintaining continuous view of all users

Engineering Contradiction:
Improveautomatic user focus managementVSAvoidcontinuous visibility of all participants
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs preliminary classification of peers into primary and secondary categories before the video communication begins or during setup. This pre-established hierarchy enables automatic focus management throughout the communication, eliminating the need for dynamic adjustments based on speaking activity. The primary peer maintains continuous visibility as the base layer, ensuring all participants remain visible without defaulting to speaker-focused views.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11750680B2Systems and methods to selectively combine video streams
Publication Date: 2023.09.05 META PLATFORMS INC
  • US11750680B2 patent drawing
  • US11750680B2 patent drawing
  • US11750680B2 patent drawing

AI summary

Systems, methods, and non-transitory computer readable media are configured for determining that a first peer involved in a video conference is a primary peer; determining that a second peer involved in the video conference is a secondary peer in response to non-satisfaction by the second peer of a threshold associated with a selected number of objects in the second peer; determining a viewing peer involved in the video conference, wherein the primary peer, the secondary peer, and the viewing peer are different; creating a modified video stream of the second peer in response to the determining that the second peer is the secondary peer based on the non-satisfaction by the second peer of the threshold associated with the selected number of objects in the second peer; detecting a static area and a dynamic area in a video stream of the first peer; superimposing the modified video stream of the second peer onto the static area in the video stream of the first peer; and providing a composite video including the video stream of the first peer, the modified video stream of the second peer, and a video stream of the viewing peer for presentation to the viewing peer.