Virtual Background Brightness Matching in Video Sessions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional virtual background replacement techniques in video communication sessions appear inauthentic due to inconsistencies between the image properties of the foreground and the virtual background, such as brightness, color, and exposure, leading to a lack of credibility in the virtual environment.

Innovation Solution

The method involves analyzing and matching image properties of the foreground and virtual background in real-time, adjusting either or both to minimize differences in brightness, white balance, focal length, and other attributes, ensuring a more photorealistic virtual background replacement by modifying the virtual background to match the user's image properties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional virtual background replacement is implemented, then background substitution is achieved, but image property inconsistencies (brightness, color, exposure) make the result appear inauthentic

Engineering Contradiction:

Improveauthenticity of virtual backgroundVSAvoidimage property consistency

Core Design Contradiction:

ReliabilityVSManufacturing precision

Solution Approach 1:

The patent adjusts multiple image parameters including brightness, contrast, saturation, exposure, and white balance of the virtual background to match the foreground user image. This involves analyzing the foreground image properties and dynamically modifying the virtual background parameters to achieve visual consistency, thereby resolving the authenticity issue without requiring perfect initial matching.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent replaces manual or simple automated background replacement with an intelligent image processing system that uses algorithms to analyze and match image properties. This substitution of mechanical replacement with intelligent processing enables automatic adjustment of multiple parameters simultaneously, achieving both efficiency and visual authenticity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If real-time image property matching is performed, then authenticity is improved, but processing complexity and computational requirements increase

Engineering Contradiction:

Improveauthenticity of virtual backgroundVSAvoidprocessing system complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the image processing task into distinct segments: foreground detection and extraction, virtual background selection, image property analysis, parameter matching, and composite rendering. This segmentation allows each module to be optimized independently and processed in real-time, reducing overall system complexity while maintaining authenticity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-processing the virtual background images (resizing, format conversion, initial property analysis) before they are needed during the video call. This allows the real-time processing to focus only on dynamic parameter adjustment based on the foreground, significantly reducing computational complexity during live sessions.

Inventive Principle:

Principle #10Preliminary action

3Manufacturing precision

If multiple image properties are adjusted to match, then visual consistency is improved, but processing time and computational resources increase

Engineering Contradiction:

Improveimage property consistencyVSAvoidreal-time processing speed

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The patent implements partial action by adjusting only the most critical image properties (brightness and contrast) in real-time, while less critical parameters are adjusted pre-processing or with lower priority. This selective approach maintains visual consistency where it matters most while preserving real-time processing performance.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The patent uses feedback mechanisms where the processed virtual background is continuously compared with the foreground image, and adjustments are made based on the difference. This closed-loop approach ensures convergence to a visually consistent state without requiring exhaustive adjustment of all parameters, optimizing processing efficiency.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11336840B2Matching foreground and virtual background during a video communication session

Publication Date: 2022.05.17 CISCO TECHNOLOGY INC

AI summary

A method, computer system, and computer program product are provided for virtual background replacement during a video communication session. A frame comprising a user image and a captured background is obtained from a video capture device as part of a video stream. The frame is processed to replace the captured background with a virtual background. A change to an exposure characteristic of the video capture device is determined. In response to determining the change to the exposure characteristic, the virtual background is modified to match a virtual background brightness with a user image brightness to produce a modified virtual background. The frame is modified by combining the user image with the modified virtual background.