Background Differentiation via Electromagnetic Intensity Decay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video generating systems, such as those used in video conferencing, face challenges with background replacement due to high computing power requirements, software incompatibility with existing video conferencing software, and undesirable lag, making virtual background replacement unfeasible for individual remote work setups.

Innovation Solution

An advanced camera device with integrated background differentiation capabilities, using electromagnetic radiation intensity differences to separate foreground and background, allowing for real-time background removal or modification without the need for complex software execution on user devices, thereby reducing computational load and improving video streaming quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional virtual background replacement software is used, then background removal capability is achieved, but computing power requirements exceed available resources for typical individual setups

Engineering Contradiction:
Improvebackground removal capabilityVSAvoidcomputing power requirements
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The patent introduces an intermediary processing system that receives video feeds from multiple cameras, performs the computationally intensive background removal processing centrally, and delivers processed video streams to endpoints. This mediator approach allows complex processing to be performed outside individual resource-constrained devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates multiple video stream copies - one with the original background and another with the replaced background - and distributes these copies to different recipients. This allows background replacement without requiring each recipient to perform the computationally intensive processing themselves.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If virtual background replacement software is implemented, then background modification capability is achieved, but software incompatibility with existing video conferencing applications occurs

Engineering Contradiction:
Improvebackground modification capabilityVSAvoidsoftware incompatibility
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal processing system that can serve multiple video conferencing applications and platforms through a single intermediary service. This multi-functional approach allows the background replacement capability to be accessed by different video conferencing software without requiring separate implementations for each application.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If conventional virtual background replacement is used, then background replacement capability is achieved, but lag is introduced to live video stream

Engineering Contradiction:
Improvebackground replacement capabilityVSAvoidvideo stream lag
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary processing by capturing video feeds at multiple points in the streaming pipeline and preparing alternative background versions in advance. This preliminary action allows the intermediary to quickly swap between background versions during transmission without introducing significant lag to the live stream.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If chroma key compositing is used for background replacement, then background removal capability is achieved, but expensive professional lighting equipment is required

Engineering Contradiction:
Improvebackground removal capabilityVSAvoidlighting equipment cost
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent replaces the mechanical/optical chroma key system (requiring green screens and specialized lighting) with a digital image processing system that uses software-based background identification and replacement algorithms. This substitution eliminates the need for expensive physical lighting equipment while achieving similar or superior background removal results.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables seamless background replacement or modification within video conferencing systems, reducing bandwidth requirements, enhancing video quality, and improving security by preventing personal information from being transmitted, while maintaining compatibility with existing software applications.

Implementation Method 1

detecting, by a first sensor of the one or more sensors, an intensity of the electromagnetic radiation received in the second range of wavelengths from the first environment, identifying a first portion of the first environment based on values relating to the detected intensity

Methodology Applied
Scientific EffectElectromagnetic radiation detection: Absorption (EM radiation)

Data Source

PatentUS12058471B2Image generating system
Publication Date: 2024.08.06 LOGITECH EUROPE SA
  • US12058471B2 patent drawing
  • US12058471B2 patent drawing
  • US12058471B2 patent drawing

AI summary

Embodiments of the disclosure provided herein generally relate to methods and video system components that have integrated background differentiation capabilities that allow for background replacement and/or background modification. In some embodiments, undesired portions of video data generated in a video environment are separated from desired portions of the video data by taking advantage of the illumination and decay of the intensity of electromagnetic radiation, provided from an illuminator, over a distance. Due to the decay of intensity with distance, the electromagnetic radiation reflected from the undesired background has a lower intensity when received by the sensor than the electromagnetic radiation reflected from the desired foreground. The difference in the detected intensity at the one or more wavelengths can then be used to separate and/or modify the undesired background from the desired foreground for use in a video feed.