Video Feed Reframing for Dynamic Chroma Key Backgrounds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital communication tools face challenges in providing virtual backgrounds using chroma key techniques without requiring expensive cameras or large, cumbersome green screens, especially for mobile users or those in non-ideal environments.
Innovation Solution
A method that dynamically generates a virtual background within a communication session by determining a background layer, cropping and reframing the video feed, and adding a selected virtual background using chroma keying, allowing users to utilize smaller screens with solid colors or patterns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If chroma key techniques are used to provide virtual backgrounds, then virtual background quality is improved, but device complexity and cost increase due to requirements for expensive cameras and large green screens
Solution Approach 1:
The patent segments the background detection process by identifying and isolating the chroma key background layer from the video feed, allowing selective processing of only the background portion rather than the entire video stream. This enables virtual background replacement using simpler, smaller equipment by focusing computational resources on specific regions.
Solution Approach 2:
The patent creates a virtual copy of the background layer by extracting the chroma key background and replacing it with a predetermined virtual background image or video feed. This copying approach allows high-quality virtual backgrounds to be displayed without requiring expensive physical cameras or large green screens, as the system works with image data rather than real-time optical capture.
2Manufacturing precision
If chroma key techniques are used to provide virtual backgrounds, then virtual background quality is improved, but the system becomes less adaptable to non-ideal environments and mobile users
Solution Approach 1:
The patent dynamically adjusts the chroma key detection parameters and background layer extraction based on real-time analysis of the video feed. The system adapts to varying lighting conditions, background colors, and camera perspectives by continuously monitoring and adjusting its processing parameters, enabling it to function effectively in diverse non-ideal environments without requiring controlled studio conditions.
Solution Approach 2:
The patent changes detection parameters such as color range thresholds, background layer boundaries, and reframing dimensions based on the detected background characteristics. By adjusting these parameters dynamically, the system can accommodate different background colors, lighting conditions, and camera setups, making it adaptable to mobile users and non-ideal environments while maintaining virtual background quality.
3Manufacturing precision
If the video feed is reframed around the background layer, then virtual background replacement accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary detection and extraction of the background layer before the actual virtual background replacement occurs. By pre-identifying the background region, determining its boundaries, and preparing the reframed video feed in advance, the system reduces the computational burden during real-time processing. This preliminary action enables accurate background replacement while minimizing overall processing time.
Solution Approach 2:
The patent applies partial processing by focusing computational resources only on the background layer and its surrounding regions rather than processing the entire video feed uniformly. By concentrating reframing and replacement operations on the specific background area identified through chroma key detection, the system achieves high accuracy background replacement with reduced processing time compared to full-video processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables a smoother virtual background experience without the need for expensive equipment, providing professional-looking environments for users in various locations.
Implementation Method 1
A method provides a virtual background within a communication session using dynamic chroma key reframing. The method includes determining a background layer of a video feed, determining a plurality of edges for the background layer, cropping and reframing the video feed around the edges of the background layer, removing the background layer from the video feed, and adding a selected or provided virtual background to the background layer of the video feed.
Data Source
AI summary
Methods and systems provide for providing a virtual background within a communication session using dynamic chroma key reframing. In one embodiment, a user interface is displayed including at least one video feed corresponding to a participant of the communication session. The method receives a request to enable a selected or provided virtual background using chroma keying. The method then determines a background layer of the video feed. The method also determines edges for the background layer. Next, the method crops and reframes the video feed around the edges of the background layer. The method then removes the background layer from the video feed, and adds the selected or provided virtual background to the background layer of the video feed. Finally, the method displays the video feed within the communication session.