Multi-Format Keying for Durable Chroma-Luma Video Backgrounds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video capturing methods like chroma and luma keying have limitations, such as requiring subjects to avoid certain colors or using expensive display walls, and materials like ultra-black backgrounds are prone to damage.
Innovation Solution
A method and system that combines luma and chroma keying by detecting regions of different luminance and hue in a video stream, using a floor and wall with specific reflectance properties to facilitate simultaneous replacement with replacement imagery, and a post-processing computer to perform real-time keying.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If chroma keying is used to replace background regions, then background replacement is achieved, but subjects cannot contain regions of the key color
Solution Approach 1:
The patent combines chroma keying and luma keying into a unified post-processing system that detects and replaces both chroma-keyed regions (based on color) and luma-keyed regions (based on luminance) simultaneously. This merging allows the system to overcome the limitation of chroma keying where subjects cannot contain key colors, by adding luma keying as a complementary mechanism that operates on brightness rather than color.
Solution Approach 2:
The post-processing system is designed to perform multiple keying functions (chroma keying and luma keying) within a single processing pipeline. The system can detect chroma keyed regions by color matching and luma keyed regions by luminance thresholding, providing universal background replacement capability that works regardless of whether the subject contains regions matching the chroma key color.
2Reliability
If luma keying is used with dark backgrounds, then subjects can be differentiated by luminance, but the dark background material is prone to mechanical damage
Solution Approach 1:
The patent divides the background into two distinct segments: a durable chroma key background (such as a colored wall or screen) and a luma key floor surface (with different reflectance properties). This segmentation allows each surface to be optimized for its specific function - the wall provides robust color-based keying while the floor provides luminance-based keying, and neither surface is subjected to the same mechanical stresses.
Solution Approach 2:
Different regions of the studio set are assigned different optical properties tailored to their specific keying needs. The wall is designed with chroma key properties (specific color hue) while the floor is designed with luma key properties (specific reflectance characteristics). This local optimization ensures that each surface maintains its durability while providing the appropriate keying function for its location.
3Productivity
If a display wall is used to show the desired background, then no post-processing replacement is needed, but the equipment cost increases significantly
Solution Approach 1:
Instead of using an expensive display wall to show the background in real-time, the patent uses inexpensive physical backgrounds (chroma key and luma key surfaces) that are captured by the camera and then replaced with digital replacement imagery through post-processing. This copying approach creates the illusion of a real-time display while avoiding the high equipment costs of actual display walls.
4Ease of operation
If the floor supports subjects during video capture, then natural positioning is achieved, but the floor material is susceptible to mechanical damage
Solution Approach 1:
The patent segments the background surfaces so that the floor is dedicated to supporting subjects with luma key properties, while the wall provides chroma key properties. The floor material is chosen for its durability and appropriate reflectance characteristics rather than for chroma key color stability, allowing it to withstand mechanical use while still providing effective luma keying for background replacement.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and damage-resistant video capturing with improved visual effects by reducing mechanical damage to backgrounds and minimizing reflections, allowing real-time processing of both keying types on the same video frame.
Implementation Method 1
the wall exposing an extended surface having a reflectance in the visible spectrum that is less than 10% and the floor exposing an extended surface of a uniform predetermined hue
Data Source
AI summary
A method for post processing video includes receiving an input video stream Luma keyed regions are detected in a portion of the video stream. Chroma keyed regions are detected in a portion of the video stream. The detected regions are replaced with regions from replacement imagery to form an output video stream.