3D Color Space Keying for Video Halo Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current media editing applications face difficulties in accurately isolating and modifying specific color portions in images or videos, particularly when dealing with blue or green screens, due to challenges in tracing boundaries and identifying accurate color spaces, which can result in halo effects and inaccurate edits.
Innovation Solution
A novel keyer system that identifies and selects portions of a color space based on pixel samples, using user-interface tools to generate and modify three-dimensional key and transition regions within the color space, allowing for precise selection and editing of image pixels based on their selection extent.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a user traces over an image to select a portion, then the user can modify that portion, but it is difficult for a user to accurately trace the boundaries of an item in an image
Solution Approach 1:
The patent replaces the manual mechanical tracing operation with an automated color-space-based selection system. Instead of requiring users to manually trace boundaries, the system automatically identifies and selects regions based on color similarity in a defined color space, substituting manual boundary-drawing operations with automated color-based region detection.
Solution Approach 2:
The patent changes the selection parameter from spatial coordinates (tracing paths) to color space parameters (color ranges). By defining selection criteria in terms of color values rather than spatial boundaries, the system enables accurate region selection without requiring manual boundary tracing, thus improving both ease of operation and boundary accuracy.
2Extent of automation
If the key is defined as a portion of a color space, then the selection can be automated, but identifying an accurate portion of the color space is difficult, especially when accounting for halos
Solution Approach 1:
The patent applies local quality by allowing different regions of the color space to have different selection characteristics. The system can define different portions of the color space with different inclusion criteria, enabling precise control over which color values are selected and which represent halos to be excluded, thus maintaining automation while improving color space accuracy.
Solution Approach 2:
The patent segments the color space into distinct selectable regions, separating the desired subject colors from the halo colors. By dividing the color space into multiple discrete portions that can be independently defined and controlled, the system enables automated keying while accurately distinguishing between actual subject areas and halo artifacts.
3Ease of operation
If a two-dimensional shape is used for the key in color space, then the key can be visually represented, but it does not account for variations in the third dimension of color space
Solution Approach 1:
The patent extends the two-dimensional color space representation into three dimensions by adding depth information. The system maintains visual representation capabilities while incorporating the third color dimension, allowing the key to accurately represent color ranges in all three dimensions of color space rather than being limited to a flat two-dimensional projection.
Data Source
AI summary
Some embodiments provide a method for editing an image that includes several pixels having pixel values in a color space. The method identifies (i) a shape in a plane of two dimensions of the color space and (ii) a range in a third dimension of the color space over which the first shape is propagated to form a first volume in the color space. Pixels whose pixel values are in the first volume of the color space are fully selected. The method displays a deformable curve along the third dimension that represents the manner in which the shape is propagated over the range of the color space.