Chroma Keying Pixel Processing for Bandwidth and Distortion Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional chroma keying techniques unnecessarily consume processing and bandwidth resources and result in image distortions due to the inclusion of keyed pixels in image processing operations, which affect the quality of the composited image.
Innovation Solution
The method involves generating and storing chroma keying information to identify pixels with a keying color value before image processing, allowing for the modification of processing operations to omit unnecessary steps and avoid distortion by distinguishing between keyed pixels and foreground object pixels, thereby reducing power and bandwidth consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If all pixels in the foreground frame are processed through image processing operations, then complete processing coverage is achieved, but processing resources and bandwidth are consumed unnecessarily for keyed pixels that will be replaced
Solution Approach 1:
The chroma keying detection is performed before the image processing operations to identify which pixels are keyed pixels. This preliminary action allows the system to skip processing operations on keyed pixels that will be replaced by background pixels, thereby reducing unnecessary processing resource consumption while maintaining processing completeness for actual foreground content.
Solution Approach 2:
Different processing treatments are applied to different regions of the foreground frame based on whether each pixel is identified as a keyed pixel or a foreground object pixel. Keyed pixels are excluded from certain processing operations while foreground object pixels receive full processing, optimizing resource usage according to the specific needs of each pixel type.
2Manufacturing precision
If image processing operations are performed on keyed pixels, then processing uniformity is maintained, but image distortions occur at borders between keyed pixels and foreground objects
Solution Approach 1:
The system applies different processing operations to keyed pixels versus foreground object pixels based on local pixel classification. By identifying keyed pixels through chroma keying detection before processing, the system can exclude them from operations like filtering and scaling that would cause border distortions, while maintaining uniform processing on actual foreground objects.
Solution Approach 2:
Chroma keying detection is performed as a preliminary step before image processing to classify each pixel. This early identification allows the system to prevent distortion by excluding keyed pixels from processing operations that would otherwise be applied uniformly, thereby maintaining image quality without sacrificing operational simplicity.
3Manufacturing precision
If filtering operations use a window that includes both keyed pixels and foreground object pixels, then filtering coverage is complete, but the foreground object values are distorted by keyed pixel values
Solution Approach 1:
The filtering operation is modified to treat keyed pixels and foreground object pixels differently within the same filter window. When a filter window contains both types of pixels, the system identifies and excludes keyed pixel values from the filtering calculation, ensuring that foreground object pixels are not distorted by keyed pixel values while still maintaining filtering coverage across the entire image region.
4Device complexity
If chroma keying detection is performed after image processing, then processing workflow is simplified, but processing resources are wasted on keyed pixels and image distortions occur
Solution Approach 1:
The chroma keying detection is moved to occur before the image processing operations rather than after. This preliminary detection establishes knowledge of which pixels are keyed pixels, allowing the subsequent processing operations to be optimized by excluding keyed pixels. While this adds a detection step, it eliminates the waste of processing resources on keyed pixels and prevents image distortions, resulting in net efficiency improvement.
Data Source
AI summary
An apparatus for providing a foreground frame to be composited with a background frame in a chroma-keying arrangement, each of the foreground frame and the background frame comprising one or more regions that together form the respective frame. A detection module determines whether each frame region has a predetermined colour value and generates and stores chroma keying information based on the determination. Control circuitry then controls image processing to be performed on the region according to the stored chroma keying information.