YUV Color Space Conversion for Compressed Video Graphics Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional graphics overlay systems are inefficient for layering multiple graphics planes on compressed digital video, requiring significant memory and separate blender hardware for each layer, and often result in video quality loss due to color space conversion issues.
Innovation Solution
A system that processes compressed video and graphics one macroblock at a time, converting between color space formats by basing chrominance values on the brightest pixel in the YUV 4:4:4 format to YUV 4:2:0 format, allowing real-time or faster-than-real-time processing without storing fully decoded frames and reducing tinting of high-intensity pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional scan-line graphics overlay system is used with compressed digital media, then the system is well adapted for analog or uncompressed media, but the system is poorly suited for compressed digital media that operate on macroblock basis
Solution Approach 1:
The patent divides the video frame into macroblocks, which are the basic processing units in compressed digital video. The graphics overlay system processes and blends graphics planes with video macroblocks rather than entire frames, enabling efficient operation on compressed digital media that uses macroblock-based compression algorithms.
2Reliability
If full frame video is decoded and stored in memory before blend operations, then complete video frames are available for processing, but significant memory is needed and real-time processing is prevented
Solution Approach 1:
Instead of decoding and storing entire video frames before processing, the system decodes and processes video macroblocks in real-time as they become available from the compressed stream. This segmentation approach eliminates the need for large frame buffers while maintaining processing completeness through macroblock-level operations.
Solution Approach 2:
The system continuously processes video macroblocks and graphics planes in real-time as data becomes available, rather than waiting to process complete frames after decoding. This continuous processing approach enables real-time graphics overlay on compressed video streams without requiring significant memory storage.
3Reliability
If separate blender hardware is used for each graphics plane, then each layer can be blended independently, but significant increases in cost and physical size occur as number of graphics planes increases
Solution Approach 1:
The patent combines multiple graphics planes into a single data structure and uses a single blender hardware unit to process all graphics layers simultaneously. The blender operates on macroblock-level data, blending multiple graphics planes and the video signal in one unified operation, thereby reducing hardware complexity while maintaining blending precision.
Solution Approach 2:
The single blender hardware unit is designed to handle multiple graphics planes and video signals universally. It can process different numbers and types of graphics layers through a unified macroblock-based blending algorithm, making the hardware versatile and reducing the need for separate dedicated blender units for each graphics plane.
4Ease of manufacture
If conventional color space conversion is used during compression, then YUV 4:2:0 format is produced, but high intensity pixels are tinted by chrominance components of neighboring low-intensity pixels resulting in video quality loss
Solution Approach 1:
The patent applies different chroma subsampling ratios to different regions of the video image based on local characteristics. High-intensity pixels and regions with significant chroma variation maintain higher chroma resolution (YUV 4:4:4), while low-intensity or uniform regions use reduced chroma subsampling (YUV 4:2:0). This local adaptation prevents tinting artifacts while maintaining compression efficiency.
Solution Approach 2:
Instead of applying uniform chroma subsampling across the entire image, the system applies chroma subsampling selectively and partially to regions where it is most beneficial. High-intensity pixels retain full chroma information to avoid tinting, while the system accepts some chroma loss in low-intensity regions to achieve compression efficiency.
Data Source
AI summary
Systems and methods for converting between a first color space format and a second color space format are described herein. The system receives a video cell in a first color space format comprising a plurality of pixels. Each pixel in the cell has a luminance value and a chrominance value. The luminance values of each pixel are compared to determine the brightest pixel in the received cell. The cell is downsampled to generate a second cell in a second color space format. The second cell in the second color space format comprises a downsampled chrominance value that is computed based at least in part on the chrominance value of the brightest pixel. The method advantageously reduces tinting of a high intensity pixel by the chrominance component of a neighboring low-intensity pixel.