Video Encoder Chroma Quantization Offset for Mixed Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards, such as H.265/HEVC, face challenges in achieving optimal rate-distortion performance for mixed content containing both natural scenes and computer-generated graphics, as chroma subsampling leads to blurriness and increased bit rate when upsampled to 4:4:4 format, resulting in unjustified cost in terms of bit rate for minimal perceptual improvement.
Innovation Solution
The proposed solution involves adjusting quantization parameters in low-fidelity areas of the picture to emulate 4:2:0 format coding, by using a low-fidelity-mode offset for chroma components, which allows for more aggressive quantization and restricted partitioning of larger transform blocks, effectively balancing rate-distortion costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If chroma subsampling (4:2:0 format) is used to reduce bit rate, then bit rate is reduced, but chroma fidelity deteriorates and blurriness increases when upsampled to 4:4:4 format
Solution Approach 1:
The patent applies different quantization strategies to different regions of the video content. Natural scene regions use aggressive quantization (low-fidelity mode) to reduce bit rate, while computer-generated graphic regions use standard quantization to maintain sharp color edges. This is achieved through content classification and region-specific quantization parameter adjustment.
Solution Approach 2:
The patent dynamically adjusts quantization parameters based on content type and fidelity requirements. By modifying quantization parameters for chroma components in low-fidelity mode, the system achieves better rate-distortion performance for natural scenes while avoiding the blurriness problem in computer-generated content.
2Quantity of substance
If aggressive quantization is applied to reduce bit rate, then bit rate is reduced, but distortion increases and visual quality deteriorates
Solution Approach 1:
The patent applies aggressive quantization only to natural scene regions where human perception is less sensitive to chroma details, while maintaining standard quantization for computer-generated graphic regions. This selective approach reduces overall bit rate without introducing noticeable distortion in critical areas.
Solution Approach 2:
The patent converts the potential harm of aggressive quantization into a benefit by strategically applying it only where human perception is least sensitive (natural scenes with smooth color transitions), while protecting sensitive regions (computer-generated graphics with sharp edges) from quantization damage.
3Manufacturing precision
If standard quantization is used to maintain chroma fidelity, then chroma fidelity is maintained, but bit rate increases without proportional perceptual improvement
Solution Approach 1:
The patent dynamically adjusts quantization parameters based on content analysis. For natural scenes, it uses lower quantization parameters (higher fidelity) where perceptual improvement is noticeable, and for computer-generated content, it uses higher quantization parameters (lower fidelity) where standard quantization already provides acceptable quality, thereby optimizing bit rate efficiency.
4Manufacturing precision
If chroma subsampling is avoided to maintain sharp color edges in computer-generated content, then color edge definition is improved, but bit rate increases significantly
Solution Approach 1:
The patent identifies computer-generated graphic regions and applies standard quantization specifically to those areas to preserve sharp color edges, while applying aggressive quantization only to natural scene regions. This localized approach maintains color edge definition where needed without incurring the full bit rate cost across the entire video stream.
Data Source
AI summary
Methods of encoding and decoding video in a low-fidelity mode are described. A coding unit level low-fidelity flag is present in the bitstream to signal whether low-fidelity mode is enabled for a particular coding unit or not. If enabled, then, for that coding unit, the chroma quantization parameter is determined using the luma quantization parameter adjusted by a low-fidelity-mode offset. If not enabled, then, for that coding unit, the chroma quantization parameter is determined using the luma quantization parameter without adjustment by the low-fidelity-mode offset. The chroma quantization parameter is then used in the scaling of quantized chroma transform domain coefficients. Use with luma or other video components is also proposed.