Media Content Encoding Noise Reduction via Residual Coefficient Attenuation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media content encoding techniques face challenges in efficiently encoding noisy media content, particularly in standards like HEVC/H.265, where noise is often concentrated in high frequency residual coefficients, leading to inefficient bit usage and noticeable flickering due to varying quantization parameters across different image frame portions.
Innovation Solution
The proposed solution involves applying a Discrete Cosine Transform to transform residual coefficients into the frequency domain, identifying and modifying or attenuating isolated high frequency residual coefficients based on noise levels, and constraining quantization parameters to ensure consistent quality across image frame portions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If standard compression algorithms are used to encode noisy media content, then the media content can be transmitted and decoded for playback, but noise in high frequency residual coefficients consumes excessive bits and degrades visual quality
Solution Approach 1:
The patent extracts and removes isolated non-zero high frequency residual coefficients that represent noise from the compressed media content. By identifying and eliminating these noise-specific coefficients after decoding, the system reduces bit waste on noise while preserving visual quality of actual content.
Solution Approach 2:
The patent applies different processing to different frequency components: high frequency residual coefficients are selectively removed or attenuated while low and mid-frequency coefficients are preserved. This local differentiation optimizes bit allocation by treating noise-prone high frequencies differently from content-carrying lower frequencies.
2Adaptability or versatility
If quantization parameters vary across different portions of image frames, then encoding can be adapted to local content characteristics, but noticeable flickering occurs during playback
Solution Approach 1:
The patent merges quantization parameter control across multiple portions of image frames by applying similar or identical quantization parameters to adjacent blocks. This reduces the variation between neighboring regions, eliminating flickering while maintaining overall encoding adaptability through content-based parameter selection.
3Loss of information
If high frequency residual coefficients are preserved during compression, then more detail information is retained, but noise consumption increases bit usage without improving visual quality
Solution Approach 1:
The patent converts the harmful effect of high frequency noise into a benefit by selectively removing isolated non-zero high frequency residual coefficients. This transforms the problem of noise consumption into an opportunity to reduce bit usage while maintaining or improving visual quality through intelligent coefficient elimination.
Data Source
AI summary
Techniques are described for encoding noisy media content. A residual coefficient matrix representing differences in image content between a portion of a target image frame and portions of one or more reference frames can include noise within a high frequency band. Some of the noise can be removed by removing isolated residual coefficients. Some of the noise can be reduced by attenuating their values selectively.