Adaptive Video Filtering Resolution Using Decoder Metadata
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face issues with in-loop and post-filtering being applied at unsuitable resolutions, leading to a potential loss of quality due to blurring effects and reduced benefits from filtering processes like SAO edge offset and film grain synthesis when up-sampling is involved.
Innovation Solution
Implementing metadata to specify the appropriate spatial resolution for applying in-loop and post-filtering operations, allowing these processes to be performed at a resolution different from the initial reconstruction, thereby enhancing the effectiveness of filtering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If in-loop filtering and post-filtering are applied at the initial reconstruction resolution, then the filtering process is simple and computationally efficient, but the quality is degraded due to blurring effects when up-sampling is subsequently applied
Solution Approach 1:
The patent applies dynamics by making the filtering resolution adaptive rather than fixed. The system dynamically selects between filtering at the initial reconstruction resolution or at a different resolution based on whether up-sampling is applied. This is achieved through metadata indicating the second spatial resolution and conditions under which alternative filtering should be performed, allowing the filtering process to adapt to the specific rendering scenario.
Solution Approach 2:
The patent changes the spatial resolution parameter at which filtering is applied. Instead of always filtering at the initial reconstruction resolution, the system modifies this parameter to a second spatial resolution when metadata indicates that up-sampling will be applied. This parameter change ensures that filtering operations are performed at the appropriate resolution to maintain edge details and prevent blurring.
2Manufacturing precision
If filtering operations are applied at a higher resolution to preserve edge details, then video quality is improved, but computational complexity and processing time increase
Solution Approach 1:
The patent applies local quality by providing different filtering resolutions for different local scenarios. Instead of uniformly applying high-resolution filtering to all video content, the system uses metadata to indicate specifically when and where alternative filtering at a second spatial resolution should be applied. This allows high-quality filtering to be applied locally only where needed (when up-sampling is performed) rather than globally to all content.
Solution Approach 2:
The patent applies partial action by selectively applying the more complex filtering process only in specific cases where up-sampling is indicated by metadata. For content that does not require up-sampling, the system uses the simpler initial filtering approach. This partial application of the enhanced filtering process balances quality improvement with computational efficiency.
3Productivity
If filtering is applied at the reconstruction resolution, then processing speed is maintained, but the benefits of filtering processes like SAO edge offset and film grain synthesis are reduced when up-sampling is involved
Solution Approach 1:
The patent applies feedback by using metadata that provides information about the intended rendering resolution and up-sampling requirements. This feedback mechanism allows the system to adjust the filtering resolution accordingly. The metadata acts as a feedback signal that informs the filtering process about the downstream processing requirements, enabling the system to select the appropriate filtering resolution to maintain effectiveness.
Solution Approach 2:
The patent applies preliminary action by performing filtering operations at the appropriate resolution before up-sampling is applied. By using metadata to identify cases where up-sampling will occur, the system can proactively apply filtering at the second spatial resolution in advance, ensuring that edge details and film grain effects are preserved before the up-sampling process that would otherwise degrade them.
Data Source
AI summary
A method for video decoding pictures comprising: reconstructing (701) a picture at a first spatial resolution; and, obtaining (702) metadata associated to said picture representative of an information specifying that applying at least one in-loop filtering and/or at least one post-filtering on at least a portion of said reconstructed picture at a second spatial resolution different from the first resolution is allowed.