Decoder Line Memory Harmonization for Video Intra-Mode Derivation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing decoder-side intra-mode derivation (DIMD) tool in video codecs increases decoder complexity and memory requirements, leading to higher power consumption and processing time due to the need for larger memory and repeated memory accesses for template matching during intra-prediction.
Innovation Solution
The proposed solution harmonizes the line memory requirements for the DIMD tool with deblocking filtering by selecting the template size and number of lines such that both can use the same line buffer, reducing the need for additional memory and optimizing buffer size, thereby allowing for common implementation with existing architectures without requiring a line buffer extension.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the decoder-side intra-mode derivation (DIMD) tool is implemented with template matching, then intra-prediction accuracy is improved, but memory requirements and decoder complexity increase
Solution Approach 1:
The patent merges the line memory used for deblocking filtering with the template memory required for DIMD tool operations. By harmonizing the memory requirements of both functions to use the same line buffer, the patent reduces overall memory bandwidth requirements and decoder complexity while maintaining the accuracy benefits of template matching-based intra-prediction.
2Measurement precision
If larger template size is used for DIMD tool, then intra-prediction accuracy is improved, but memory bandwidth requirements and processing time increase
Solution Approach 1:
The patent makes the line buffer serve multiple functions simultaneously - it is used for both deblocking filtering operations and template matching for DIMD tool. This multi-functional use of the same memory resource eliminates the need for separate memory allocations, reduces memory bandwidth requirements, and decreases processing time while maintaining accurate intra-prediction.
3Measurement precision
If separate line buffer is allocated for DIMD tool, then template matching accuracy is improved, but memory requirements and power consumption increase
Solution Approach 1:
The patent combines the memory resources for deblocking filter and DIMD tool into a single shared line buffer. This merging eliminates redundant memory allocations and reduces the total memory capacity required, which directly reduces power consumption associated with memory operations while maintaining the accuracy of template matching through adequate buffer size.
Data Source
AI summary
The present disclosure relates to image coding/decoding applying deblocking filtering and decoder-based intra-mode determination. In order to efficiently use software and/or hardware resources, the size of the template for the decoder-based intra-mode determination is smaller than the number of lines used by the deblocking filtering.