Reference Frame Reordering Using Template Matching in Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face inefficiencies in reference frame management, leading to suboptimal compression ratios and increased bandwidth requirements due to inadequate handling of motion vectors and intra prediction directions.
Innovation Solution
Adaptive reordering of reference frames using template matching (TM) to rank and reorder reference frames based on motion information differences, optimizing the use of spatial and temporal motion vectors for improved compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If reference frames are managed using traditional fixed ordering methods, then the video coding system maintains simple reference frame management, but compression ratios are suboptimal and bandwidth requirements increase
Solution Approach 1:
The patent implements dynamic reordering of reference frames based on template matching scores and motion vector characteristics. Instead of using a fixed reference frame order, the system adaptively determines the optimal ordering for each block by comparing templates and calculating scores that reflect the similarity between current block and reference frames. This dynamic approach allows the system to optimize compression ratios by selecting the most appropriate reference frames based on actual content characteristics rather than following a predetermined sequence.
Solution Approach 2:
The system changes the ordering parameter of reference frames based on calculated template matching scores and motion information. By computing scores that quantify the similarity between the current block template and reference frame templates, the system reorders reference frames according to these scores, placing the most similar references in optimal positions. This parameter-based reordering enables the system to adapt to different video content characteristics and achieve better compression efficiency.
2Loss of energy
If adaptive reordering with template matching is implemented, then compression ratios improve and bandwidth requirements reduce, but the complexity of reference frame management increases
Solution Approach 1:
The patent performs preliminary template matching and scoring of reference frames before the actual encoding process. By pre-calculating the similarity scores between current block templates and reference frame templates, the system identifies the optimal reference frame ordering in advance. This preliminary action allows the encoder to use the pre-determined optimal references during encoding, reducing the need for complex real-time calculations and minimizing bandwidth consumption without requiring excessive processing complexity during the main encoding phase.
3Productivity
If traditional motion vector handling is used, then the coding process remains simple, but redundancy in motion vectors and intra prediction increases
Solution Approach 1:
The patent extracts and utilizes motion information from multiple reference frames to predict the motion of the current block. By examining motion vectors from different reference frames and selecting the most appropriate ones based on template matching scores, the system removes redundancy in motion vector representation. Instead of relying on a single motion vector from a fixed reference frame, the system intelligently selects and combines motion information from multiple sources, reducing the amount of redundant data that needs to be encoded and transmitted.
Data Source
AI summary
This disclosure relates to adaptively reordering reference frames for video coding technologies. Template matching (TM) may be used to reorder the reference frames or reference frame pairs for each block by comparing the difference between the template of a current block and the template of a reference block with reference to the motion information of the spatial reference motion information (or spatial motion vectors) and/or temporal reference motion information (or temporal motion vectors). The difference between the template of current block and the template of the reference block may be calculated for each spatial reference motion information and/or temporal reference motion information, and marked as the score value of the associated reference frames or reference frame pairs. The available reference frames or reference frame pairs are ranked based on the score value.