Decoder Motion Vector Refinement via Bilateral Template Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding techniques face challenges in efficiently decoding motion vectors across multiple reference pictures, leading to increased bandwidth and storage requirements due to redundancy in video data.
Innovation Solution
The method involves generating a bilateral template from a weighted combination of reference blocks and refining motion vectors using a cost measure such as SAD, MSE, or MAD, allowing for improved motion compensation and reduced data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion vectors are coded directly without prediction, then decoding accuracy is maintained, but bandwidth and storage requirements increase significantly
Solution Approach 1:
The patent applies preliminary action by performing motion vector prediction before actual motion compensation. The decoder predicts motion vectors for current blocks based on motion vectors of previously decoded neighboring blocks, preparing prediction data in advance to reduce the amount of data that needs to be transmitted and stored while maintaining decoding accuracy
Solution Approach 2:
The patent uses copying by creating prediction motion vectors that are copies or approximations of the actual motion vectors. These predicted motion vectors are derived from neighboring block motion vectors and serve as substitutes for the full motion vector data, reducing bandwidth and storage requirements while maintaining sufficient decoding accuracy
2Productivity
If motion vector prediction is applied to reduce data redundancy, then compression ratio improves, but decoding complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the motion vector prediction process into distinct stages: identifying neighboring blocks, extracting their motion vectors, generating prediction candidates, and selecting the best match. This segmented approach organizes the complexity into manageable steps, improving compression ratio while making the decoding process more systematic and efficient
Solution Approach 2:
The patent uses partial action by implementing motion vector prediction only for blocks where it provides benefit, rather than applying it universally. The decoder selectively performs prediction based on block characteristics and available neighboring data, achieving improved compression ratio without unnecessarily increasing decoding complexity for all blocks
3Measurement precision
If multiple reference pictures are used for bi-prediction, then motion compensation accuracy improves, but data transmission requirements increase
Solution Approach 1:
The patent applies merging by combining motion vector prediction from multiple reference pictures into a unified prediction process. The decoder merges motion information from first and second reference pictures, using bilateral template matching to combine motion vectors and generate a single refined motion vector, improving motion compensation accuracy while reducing redundant data transmission
Solution Approach 2:
The patent uses an intermediary approach by introducing bilateral templates as intermediate structures. These templates are generated from reference blocks in multiple pictures and serve as mediators to derive refined motion vectors. The bilateral templates enable accurate motion compensation from multiple references while reducing the amount of raw motion vector data that needs to be transmitted
Data Source
AI summary
A first motion vector and a second motion vector are determined for a first block in a current picture of a video, where the first motion vector is indicative of a first reference block in a first picture, and the second motion vector is indicative of a second reference block in a second picture. A bilateral template is generated based on a weighted combination of the first reference block and the second reference block. A refined first motion vector is determined based on the bilateral template and a first set of reference blocks in the first picture. A refined second motion vector is determined based on the bilateral template and a second set of reference blocks in the second picture. Prediction information of the first block is generated according to (i) the refined first motion vector, (ii) the refined second motion vector, and (iii) a final motion compensation interpolation filter.