Bilateral Template Motion Vector Refinement for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current motion compensation techniques in video coding, such as those used in HEVC, face challenges in reducing bandwidth and computational complexity while improving coding efficiency, particularly in the Bilateral Template MV Refinement process.
Innovation Solution
The implementation of Bilateral Template MV Refinement, which refines motion vectors at the decoder side using a two-stage search process and template matching, allows for improved motion estimation and compensation, reducing the need for explicit transmission of motion information and adapting to different block sizes and resolutions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If Bilateral Template MV Refinement is applied to all blocks, then motion compensation accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent applies Bilateral Template MV Refinement selectively based on block characteristics (size, motion complexity, prediction mode) rather than uniformly to all blocks. This local quality approach ensures high motion compensation accuracy for blocks that benefit most from refinement while avoiding unnecessary computational overhead for blocks where refinement provides minimal improvement.
Solution Approach 2:
The patent modifies the refinement process by adjusting search range, template size, and matching criteria based on block properties such as size, motion vector magnitude, and prediction mode. These parameter changes allow the system to maintain high accuracy for complex blocks while reducing computational complexity for simpler blocks.
2Productivity
If Bilateral Template MV Refinement is applied to all blocks, then coding efficiency is improved, but bandwidth consumption increases
Solution Approach 1:
The patent transmits refinement information selectively only for blocks where Bilateral Template MV Refinement is applied, rather than for all blocks. This local quality approach improves coding efficiency for blocks that require refinement while minimizing the additional bandwidth consumption by avoiding transmission of redundant refinement data for blocks where refinement is not applied.
3Measurement precision
If template matching is performed with large search range, then motion vector accuracy is improved, but processing time increases
Solution Approach 1:
The patent dynamically adjusts the template matching search range and precision based on block characteristics such as motion vector magnitude, block size, and motion complexity. For blocks with small motion or simple motion patterns, a reduced search range is used to decrease processing time. For blocks with large or complex motion, a larger search range is employed to maintain high motion vector accuracy.
Solution Approach 2:
The patent applies full-precision template matching only when necessary, using reduced-precision or limited-range matching for blocks where full precision would be excessive. This partial action approach maintains adequate motion vector accuracy for most blocks while significantly reducing processing time by avoiding unnecessary high-precision searches.
Data Source
AI summary
Method and apparatus of using Bilateral Template MV Refinement are disclosed to improve coding efficiency or reducing complexity. According to one method, if a size associated with the current block is greater than a threshold, then Bilateral Template MV Refinement is applied to the current block. Otherwise, the Bilateral Template MV Refinement is not applied to the current block. In another method, the Bilateral Template MV Refinement is turned on or off implicitly based on the two reference blocks. According to yet another method, the Bilateral Template MV Refinement is performed on the sub-block level. According to yet another method, the Bilateral Template MV Refinement is performed motion vectors selected from candidates of AMVP (advance MV prediction) candidate list. According to yet another method, the Bilateral Template MV Refinement used a modified template to refine motion vector.