Refining Internal Sub-block Motion Vectors for Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression tools, such as HEVC, face challenges in deriving motion vectors for internal sub-blocks, limiting compression performance as they cannot utilize neighboring encoded and reconstructed parts for sub-blocks not on the first row or column.
Innovation Solution
A method and apparatus that derive motion vectors for internal sub-blocks by refining information from neighboring sub-blocks along the left or top edge, using previously encoded data, and applying this refined information for encoding or decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion vectors are derived only from neighboring blocks previously encoded, then compression efficiency is improved through redundancy exploitation, but internal sub-blocks cannot utilize refined neighboring information for motion derivation
Solution Approach 1:
The patent applies preliminary action by first refining motion information for sub-blocks along the left or top edge before using this refined information for internal sub-blocks. This sequential refinement approach allows internal sub-blocks to benefit from previously processed neighboring information, resolving the limitation where internal sub-blocks could not access refined neighboring data.
Solution Approach 2:
The patent introduces a temporal dimension to the motion derivation process by utilizing previously encoded and reconstructed neighboring sub-blocks. Instead of treating all sub-blocks equally in the current encoding pass, the solution extends the derivation process to incorporate historical refinement data from adjacent sub-blocks, effectively adding a time-based dimension to spatial motion compensation.
2Measurement precision
If a CU is divided into multiple PUs and TUs, then prediction accuracy is improved, but device complexity increases due to multiple partitioning structures
Solution Approach 1:
The patent applies segmentation by dividing a Coding Unit (CU) into multiple Prediction Units (PUs) and Transform Units (TUs) with different partitioning structures. This allows the system to process different regions of the CU with appropriate granularity, improving prediction accuracy for complex motion patterns while maintaining manageable complexity through structured division.
Solution Approach 2:
The patent implements local quality by applying different refinement approaches to different sub-blocks based on their position and characteristics. Edge sub-blocks undergo refinement using neighboring information, while internal sub-blocks use the refined information from their neighbors. This localized processing strategy optimizes prediction accuracy where needed without uniformly increasing complexity across the entire CU.
Data Source
AI summary
Motion information for an internal sub-block of a larger block can be derived for use in encoding or decoding the video block or a coding unit by using the motion information for sub-blocks on the left or top edge of the coding block. The left column of edge sub-blocks and the top row of sub-blocks has motion information, such as motion vectors, derived using such techniques as template matching. The motion vectors of these edge sub-blocks are used in deriving the motion vectors of internal sub-blocks, which leads to better prediction and improved coding efficiency. In another embodiment, other motion information for internal sub-blocks is derived from corresponding information of the edge sub-blocks.