Combined Merge Candidates and Affine Models for Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression technologies face challenges in efficiently predicting pixel values across high-resolution and high-quality videos, particularly in constructing accurate merge candidate lists and performing inter-prediction, which affects encoding/decoding performance and accuracy.
Innovation Solution
A method and apparatus for constructing a merge candidate list that includes spatial, temporal, and combined merge candidates, deriving motion information through weighted averages, and performing inter-prediction using affine models and sub-block units to enhance prediction accuracy and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional inter-prediction technology is used, then video compression is achieved, but prediction accuracy decreases for high-resolution and high-quality videos
Solution Approach 1:
The patent divides the current block into multiple sub-blocks (first sub-block, second sub-block, etc.) and performs inter-prediction separately on each sub-block using sub-block motion vectors. This segmentation allows more precise motion estimation for different regions of the block, improving prediction accuracy while maintaining efficiency through parallel processing of sub-blocks.
Solution Approach 2:
The patent applies different motion vectors to different sub-blocks within the same block, allowing each sub-block to have optimized motion parameters tailored to its specific content and motion characteristics. This local quality approach improves prediction accuracy by avoiding the use of a single motion vector for the entire block, which would fail to capture local motion variations.
2Measurement precision
If merge candidate list is constructed with multiple candidates, then prediction accuracy improves, but device complexity increases
Solution Approach 1:
The patent combines multiple merge candidates (first merge candidate, second merge candidate, etc.) into a unified merge candidate list structure. Each candidate contains motion information for one or more sub-blocks, and the system efficiently manages these candidates through standardized combination rules, improving prediction accuracy while controlling complexity through structured organization.
Solution Approach 2:
The merge candidate list structure is designed to handle multiple types of motion information universally, accommodating different motion vector configurations, reference picture indices, and sub-block mappings through a single unified data structure. This multi-functionality reduces complexity by avoiding the need for separate handling mechanisms for different candidate types.
3Measurement precision
If sub-block based motion estimation is performed, then prediction accuracy improves, but processing time increases
Solution Approach 1:
The patent performs motion estimation for sub-blocks in a predetermined sequence and stores the resulting motion vectors for later use in inter-prediction. By preparing motion information in advance during the encoding process and organizing it efficiently, the system reduces processing time during actual prediction operations while maintaining high accuracy through comprehensive sub-block motion analysis.
Data Source
AI summary
A video encoding/decoding method is provided, which includes constructing a merge candidate list of a current block, deriving motion information of the current block from the merge candidate list, and performing inter-prediction of the current block using the motion information, where the merge candidate list includes at least one of a spatial merge candidate, a temporal merge candidate, or a combined merge candidate, and the combined merge candidate is derived by combining n merge candidates belonging to the merge candidate list. A video encoding/decoding apparatus is also provided.