Motion Estimation Regions for SbTMVP Merge Candidate Construction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently encoding and decoding high-definition and ultra-high-definition video data while maintaining image quality, particularly in constructing merge candidate lists for video blocks.
Innovation Solution
Implementing methods and apparatus for constructing merge candidate lists that utilize Motion Estimation Regions (MER) and subblock-based temporal motion vector prediction (SbTMVP) modes to determine and set temporal vectors or select alternative merge candidates based on spatial neighboring blocks within the same MER.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional merge candidate list construction is used, then coding compatibility is maintained, but encoding efficiency and compression performance deteriorate for high-definition and ultra-high-definition video data
Solution Approach 1:
The patent segments the video block into multiple subblocks and constructs merge candidate lists separately for each subblock. This segmentation allows the use of subblock-based temporal motion vector prediction (SbTMVP) modes, which improve encoding efficiency by capturing local motion variations in different parts of the block, while the segmented approach itself manages complexity by breaking down the overall construction process into manageable subblock-level operations.
Solution Approach 2:
The patent applies local quality by using different prediction modes (spatial merge candidates vs. temporal SbTMVP candidates) for different subblocks based on their local characteristics. Each subblock can select the most appropriate merge candidate from its local candidate list, allowing the encoding to adapt to local motion patterns and improve overall compression performance without requiring a completely new complex framework.
2Measurement precision
If more merge candidates are included in the list, then prediction accuracy improves, but computational complexity and processing time increase
Solution Approach 1:
By segmenting the candidate list construction into subblock-specific lists, the patent achieves higher effective prediction accuracy for each subblock without requiring an excessively long overall candidate list. Each subblock gets tailored candidates from its local spatial and temporal contexts, improving precision while the segmentation naturally limits the complexity of each individual subblock's candidate set.
Solution Approach 2:
The patent changes the parameters of merge candidate construction by introducing subblock-level granularity and SbTMVP mode indicators. Instead of using a single uniform candidate list for the entire block, the system varies the candidate selection parameters at the subblock level, allowing more precise motion prediction while managing complexity through parameterized candidate generation rather than brute-force enumeration.
3Productivity
If subblock-based temporal motion vector prediction is implemented, then compression performance improves, but determination complexity and processing overhead increase
Solution Approach 1:
The patent performs preliminary action by pre-determining spatial neighboring blocks and their merge candidates before final merge candidate list construction. The encoder/decoder checks whether spatial neighboring blocks are available and pre-computes their merge candidates, which are then used to generate temporal SbTMVP candidates. This preliminary preparation reduces the complexity of the main SbTMVP determination process and improves compression performance by having ready-to-use candidates.
Solution Approach 2:
The system uses self-service by having spatial neighboring blocks serve the current block's merge candidate needs. The spatial neighboring blocks' merge candidates automatically become the temporal SbTMVP candidates for the current block, eliminating the need for separate complex temporal prediction computations. This self-service mechanism improves compression performance while keeping the determination process relatively simple.
4Measurement precision
If spatial neighboring blocks are used for merge candidate determination, then temporal prediction accuracy improves, but reliability deteriorates when neighboring blocks are unavailable or outside Motion Estimation Regions
Solution Approach 1:
The patent applies beforehand cushioning by checking the availability of spatial neighboring blocks and their merge candidates before relying on them for SbTMVP mode. The encoder/decoder determines whether spatial neighboring blocks exist and whether they are within valid Motion Estimation Regions before using them as sources for temporal prediction candidates. This preparatory validation ensures reliability by avoiding references to unavailable or invalid blocks, while still allowing high accuracy when valid neighbors are available.
Solution Approach 2:
The patent uses an intermediary approach by introducing a validity check mechanism that mediates between the desire to use spatial neighboring blocks for accurate temporal prediction and the need to ensure their availability. The system checks whether spatial neighboring blocks are valid intermediaries (within MER, properly decoded) before using them to generate temporal SbTMVP candidates, ensuring both accuracy and reliability in the prediction process.
Data Source
AI summary
An electronic apparatus performs a method of encoding and decoding video data. The method comprises: receiving, from a bitstream, the video data corresponding to a coding unit; receiving, from the video data, a first syntax element that defines a Motion Estimation Region (MER); receiving a plurality of second syntax elements from the video data, wherein the plurality of second syntax elements indicate whether the coding unit is in a subblock-based temporal motion vector prediction (SbTMVP) mode; in accordance with a determination that the coding unit is in the SbTMVP mode, determining whether both a spatial neighboring block used to determine a temporal vector of the coding unit and the coding unit are within the same MER; and in accordance with a determination that both the spatial neighboring block and the coding unit are within the same MER, setting the temporal vector of the coding unit to zero.


