Motion Estimation Regions for SbTMVP Merge Candidate Construction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in efficiently encoding and decoding high-definition and ultra-high-definition video data while maintaining image quality, particularly in constructing merge candidate lists for video blocks.

Innovation Solution

Implementing methods and apparatus for constructing merge candidate lists that utilize Motion Estimation Regions (MER) and subblock-based temporal motion vector prediction (SbTMVP) modes to determine and set temporal vectors or select alternative merge candidates based on spatial neighboring blocks within the same MER.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional merge candidate list construction is used, then coding compatibility is maintained, but encoding efficiency and compression performance deteriorate for high-definition and ultra-high-definition video data

Engineering Contradiction:
Improveencoding efficiencyVSAvoidmerge candidate list construction complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the video block into multiple subblocks and constructs merge candidate lists separately for each subblock. This segmentation allows the use of subblock-based temporal motion vector prediction (SbTMVP) modes, which improve encoding efficiency by capturing local motion variations in different parts of the block, while the segmented approach itself manages complexity by breaking down the overall construction process into manageable subblock-level operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by using different prediction modes (spatial merge candidates vs. temporal SbTMVP candidates) for different subblocks based on their local characteristics. Each subblock can select the most appropriate merge candidate from its local candidate list, allowing the encoding to adapt to local motion patterns and improve overall compression performance without requiring a completely new complex framework.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If more merge candidates are included in the list, then prediction accuracy improves, but computational complexity and processing time increase

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoidcandidate list processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

By segmenting the candidate list construction into subblock-specific lists, the patent achieves higher effective prediction accuracy for each subblock without requiring an excessively long overall candidate list. Each subblock gets tailored candidates from its local spatial and temporal contexts, improving precision while the segmentation naturally limits the complexity of each individual subblock's candidate set.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of merge candidate construction by introducing subblock-level granularity and SbTMVP mode indicators. Instead of using a single uniform candidate list for the entire block, the system varies the candidate selection parameters at the subblock level, allowing more precise motion prediction while managing complexity through parameterized candidate generation rather than brute-force enumeration.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If subblock-based temporal motion vector prediction is implemented, then compression performance improves, but determination complexity and processing overhead increase

Engineering Contradiction:
Improvecompression performanceVSAvoidSbTMVP mode determination complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-determining spatial neighboring blocks and their merge candidates before final merge candidate list construction. The encoder/decoder checks whether spatial neighboring blocks are available and pre-computes their merge candidates, which are then used to generate temporal SbTMVP candidates. This preliminary preparation reduces the complexity of the main SbTMVP determination process and improves compression performance by having ready-to-use candidates.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses self-service by having spatial neighboring blocks serve the current block's merge candidate needs. The spatial neighboring blocks' merge candidates automatically become the temporal SbTMVP candidates for the current block, eliminating the need for separate complex temporal prediction computations. This self-service mechanism improves compression performance while keeping the determination process relatively simple.

Inventive Principle:
Principle #25Self-service

4Measurement precision

If spatial neighboring blocks are used for merge candidate determination, then temporal prediction accuracy improves, but reliability deteriorates when neighboring blocks are unavailable or outside Motion Estimation Regions

Engineering Contradiction:
Improvetemporal vector determination accuracyVSAvoidmerge candidate availability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies beforehand cushioning by checking the availability of spatial neighboring blocks and their merge candidates before relying on them for SbTMVP mode. The encoder/decoder determines whether spatial neighboring blocks exist and whether they are within valid Motion Estimation Regions before using them as sources for temporal prediction candidates. This preparatory validation ensures reliability by avoiding references to unavailable or invalid blocks, while still allowing high accuracy when valid neighbors are available.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent uses an intermediary approach by introducing a validity check mechanism that mediates between the desire to use spatial neighboring blocks for accurate temporal prediction and the need to ensure their availability. The system checks whether spatial neighboring blocks are valid intermediaries (within MER, properly decoded) before using them to generate temporal SbTMVP candidates, ensuring both accuracy and reliability in the prediction process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12382088B2Motion estimation region for the merge candidates
Publication Date: 2025.08.05 BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
  • US12382088B2 patent drawing
  • US12382088B2 patent drawing
  • US12382088B2 patent drawing

AI summary

An electronic apparatus performs a method of encoding and decoding video data. The method comprises: receiving, from a bitstream, the video data corresponding to a coding unit; receiving, from the video data, a first syntax element that defines a Motion Estimation Region (MER); receiving a plurality of second syntax elements from the video data, wherein the plurality of second syntax elements indicate whether the coding unit is in a subblock-based temporal motion vector prediction (SbTMVP) mode; in accordance with a determination that the coding unit is in the SbTMVP mode, determining whether both a spatial neighboring block used to determine a temporal vector of the coding unit and the coding unit are within the same MER; and in accordance with a determination that both the spatial neighboring block and the coding unit are within the same MER, setting the temporal vector of the coding unit to zero.