Merge Estimation Region Marking for VVC Coding Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing video coding technologies, such as HEVC, face challenges in efficiently performing merge estimation with non-square partition patterns used in VVC, leading to degraded coding performance and limited parallel processing due to inconsistent merge estimation regions.

Innovation Solution

The proposed solution involves marking candidate coding blocks as available or unavailable based on extended merge estimation regions, allowing for flexible merge estimation even with irregular CTU partitions, by comparing specific point coordinates within the current coding block's MER, thereby enabling parallel processing of more coding blocks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If HEVC merge estimation is applied to VVC irregular partitions, then coding performance degrades, but implementing new partition-aware merge estimation increases device complexity

Engineering Contradiction:
Improvecoding performanceVSAvoidmerge estimation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the parameters of merge estimation by introducing extended MER regions and alternative availability checking methods that are adapted to irregular VVC partitions. Instead of using the original HEVC square-MER-based approach, the patent modifies the MER extent and candidate selection criteria to work with non-square partitions, thereby maintaining coding performance without requiring complete redesign of the merge estimation mechanism

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the merge estimation process into distinct phases: determining MER extent based on partition type, checking candidate availability within extended regions, and selecting candidates from available blocks. This segmentation allows the system to handle irregular partitions systematically while keeping each sub-task manageable and avoiding overall complexity increase

Inventive Principle:
Principle #1Segmentation

2Productivity

If parallel processing is limited by inconsistent MER, then processing speed decreases, but expanding MER increases memory access complexity

Engineering Contradiction:
Improveparallel processing speedVSAvoidmemory access complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces dynamic MER extent determination that adapts to partition characteristics. For non-square partitions, the MER region is extended in specific directions based on partition orientation and size, allowing parallel processing to proceed efficiently while memory access patterns remain adapted to the actual partition geometry rather than fixed square regions

Inventive Principle:
Principle #15Dynamics

3Productivity

If merge candidate list is restricted by MER boundaries, then coding efficiency decreases, but removing restriction increases computational load

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcomputational load
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The patent applies local quality by treating different spatial regions differently in the merge candidate selection process. Within the extended MER, certain directional neighbors are prioritized based on their likelihood of providing good motion predictors for irregular partitions. This localized optimization improves coding efficiency without requiring exhaustive search of all possible candidates, thus controlling computational load

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11750835B2Coding method, device, system with merge mode
Publication Date: 2023.09.05 HUAWEI TECH CO LTD
  • US11750835B2 patent drawing
  • US11750835B2 patent drawing
  • US11750835B2 patent drawing

AI summary

An apparatus and method for marking availability of a candidate coding block for merge estimation of a current coding block within a coding tree unit, CTU, which includes multiple coding blocks. Initially, the candidate coding block is marked as available. The candidate coding block is marked as unavailable when a predefined location of the candidate coding block is included within an extended merge estimation region, MER. The extended MER includes a current MER in which the current coding block is located and at least a portion of another MER, adjacent to the current MER.