Merge Candidate Availability in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing video coding technologies, such as HEVC, face challenges in efficiently handling non-square partition patterns introduced by new partition modes in VVC, which degrade coding performance and parallel processing efficiency in merge estimation due to inconsistent MER conditions.

Innovation Solution

The proposed solution involves marking candidate coding blocks as available or unavailable based on specific MER conditions and splitting depth within a CTU, allowing parallel processing even with irregular patterns, and determining MER grid dimensions to improve merge estimation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If new partition modes (BT and TT) are introduced in VVC to improve coding flexibility, then adaptability is improved, but MER condition consistency deteriorates causing degraded coding performance and parallel processing efficiency

Engineering Contradiction:
Improvecoding flexibilityVSAvoidcoding performance
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the merge candidate selection process by introducing separate handling for different partition types. It divides the candidate block availability determination into distinct cases: QT partitions follow traditional MER rules, while BT and TT partitions use modified availability checking that accounts for their non-square geometry. This segmentation allows each partition type to be optimized independently, resolving the conflict between flexibility and performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by making the merge candidate availability rules location-dependent and pattern-dependent. Different MER condition checks are applied based on the specific partition pattern (QT, BT, or TT) and the relative positions of candidate blocks. This localized approach ensures that each region is evaluated with appropriate criteria, maintaining coding performance across diverse partition patterns.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If new partition modes (BT and TT) are introduced in VVC to improve coding flexibility, then adaptability is improved, but parallel processing efficiency deteriorates due to inconsistent MER conditions

Engineering Contradiction:
Improvecoding flexibilityVSAvoidparallel processing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the parallel processing workflow by introducing independent availability determination for different partition types. QT partitions can be processed with traditional MER rules, while BT and TT partitions use specialized availability checks that don't rely on square-grid assumptions. This segmentation enables parallel processing units to handle different partition types independently without waiting for MER condition resolution, improving overall parallel efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters used for MER condition evaluation when dealing with BT and TT partitions. Instead of using fixed square-grid based MER rules, the patent modifies the availability checking parameters to account for non-square block geometries. This parameter adaptation allows parallel processing to proceed efficiently with irregular partition patterns while maintaining coding accuracy.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If traditional MER conditions are applied to non-square partition patterns, then device complexity is reduced, but measurement precision deteriorates leading to inaccurate merge estimation

Engineering Contradiction:
Improveprocessing simplicityVSAvoidmerge estimation accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by implementing location-aware availability checking for merge candidates. The determination of whether a candidate block is available depends on its specific position relative to the current block and the partition pattern type. This localized precision ensures accurate merge estimation for each candidate without requiring complex global re-evaluation, balancing simplicity and accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the evaluation parameters for merge candidate availability based on partition pattern characteristics. For BT and TT partitions, the patent modifies the spatial relationship checks and availability criteria to match the non-square geometry. These parameter adjustments maintain processing simplicity while significantly improving merge estimation accuracy for irregular partitions compared to traditional square-grid assumptions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11343533B2Coding method, device, system with merge mode
Publication Date: 2022.05.24 HUAWEI TECH CO LTD
  • US11343533B2 patent drawing
  • US11343533B2 patent drawing
  • US11343533B2 patent drawing

AI summary

An apparatus and method for marking availability of a candidate coding block for merge estimation of a current coding block within a coding tree unit (CTU). The candidate block may be marked as unavailable if a splitting depth of the current coding block is equal to or larger than a predetermined threshold and a first location of the candidate block and a second location of the current block are included in a same merge estimation region (MER). Otherwise, the candidate block is marked as available. A candidate block may be marked as unavailable also, when a parent block “parentCurr” of the current block and a parent block “parentCand” of the candidate block, with both parent blocks obtained by splitting, are the same block and when the size of the parentCand is smaller than a threshold.