Merge Flag Coding With Non-Empty Candidate Lists in Video Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current merge mode in video coding standards like HEVC results in high decoding overhead and error sensitivity due to conditional encoding of the merge flag, which depends on the size of the merging candidate list, leading to inefficient bit stream parsing and increased error resilience challenges.

Innovation Solution

Decoupling the encoding of the merge flag from the merging candidate list size ensures that a merge flag is always encoded for each inter-predicted prediction unit not using skip mode, allowing independent parsing and adding a zero motion vector candidate to guarantee a non-empty merging candidate list, thereby reducing overhead and enhancing error resilience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conditional encoding of merge flag is used based on merging candidate list size, then coding efficiency is improved, but decoding overhead increases and error resilience deteriorates

Engineering Contradiction:
Improvecoding efficiencyVSAvoiderror resilience
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the merge flag encoding process into two independent parts: (1) always encoding the merge flag for every inter-predicted PU regardless of candidate list size, and (2) separately handling the candidate list construction. This segmentation eliminates the coupling that causes error propagation, allowing the decoder to always expect a merge flag and independently construct the candidate list, thereby improving error resilience while maintaining coding efficiency through alternative signaling methods.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If conditional encoding of merge flag is used based on merging candidate list size, then bit stream parsing becomes complex, but coding flexibility is improved

Engineering Contradiction:
Improvecoding flexibilityVSAvoidbit stream parsing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent inverts the conventional approach by always encoding the merge flag instead of conditionally encoding it. This inversion simplifies the parsing logic because the decoder no longer needs to check candidate list size to determine whether to expect a merge flag. The coding flexibility previously achieved through conditional encoding is replaced by alternative methods such as always signaling the flag and using different candidate list construction rules, thereby reducing parsing complexity while maintaining adaptability.

Inventive Principle:
Principle #13The other way round (Inversion)

3Loss of time

If merging candidate list is allowed to be empty, then decoding overhead is reduced, but error sensitivity increases

Engineering Contradiction:
Improvedecoding overheadVSAvoiderror sensitivity
Core Design Contradiction:
Loss of timeVSObject-affected harmful factors

Solution Approach 1:

The patent applies beforehand cushioning by ensuring the merging candidate list is never empty through pre-defined rules for candidate selection and list construction. This protective measure prevents decoding errors that would occur with empty lists while minimizing overhead by establishing clear, deterministic rules for candidate inclusion. The decoder can always safely access at least one candidate, preventing errors without requiring complex error handling mechanisms that would increase overhead.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS11563950B2Parsing friendly and error resilient merge flag coding in video coding
Publication Date: 2023.01.24 TEXAS INSTRUMENTS INC
  • US11563950B2 patent drawing
  • US11563950B2 patent drawing
  • US11563950B2 patent drawing

AI summary

Methods and apparatus for parsing friendly and error resilient merge flag coding in video coding are provided. In some methods, in contrast to merging candidate list size dependent coding of the merge flag in the prior art, a merge flag is always encoded in the encoded bit stream for each inter-predicted prediction unit (PU) that is not encoded using skip mode. In some methods, in contrast to the prior art that allowed the merging candidate list to be empty, one or more zero motion vector merging candidates formatted according to the prediction type of the slice containing a PU are added to the merging candidate list if needed to ensure that the list is not empty and/or to ensure that the list contains a maximum number of merging candidates.