Constrained Merge Flag Signaling in Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding systems face inefficiencies in signaling due to redundant mode flags, particularly when only one valid mode exists for a block, leading to unnecessary signaling and increased bandwidth requirements.

Innovation Solution

Implementing constrained mode signaling by skipping the regular flag for Merge or Skip modes when only one mode is valid, inferring the mode based on conditions such as block size and Sequence Parameter Set (SPS) flags, and using fallback modes when all other modes are disabled.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mode syntax is signaled for every block to indicate the current mode, then the decoder can accurately determine the encoding mode, but redundant signaling occurs when only one mode is valid, increasing bandwidth requirements

Engineering Contradiction:
Improvemode indication accuracyVSAvoidsignaling bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts and removes redundant mode syntax signaling from the bitstream. When only one mode is valid for a block (determined by block size constraints or SPS flags), the corresponding mode syntax is not signaled, as the mode can be inferred from the block characteristics. This eliminates unnecessary signaling while maintaining accurate mode indication.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The decoder uses the block characteristics (size, SPS flags) to self-determine which mode is valid without requiring explicit signaling. The block itself provides the information needed to infer the mode, eliminating the need for separate mode indication syntax when only one mode is possible.

Inventive Principle:
Principle #25Self-service

2Productivity

If all candidate modes are always signaled to provide flexibility in mode selection, then the encoder can optimize coding efficiency, but unnecessary flags increase the bitstream size and processing complexity

Engineering Contradiction:
Improvecoding efficiencyVSAvoidsignaling complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies different signaling strategies to different blocks based on their local characteristics. For blocks where only one mode is valid (e.g., small blocks where subblock mode is not allowed), no mode syntax is signaled. For blocks where multiple modes are valid, the appropriate mode syntax is signaled. This localized approach optimizes both coding efficiency and signaling complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of always signaling all possible mode syntaxes (excessive action), the patent signals only the necessary mode syntax for each block (partial action). The amount of signaling is adjusted to match the actual mode selection needs, avoiding unnecessary flags while maintaining coding flexibility where required.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11432004B2Method and apparatus of constraining merge flag signaling in video coding
Publication Date: 2022.08.30 HFI INNOVATION INC
  • US11432004B2 patent drawing
  • US11432004B2 patent drawing
  • US11432004B2 patent drawing

AI summary

Method and apparatus for constrained mode signaling are disclosed. According to one method, a plurality of mode syntaxes are used to signal a current mode used for the current block. If one or more of the plurality of candidate modes are unavailable according to one or more conditions related to the current block, signaling a mode syntax is skipped at the video encoder side or parsing the mode syntax is skipped at the video decoder side. In one embodiment, a regular flag indicating on or off of a regular Merge mode or Skip mode is not signaled if Merge mode with MVD (MMVD) mode, Affine mode, subblock Temporal Motion Vector Prediction (SbTMVP) mode, Combined Inter and Intra Prediction (CIIP) Merge mode, and Triangle Prediction Mode (TPM) are disabled as indicated by an SPS flag.