Multi-Hypothesis Motion Compensation Coding with Implicit Prediction Flags

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding systems face limitations in flexibility and efficiency due to the fixed number of hypotheses in multi-hypothesis motion compensation (MHMC) coding, which restricts the representation of image data and increases signaling overhead, especially when expanding beyond two hypotheses, leading to higher bandwidth and power consumption.

Innovation Solution

The proposed solution introduces techniques to develop and signal multiple coding hypotheses for an input pixel block, allowing different block sizes and flexible partitioning, with advanced syntax elements to reduce signaling overhead and enable the use of multiple hypotheses, including implicit prediction flags and motion vector derivation methods to optimize coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of hypotheses in MHMC coding is increased beyond two, then the flexibility and representation capability of video coding is improved, but the signaling overhead, bandwidth, and power consumption increase considerably

Engineering Contradiction:
Improveflexibility of video codingVSAvoidsignaling overhead
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the hypothesis selection process by introducing implicit prediction flags that allow the decoder to infer certain hypotheses without explicit signaling. This divides the full set of hypothesis parameters into signaled and implicitly derived portions, reducing overall signaling overhead while maintaining support for multiple hypotheses

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of explicitly signaling all hypothesis parameters, the patent inverts the approach by having the decoder implicitly derive certain parameters from context and previously signaled data. This inversion reduces the amount of explicit signaling required while preserving the ability to use multiple hypotheses

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If the number of hypotheses in MHMC coding is increased beyond two, then the representation capability of image data is improved, but the bandwidth consumption increases by 33% or more

Engineering Contradiction:
Improverepresentation capabilityVSAvoidbandwidth consumption
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential hypothesis parameters that need explicit signaling, separating them from parameters that can be implicitly derived. This extraction approach reduces the quantity of data that must be transmitted, lowering bandwidth consumption while maintaining representation capability

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If the number of hypotheses in MHMC coding is increased beyond two, then the coding flexibility is improved, but the power consumption increases due to more complex data prefetching and memory management

Engineering Contradiction:
Improvecoding flexibilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary actions by establishing implicit prediction rules and flags before the actual hypothesis processing occurs. This allows the decoder to prepare and infer certain parameters in advance, reducing the computational burden and memory management complexity during active decoding, thereby lowering power consumption

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11924440B2Techniques of multi-hypothesis motion compensation
Publication Date: 2024.03.05 APPLE INC
  • US11924440B2 patent drawing
  • US11924440B2 patent drawing
  • US11924440B2 patent drawing

AI summary

The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.