Multi-hypothesis Inter Prediction Bandwidth Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-Efficiency Video Coding (HEVC) faces challenges in reducing bandwidth requirements for Multi-hypothesis mode, particularly in Inter prediction, where existing methods do not effectively optimize coding settings to improve prediction efficiency and reduce computational complexity.

Innovation Solution

The proposed solution involves a Multi-hypothesis (MH) mode that combines a first predictor based on a first hypothesis with at least one second predictor based on a second hypothesis, adjusting coding-control settings such as prediction direction, filter taps, block size, and reference pictures to derive motion information, and using these settings to generate additional motion candidates for improved Inter prediction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If Multi-hypothesis mode is used for Inter prediction, then prediction efficiency is improved, but bandwidth requirement increases

Engineering Contradiction:
Improveprediction efficiencyVSAvoidbandwidth requirement
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential motion information from multiple hypotheses rather than transmitting complete motion data for each hypothesis. By selecting and transmitting only critical motion parameters (such as motion vector differences or selected hypothesis indicators) instead of full motion information, the bandwidth requirement is reduced while maintaining the prediction efficiency benefits of multi-hypothesis mode.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by using a subset of the full multi-hypothesis information set. Instead of utilizing all available hypothesis data which would maximize bandwidth consumption, the method selectively uses only the necessary portion of motion information from multiple hypotheses to achieve sufficient prediction accuracy, thereby reducing transmitted data while maintaining improved prediction efficiency.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If multiple motion candidates are generated for Multi-hypothesis mode, then coding performance is improved, but computational complexity increases

Engineering Contradiction:
Improvecoding performanceVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-generating and caching motion candidates during the encoding process before actual prediction is needed. Motion vectors and candidate information are prepared in advance and stored in candidate lists, allowing the decoder to benefit from multiple hypotheses without performing computationally intensive motion estimation at decode time. This preliminary preparation improves coding performance while managing computational complexity through advance computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies dynamics by adaptively adjusting the number and type of motion candidates generated based on picture characteristics, block size, and prediction mode. The system dynamically modifies the complexity of multi-hypothesis processing - using more candidates for difficult prediction regions and fewer candidates for simpler regions - thereby improving coding performance where needed while reducing overall computational complexity through selective application.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11917185B2Method and apparatus of motion compensation bandwidth reduction for video coding system utilizing multi-hypothesis
Publication Date: 2024.02.27 HFI INNOVATION INC
  • US11917185B2 patent drawing
  • US11917185B2 patent drawing
  • US11917185B2 patent drawing

AI summary

A method and apparatus of Inter prediction for video coding using Multi-hypothesis (MH) are disclosed. If an MH mode is used for the current block: at least one MH candidate is derived using reduced reference data by adjusting at least one coding-control setting; an Inter candidate list is generated, where the Inter candidate list comprises said at least one MH candidate; and current motion information associated with the current block is encoded using the Inter candidate list at the video encoder side or the current motion information associated with the current block is decoded at the video decoder side using the Merge candidate list. The coding control setting may correspond to prediction direction setting, filter tap setting, block size of reference block to be fetched, reference picture setting or motion limitation setting.