Video Block Multi-Hypothesis Prediction for Coding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding techniques, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/AVC, HEVC, and VVC, suffer from low coding efficiency, which is undesirable for digital video applications.

Innovation Solution

A method and apparatus for video processing that applies a multi-hypothesis prediction process to a target video block based on a plurality of motion candidates from a non-regular merge list, enhancing the conversion between the video block and bitstream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding techniques are used, then the implementation is simple, but the coding efficiency is low

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprediction process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the prediction process into multiple hypotheses, where each hypothesis represents a different motion candidate from the non-regular merge list. This segmentation allows the system to evaluate multiple motion possibilities independently and combine them to achieve better coding efficiency while maintaining manageable complexity through structured processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an additional dimension to the motion prediction by incorporating multiple hypotheses beyond the conventional single motion candidate approach. This multi-hypothesis framework extends the prediction space, allowing the encoder to explore multiple motion scenarios simultaneously, thereby improving coding efficiency without significantly increasing implementation complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If a multi-hypothesis prediction process is applied, then the coding efficiency is improved, but the computational complexity increases

Engineering Contradiction:
Improvecompression performanceVSAvoidcomputational power
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The patent performs preliminary action by pre-defining the non-regular merge list and motion candidates before the actual prediction process. This preparation work is done once and reused across multiple predictions, reducing the repeated computational overhead and allowing the multi-hypothesis approach to achieve better compression performance with controlled computational power consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by selectively applying the multi-hypothesis prediction process only to specific video blocks where it provides significant benefit, rather than uniformly applying it to all blocks. This selective approach improves overall compression performance while limiting the increase in computational power to only where necessary.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240259552A1Method, device, and medium for video processing
Publication Date: 2024.08.01 BYTEDANCE INC
  • US20240259552A1 patent drawing
  • US20240259552A1 patent drawing
  • US20240259552A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a target video block of a video and a bitstream of the video, a multi-hypothesis prediction process for the target video block based on a plurality of motion candidates from a non-regular merge list; and performing the conversion based on a result of the multi-hypothesis prediction process. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency and performance.