Video Coding Efficiency via Multiple Hypothesis Motion Candidates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding techniques, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/AVC, HEVC, and VVC, suffer from low coding efficiency, which limits their effectiveness in efficiently processing and compressing video data.

Innovation Solution

A method and apparatus for improving video coding efficiency by determining multiple hypothesis information for a video unit, inserting it into a history-based motion candidate table, and using this information to perform the conversion between a video unit and its bitstream, thereby enhancing coding performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding techniques are used, then the video data can be processed and compressed, but the coding efficiency is low

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcompression effectiveness
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent segments the motion prediction process into multiple hypotheses, where each hypothesis represents a different prediction approach (e.g., temporal prediction, spatial prediction, combined prediction). By dividing the prediction task into multiple segments and evaluating each, the system achieves better coding efficiency without overwhelming computational burden.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively evaluating multiple hypotheses only when beneficial, rather than always using all prediction methods. The system determines whether to use multiple hypotheses based on rate-distortion optimization, applying the additional computational effort only when it improves coding efficiency beyond a certain threshold.

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If multiple hypothesis information is inserted into history-based motion candidate table, then coding efficiency improves, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-calculating and storing motion candidates in the history-based motion candidate table before actual prediction is needed. Multiple hypotheses are evaluated in advance, and the best candidates are stored for rapid retrieval during decoding, reducing real-time computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating multiple hypothesis copies of motion information from reference blocks. Instead of performing complex real-time calculations, the system copies motion vectors and prediction data from previously decoded blocks, storing multiple versions (hypotheses) in the candidate table for quick comparison and selection.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240205390A1Method, device, and medium for video processing
Publication Date: 2024.06.20 DOUYIN VISION CO LTD
  • US20240205390A1 patent drawing
  • US20240205390A1 patent drawing
  • US20240205390A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a video unit of a video and a bitstream of the video unit, multiple hypothesis information of the video unit, the video unit being a multiple hypothesis coded video unit; inserting the multiple hypothesis information into a history-based motion candidate table; and performing the conversion based on the history-based motion candidate table.