Video Processing Merge Candidate List Reordering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/AVC, HEVC, and VVC, face limitations in coding efficiency and performance, particularly in handling complex video block structures and prediction modes.

Innovation Solution

The proposed methods involve determining combined inter and intra prediction modes, constructing and reordering merge candidate lists, and incorporating motion vector differences to enhance video processing, allowing for improved coding performance and efficiency during the conversion between video blocks and bitstreams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding technologies are used, then the coding process is simple, but the coding efficiency and performance are limited

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies adaptive merge list reordering that dynamically adjusts the order of merge candidates based on prediction accuracy metrics. The system evaluates different merge candidates and reorders them according to their actual performance in predicting motion vectors, allowing the coding process to adapt to different video content characteristics and optimize coding efficiency for each specific case

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent performs preliminary actions by pre-establishing multiple merge candidate lists with different ordering strategies before the actual coding process. These pre-prepared lists include various permutations of merge candidates based on different criteria (spatial proximity, temporal proximity, prediction accuracy), allowing the system to select the most appropriate list without performing exhaustive search during coding

Inventive Principle:
Principle #10Preliminary action

2Reliability

If more prediction modes and motion candidates are considered, then coding performance improves, but the complexity of selecting and processing them increases

Engineering Contradiction:
Improvecoding performanceVSAvoidselection and processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the merge candidate list into multiple ordered lists, where each list represents a different hypothesis about the optimal ordering of candidates. Instead of treating all candidates uniformly, the system divides them into distinct ordered sequences based on different sorting criteria, making the selection process more manageable and efficient while maintaining high coding performance

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements feedback mechanisms where the coding system evaluates the performance of different merge candidates and uses this information to adjust the ordering in subsequent iterations. The system learns from previous coding operations and refines the merge candidate ordering based on actual prediction accuracy, creating a self-improving process that maintains high reliability without proportional increases in complexity

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240195952A1Method, apparatus, and medium for video processing
Publication Date: 2024.06.13 BYTEDANCE INC
  • US20240195952A1 patent drawing
  • US20240195952A1 patent drawing
  • US20240195952A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target block of a video and a bitstream of the target block, a combined inter and intra prediction (CIIP) mode associated with the target block; constructing a merge candidate list associated with the CIIP mode; performing an adaptive merge list reordering to the merge candidate list associated with the CIIP mode; and performing the conversion based on the reordered merge candidate list.