Video Processing Candidate List Construction Using Multi-Threshold Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding techniques have low coding efficiency due to the use of a single threshold in candidate list construction for motion vector prediction, leading to suboptimal MVP candidate lists.

Innovation Solution

The method involves determining a candidate list using multiple thresholds and performing multi-pass reordering processes to construct more appropriate MVP candidate lists, incorporating virtual candidates and setting a threshold number for improved coding effectiveness and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single threshold is used in candidate list construction, then the device complexity is reduced, but the coding efficiency deteriorates

Engineering Contradiction:
Improvecandidate list construction complexityVSAvoidcoding efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The candidate list construction process is segmented into multiple stages, each with its own threshold. The first threshold filters candidates in an initial stage, and a second threshold further refines the list in a subsequent stage. This segmentation allows the system to achieve better coding efficiency through multi-stage filtering while keeping each individual stage relatively simple.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts threshold values based on different candidate types and processing stages. Different thresholds are applied to different groups of motion vector prediction candidates, allowing the system to optimize the balance between complexity and efficiency adaptively rather than using a fixed single threshold throughout.

Inventive Principle:
Principle #15Dynamics

2Productivity

If multiple reordering processes are performed on MVP candidates, then the coding efficiency is improved, but the processing time increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

Multiple reordering processes are performed in advance during the encoding stage to construct an optimized MVP candidate list. By performing these reordering operations preliminarily before actual video block processing, the system achieves better coding efficiency while the time cost is incurred during setup rather than during repeated processing operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the ordering parameters and criteria through multiple passes, applying different sorting rules in different stages. This allows the MVP candidate list to be optimized from multiple perspectives, improving coding efficiency by finding better candidate arrangements without requiring excessive computational resources in any single pass.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If virtual MVP candidates are incorporated into the candidate list, then the coding effectiveness is improved, but the device complexity increases

Engineering Contradiction:
Improvecoding effectivenessVSAvoidcandidate list construction complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Virtual MVP candidates act as intermediary elements that bridge the gap between available motion information and optimal prediction candidates. These virtual candidates are constructed from combinations of existing motion vectors and serve as intermediate steps in the candidate selection process, improving coding effectiveness by providing additional prediction options without requiring complex external resources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240291967A1Method, apparatus, and medium for video processing
Publication Date: 2024.08.29 BYTEDANCE INC
  • US20240291967A1 patent drawing
  • US20240291967A1 patent drawing
  • US20240291967A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target video block of a video and a bitstream of the video, a plurality of candidates of the target video block; determining a candidate list from the plurality of candidates by using a plurality of thresholds; and performing the conversion based on the candidate list.