DMVR and BDOF Inter Prediction for Efficient Video Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing demand for high-resolution and high-quality images and videos, such as UHD images and videos of 4K or 8K, poses challenges in efficiently compressing and transmitting or storing these data due to the increased amount of information required, leading to higher transmission and storage costs. Additionally, the need for efficient compression technologies is exacerbated by the growing interest in immersive media like VR and AR content.

Innovation Solution

The proposed method and apparatus enhance image coding efficiency by performing inter prediction using decoder-side motion vector refinement (DMVR) and bi-directional optical flow (BDOF). This involves deriving refined motion vectors and determining whether to apply DMVR and/or BDOF based on specific conditions to optimize prediction performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If conventional inter prediction is used for high-resolution images and videos, then transmission and storage costs increase due to increased data amount, but applying advanced techniques like DMVR and BDOF increases calculation complexity

Engineering Contradiction:
Improvetransmission and storage costsVSAvoidcalculation complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting prediction modes (DMVR and BDOF) based on picture type, block size, and motion characteristics. The encoder selects between different prediction algorithms and refinement levels according to specific parameters such as whether the picture is intra or inter predicted, block dimensions, and motion vector differences, thereby optimizing compression efficiency while controlling calculation complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements partial action by applying DMVR and BDOF selectively rather than universally. The advanced prediction techniques are applied only to specific blocks or regions that benefit most from them, determined by checking conditions such as block size thresholds, motion vector precision requirements, and prediction mode compatibility. This selective application reduces overall calculation complexity while maintaining compression efficiency for critical areas.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If DMVR and BDOF are applied to all blocks, then prediction performance improves, but encoding complexity and processing time increase significantly

Engineering Contradiction:
Improveprediction performanceVSAvoidencoding speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies local quality by using different prediction and refinement strategies for different blocks based on their specific characteristics. Each block is evaluated individually against criteria such as size, motion complexity, and reference picture availability. Blocks requiring high precision receive DMVR or BDOF processing, while simpler blocks use standard prediction, thereby achieving high prediction performance where needed without uniformly increasing encoding complexity across the entire picture.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the encoding process into multiple stages with different complexity levels. The encoding proceeds through initial prediction, condition checking, selective refinement (DMVR/BDOF application), and final output. This segmentation allows the encoder to process blocks in an organized manner, applying computational resources efficiently to only those segments (blocks) that require advanced processing, thus balancing prediction performance with encoding speed.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12348731B2Inter-prediction method and device based on DMVR and BDOF
Publication Date: 2025.07.01 LG ELECTRONICS INC
  • US12348731B2 patent drawing
  • US12348731B2 patent drawing
  • US12348731B2 patent drawing

AI summary

An image decoding method according to the present document is characterized in that: decoder-side motion vector refinement (DMVR) is applied to derive refined L0 and L1 motion vectors on the basis of L0 and L1 motion vectors of the current block; prediction samples of the current block are derived on the basis of L0 prediction samples derived on the basis of the refined L0 motion vector and L1 prediction samples derived on the basis of the refined L1 motion vector; and recovery samples of the current block are generated on the basis of the prediction samples, wherein the L0 prediction samples are derived on the basis of an L0 reference picture and the refined L0 motion vector, the L1 prediction samples are derived on the basis of an L1 reference picture and the refined L1 motion vector, and in the step for deriving the prediction samples, whether to apply a bi-directional optical flow (BDOF) process is determined on the basis of whether a first POC difference between the current picture and the L0 reference picture and a second POC difference between the current picture and the L1 reference picture are the same.