Selective Bi-Directional Optical Flow for Motion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing block-based video coding systems face inefficiencies in motion compensation due to residual motion within bi-predicted blocks, leading to increased computational complexity and resource utilization.

Innovation Solution

Implement bi-directional optical flow (BIO) for motion refinement by deriving local motion vectors at a sample level, using 2D separable FIR filters and SIMD instructions to optimize gradient derivation and reduce memory access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If bi-directional optical flow (BIO) is applied to all bi-predicted blocks for motion refinement, then motion compensation accuracy is improved, but computational complexity and resource utilization increase

Engineering Contradiction:
Improvemotion compensation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies motion refinement selectively only to blocks that exhibit residual motion, rather than uniformly to all bi-predicted blocks. By identifying blocks with prediction errors and applying BIO specifically to those regions, the system achieves high motion compensation accuracy where needed while avoiding unnecessary computational overhead in regions where simple bi-prediction suffices.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements a conditional approach where BIO is applied partially - only when the block similarity metric falls below a threshold indicating residual motion. This partial application strategy ensures sufficient motion refinement for problematic blocks while limiting the overall computational burden by skipping refinement for blocks that already have adequate prediction accuracy.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If bi-directional optical flow (BIO) is applied to all bi-predicted blocks, then motion compensation accuracy is improved, but resource utilization increases

Engineering Contradiction:
Improvemotion compensation accuracyVSAvoidresource utilization
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies computational resources selectively to blocks requiring motion refinement based on their individual characteristics. By calculating a similarity metric for each block and applying BIO only to dissimilar blocks, the patent optimizes resource utilization by concentrating computational effort where it provides the most benefit while conserving resources for blocks that don't require refinement.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial application of BIO based on a threshold criterion. When the similarity metric indicates sufficient prediction accuracy, the system skips the computationally intensive BIO process, thereby reducing overall resource utilization while maintaining adequate motion compensation accuracy for the majority of blocks.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If block-based motion compensation is used, then processing simplicity is maintained, but residual motion within bi-predicted blocks causes inefficiencies

Engineering Contradiction:
Improveprocessing simplicityVSAvoidcoding efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent segments the processing approach by dividing blocks into two categories: those requiring simple bi-prediction and those requiring advanced BIO refinement. This segmentation allows the system to maintain processing simplicity for the majority of blocks while applying enhanced motion compensation only where necessary, thereby resolving the contradiction between simplicity and efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies the more complex BIO process partially - only to blocks identified as having residual motion through similarity metric evaluation. This partial application maintains the overall simplicity of the block-based framework while improving coding efficiency for specific problematic blocks, achieving a balance between processing ease and compression performance.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12464161B2Motion-compensation prediction based on bi-directional optical flow
Publication Date: 2025.11.04 INTERDIGITAL VC HOLDINGS INC
  • US12464161B2 patent drawing
  • US12464161B2 patent drawing
  • US12464161B2 patent drawing

AI summary

A device may determine whether to enable or disable bi-directional optical flow (BIO) for a current coding unit (CU) (e.g., block and/or sub-block). Prediction information for the CU may be identified and may include prediction signals associated with a first reference block and a second reference block (e.g., or a first reference sub-block and a second reference sub-block). A prediction difference may be calculated and may be used to determine the similarity between the two prediction signals. The CU may be reconstructed based on the similarity. For example, whether to reconstruct the CU with BIO enabled or BIO disabled may be based on whether the two prediction signals are similar. It may be determined to enable BIO for the CU when the two prediction signals are determined to be dissimilar. For example, the CU may be reconstructed with BIO disabled when the two prediction signals are determined to be similar.