Decoder Side Motion Vector Refinement With Wrap-Around Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video processing technologies face challenges in simplifying the decoder side motion vector refinement process when combined with wrap-around motion compensation, which can increase complexity and reduce efficiency.

Innovation Solution

The method involves determining a refined motion vector for a target coding unit without using wrap-around motion compensation and generating a bi-predicted signal using wrap-around motion compensation only when enabled, simplifying the process by removing unnecessary clipping operations and using bi-linear interpolation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If wrap-around motion compensation is combined with DMVR process, then coding efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocess complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the motion compensation process into two distinct stages: first performing DMVR to obtain a refined motion vector without wrap-around, then conditionally applying wrap-around motion compensation only in the second stage. This segmentation allows each stage to be optimized independently, maintaining coding efficiency while reducing overall process complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies wrap-around motion compensation only partially - specifically, only after DMVR is completed and only when certain conditions are met. This partial application avoids the full complexity of combining both processes throughout the entire motion compensation pipeline, while still achieving the coding efficiency benefits where needed.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If wrap-around motion compensation is applied in DMVR, then motion accuracy is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvemotion vector accuracyVSAvoidimplementation ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent performs DMVR first to establish an accurate refined motion vector before considering wrap-around motion compensation. This preliminary action ensures that the foundation for motion accuracy is already in place, and wrap-around is then applied as a conditional refinement rather than a complex integrated process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the wrap-around motion compensation step from the core DMVR process, making it a separate, optional operation that occurs only after DMVR completes. This extraction simplifies the DMVR implementation while preserving the ability to achieve high motion accuracy when wrap-around conditions are appropriate.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If conventional DMVR process is used with wrap-around, then visual quality is maintained, but loss of time increases

Engineering Contradiction:
Improvevisual qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent introduces dynamic conditional logic that determines whether to apply wrap-around motion compensation based on specific conditions being met. This dynamic approach allows the processing time to be optimized by skipping wrap-around operations when not needed, while maintaining visual quality when the conditions indicate wrap-around would be beneficial.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies wrap-around motion compensation locally - only in specific cases where the conditions are met - rather than universally across all DMVR operations. This localized application maintains visual quality in the specific cases where it matters most, while avoiding the time penalty of applying it universally.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11412253B2Methods for combining decoder side motion vector refinement with wrap-around motion compensation
Publication Date: 2022.08.09 ALIBABA GROUP HOLDING LTD
  • US11412253B2 patent drawing
  • US11412253B2 patent drawing
  • US11412253B2 patent drawing

AI summary

The present disclosure provides systems and methods for processing video data. A method includes: performing a decoder side motion vector refinement (DMVR) process to generate a bi-predicted signal, wherein performing the DMVR process comprises: determining a refined motion vector for a target coding unit, without using wrap-around motion compensation; determining whether the wrap-around motion compensation is enabled; and in response to a determination that the wrap-around motion compensation is enabled, generating, based on the refined motion vector, a bi-predicted signal using the wrap-around motion compensation.