Intra Block Copy Motion Vector Prediction Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in efficiently encoding and decoding digital video due to increasing bandwidth demands and the need for improved motion vector prediction methods.

Innovation Solution

The proposed techniques involve using intra-block coding (IBC) with advanced motion vector prediction (AMVP) and block vector signaling, allowing for the conversion between video regions and bitstream representations while optimizing motion vector prediction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If intra block copy (IBC) mode is applied to predict samples from other samples in the video picture, then coding efficiency is improved and bandwidth requirements are reduced, but device complexity increases due to additional motion vector prediction mechanisms

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the motion vector prediction process into multiple candidate types (spatial candidates, temporal candidates, and IBC-specific candidates). By dividing the prediction process into distinct segments with different candidate sources, the system achieves better prediction accuracy while maintaining manageable complexity through modular organization of prediction candidates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic selection of prediction modes and candidates based on content characteristics. The encoder dynamically chooses between IBC mode and inter mode, and within IBC mode, dynamically selects from multiple candidate types (AMVP vs. merge candidates) based on the specific video content being encoded, thereby optimizing coding efficiency adaptively.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If advanced motion vector prediction (AMVP) with multiple IBC candidates is used during video conversion, then motion vector prediction accuracy is improved, but the complexity of the conversion process increases

Engineering Contradiction:
Improvemotion vector prediction accuracyVSAvoidconversion process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the AMVP process into distinct candidate generation stages (spatial candidate derivation, temporal candidate derivation, and IBC candidate derivation) with clear boundaries. Each segment produces specific types of candidates that are then combined and selected, making the complex process more manageable and implementable while maintaining high prediction accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different candidate generation strategies to different spatial and temporal locations. Spatial candidates are derived from specific neighboring block positions, temporal candidates from specific reference picture positions, and IBC candidates from specific intra-picture reference positions. This localized approach optimizes prediction accuracy for each candidate type while keeping the overall process structured and manageable.

Inventive Principle:
Principle #3Local quality

3Quantity of substance

If the bitstream representation selectively includes MVD related syntax elements based on maximum number of IBC candidates, then bandwidth usage is optimized, but the difficulty of detecting and measuring syntax elements increases

Engineering Contradiction:
Improvebandwidth usageVSAvoidsyntax element detection difficulty
Core Design Contradiction:
Quantity of substanceVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements dynamic syntax element inclusion in the bitstream based on the actual number of IBC candidates configured. When the maximum number of IBC candidates is zero, MVD-related syntax elements are excluded from the bitstream. When IBC candidates are present, the appropriate syntax elements are selectively included. This dynamic adaptation optimizes bandwidth usage while maintaining clear syntax element detection through conditional presence rules.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12219167B2Coding of block vectors for intra block copy-coded blocks
Publication Date: 2025.02.04 BYTEDANCE INC
  • US12219167B2 patent drawing
  • US12219167B2 patent drawing
  • US12219167B2 patent drawing

AI summary

Methods, devices and systems for intra-block coding based decoding or encoding of video while using block vector signaling and/or merge candidates are disclosed. An example method for video processing includes performing a conversion between a video region of a video and a bitstream representation of the video, wherein the bitstream representation selectively includes motion vector difference (MVD) related syntax elements for an intra block copy (IBC) advanced motion vector prediction (AMVP) mode based on a maximum number of a first type of IBC candidates used during the conversion of the video region, wherein, when an IBC mode is applied, samples of the video region are predicted from other samples in a video picture corresponding to the video region.