Sub-prediction Unit Motion Vector Prediction Using Spatial and Temporal Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face challenges in efficiently deriving motion information for sub-blocks, particularly in partitioning blocks into sub-blocks and accurately predicting motion vectors across spatial and temporal neighboring blocks.

Innovation Solution

The proposed solution involves deriving motion information for sub-blocks by combining motion information from spatially and temporally neighboring blocks, including left, above, and bottom-right neighboring blocks, and using this information for advanced temporal motion vector prediction in video codecs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion information is derived for each sub-block using spatial and temporal prediction, then prediction accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The current block is divided into multiple sub-blocks, and motion information is derived separately for each sub-block using spatial and temporal prediction. This segmentation allows for more precise motion representation in different regions while using efficient prediction methods to manage computational complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Motion information from neighboring blocks is pre-computed and stored in candidate lists before being used for prediction. This preliminary action reduces redundant calculations and speeds up the motion derivation process for sub-blocks.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If motion information is derived for sub-blocks, then compression efficiency is improved, but processing time increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

Spatial and temporal prediction methods are merged to derive motion information for sub-blocks. This combination leverages both spatial correlations within the current picture and temporal correlations across reference pictures, improving compression efficiency while maintaining reasonable processing time through efficient algorithm design.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Motion information from neighboring blocks is copied and used as prediction candidates for sub-blocks. This copying approach reduces the need for extensive new calculations by reusing previously computed motion data, thereby reducing processing time while maintaining compression efficiency.

Inventive Principle:
Principle #26Copying

3Measurement precision

If multiple neighboring blocks are used for prediction, then prediction accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different neighboring blocks (left, above, bottom-right) are used to provide motion information for different regions of the current block. This local quality approach ensures that each sub-block uses the most relevant motion information from its specific spatial context, improving prediction accuracy while managing device complexity through targeted use of neighboring data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10271064B2Sub-prediction unit motion vector prediction using spatial and/or temporal motion information
Publication Date: 2019.04.23 QUALCOMM INC
  • US10271064B2 patent drawing
  • US10271064B2 patent drawing
  • US10271064B2 patent drawing

AI summary

In one example, a device for decoding video data includes a memory configured to store video data and a video decoder configured to determine that a motion prediction candidate for a current block of video data indicates that motion information is to be derived for sub-blocks of the current block, in response to the determination: partition the current block into the sub-blocks, for each of the sub-blocks, derive motion information using motion information for at least two neighboring blocks, and decode the sub-blocks using the respective derived motion information.