Video Decoder Inter Prediction Subblock Motion Vector Derivation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding technologies face challenges in efficiently processing next-generation video contents with high spatial resolution, high frame rate, and high dimensionality, leading to increased memory storage and processing demands.

Innovation Solution

A method for decoding images using inter prediction that generates a merge candidate list by combining spatial and temporal neighboring blocks, deriving motion vectors for subblocks, and generating prediction samples, with subblock sizes set to at least 8x8, to reduce hardware gate count and maintain compression performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If inter prediction with merge mode is used to process high-resolution video contents, then compression performance is improved, but hardware gate count and processing complexity increase

Engineering Contradiction:
Improvecompression performanceVSAvoidhardware gate count
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The current block is divided into multiple subblocks, and motion vectors are derived for each subblock independently based on temporal neighboring blocks. This segmentation allows the system to process smaller regions with simpler logic, reducing overall hardware complexity while maintaining compression effectiveness through localized motion compensation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method pre-generates a merge candidate list containing temporal neighboring blocks before the actual prediction process. By preparing candidate motion vectors in advance from already-decoded pictures, the system reduces real-time processing requirements and hardware gate count during the main prediction operation.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If subblock-based inter prediction is applied to maintain compression performance, then processing accuracy is improved, but processing time and computational load increase

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Different motion vectors are derived for different subblocks based on their specific spatial and temporal characteristics. This local adaptation allows each subblock to be processed with appropriate precision, improving overall prediction accuracy while avoiding the need to process the entire block with maximum computational effort.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The method applies motion vector derivation to only the necessary subblocks using a fixed size of at least 8x8, rather than processing every possible subblock. This partial action approach maintains sufficient prediction accuracy for high-resolution video while reducing unnecessary computational overhead and processing time.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250008115A1Method for processing image on basis of inter-prediction mode and device therefor
Publication Date: 2025.01.02 NOKIA TECHNOLOGIES OY
  • US20250008115A1 patent drawing
  • US20250008115A1 patent drawing
  • US20250008115A1 patent drawing

AI summary

Disclosed herein are a method for decoding a video signal and a device therefor. Specifically, a method for decoding an image based on an inter prediction mode may include: if a merge mode is applied to a current block, generating a merge candidate list by using a spatial neighboring block and a temporal neighboring block of the current block; obtaining a merge index indicating a candidate to be used for an inter prediction of the current block in the merge candidate list; deriving a motion vector of each of subblocks included in the current block based on a motion vector of the candidate used for the inter prediction of the current block; and generating a prediction sample of the current block by using the motion vector of each of subblocks.