Video Coding Motion Information Storage for Non-Rectangular Partitions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in efficiently storing and predicting motion information for non-rectangular partition modes, such as Triangle Partition Mode (TPM), which increases data storage and bitrate, and complicates motion vector storage and blending processes.

Innovation Solution

The techniques involve partitioning a video block into non-rectangular partitions, coding motion information for each partition, and storing only the motion information associated with the second partition when both partitions refer to the same reference picture list, allowing for efficient prediction of subsequent blocks using the stored motion information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If non-rectangular partition modes (e.g., TPM) are used to improve video coding efficiency, then prediction accuracy is improved, but data storage requirements and bitrate increase

Engineering Contradiction:

Improveprediction accuracyVSAvoiddata storage requirements

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and stores only the essential motion information from the second partition when both partitions reference the same reference picture list. By selectively storing only necessary data (second partition motion information) and discarding redundant data (first partition motion information), the solution reduces storage requirements while maintaining prediction accuracy for subsequent blocks

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards the first set of motion information when both partitions reference the same reference picture list, and recovers it through prediction using the stored second set of motion information. This approach eliminates redundant storage while enabling accurate reconstruction of motion data for subsequent blocks through the prediction mechanism

Inventive Principle:

Principle #34Discarding and recovering

2Measurement precision

If non-rectangular partition modes are used to improve video coding efficiency, then prediction accuracy is improved, but bitrate increases

Engineering Contradiction:

Improveprediction accuracyVSAvoidbitrate

Core Design Contradiction:

Measurement precisionVSLoss of information

Solution Approach 1:

The patent extracts only the essential motion information that needs to be stored and transmitted (second partition motion information when both partitions use the same reference list). By extracting only what is necessary and eliminating redundant information, the solution reduces bitrate while maintaining the ability to accurately predict subsequent blocks

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards redundant motion information from the first partition and recovers it through prediction using the stored second partition motion information. This discard-and-recover mechanism reduces the amount of information that must be transmitted in the bitrate while preserving prediction accuracy

Inventive Principle:

Principle #34Discarding and recovering

3Measurement precision

If motion information for both partitions is stored to improve prediction accuracy, then prediction accuracy is improved, but device complexity increases

Engineering Contradiction:

Improveprediction accuracyVSAvoidmotion vector storage and blending processes

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and stores only the motion information from the second partition when both partitions reference the same reference picture list. This selective extraction simplifies the storage structure and reduces the complexity of motion vector management while maintaining sufficient information for accurate prediction of subsequent blocks

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards the first partition motion information and recovers it through prediction using the stored second partition information. This approach simplifies the device complexity by eliminating the need to store and manage multiple sets of redundant motion information, while the prediction mechanism ensures accurate recovery when needed

Inventive Principle:

Principle #34Discarding and recovering

Data Source

PatentUS11570442B2Reducing motion field storage for prediction of video data using non-rectangular prediction modes

Publication Date: 2023.01.31 QUALCOMM INC

AI summary

An example video coding device is configured to: code a first set of motion information for a current block of video data partitioned into a first partition and a second partition according to a non-rectangular partition mode, the first set of motion information referring to a reference picture list and being associated with the first partition; after coding the first set of motion information, code a second set of motion information for the current block referring to the reference picture list and that is associated with the second partition; in response to the first set of motion information and the second set of motion information both referring to the reference picture list, store the second set of motion information for the current block; and predict subsequent motion information of a subsequent block of the video data that neighbors the current block using the stored second set of motion information.