Motion Vector Handling in Geometry Partition Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards face challenges in efficiently managing bandwidth demand due to the increasing number of connected devices, particularly in digital video transmission, where existing compression methods do not adequately address the need for reduced bitrate while maintaining video quality.
Innovation Solution
The implementation of advanced video coding techniques, including inter prediction using triangular or arbitrary geometry partitions, which involve weighted sum prediction modes, motion vector storage, and deblocking processes, to enhance compression performance and adapt to varying video block sizes and formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If advanced video coding techniques with geometry partitions and weighted sum prediction are implemented, then video compression efficiency is improved and bitrate is reduced, but device complexity and processing requirements increase
Solution Approach 1:
The current video block is partitioned into multiple sub-blocks (e.g., 4×4 sub-blocks) with different prediction modes applied to each sub-block. This segmentation allows the encoder to achieve better compression efficiency by adapting to local variations in the video content, while the decoder can process each sub-block independently, managing complexity through modular processing.
Solution Approach 2:
Different prediction modes (intra prediction, inter prediction, or combined modes) are applied to different sub-blocks based on local characteristics. This local quality approach enables the encoder to optimize compression for each region independently, achieving overall bitrate reduction while maintaining video quality, and allows the decoder to process regions with appropriate complexity levels.
2Measurement precision
If multiple motion vectors are stored for each block, then prediction accuracy is improved, but memory usage and processing overhead increase
Solution Approach 1:
Instead of storing multiple motion vectors for all sub-blocks uniformly, the patent selectively stores motion vectors only for certain sub-blocks (e.g., only for sub-blocks with specific prediction modes or at specific positions). This partial action approach achieves prediction accuracy improvement where needed while significantly reducing memory usage compared to storing vectors for all sub-blocks.
Solution Approach 2:
The patent enables the decoder to derive motion vectors for sub-blocks that are not explicitly stored in the bitstream by using motion vector prediction techniques. The decoder uses motion vectors from neighboring blocks or previously decoded sub-blocks to predict motion vectors for current sub-blocks, reducing memory requirements while maintaining prediction accuracy through self-derived motion information.
Data Source
AI summary
A method of video processing is described. The method includes performing a conversion between a current video block of a video and a bitstream representation of the video, wherein, during the conversion, a prediction of the current video block is determined as a weighted sum of two or more predictions of the current video block, and a motion vector storing process for the current video block is determined according to a rule, wherein the current video block uses a partitioning prediction mode that is a first mode which is based on multiple first partitioning schemes or a second mode which is based on multiple second partitioning schemes, and wherein the rule specifies that a process used for determining which motion vector and how many motion vectors are stored is same for the first mode or the second mode.