Interweaved Video Prediction with Adaptive Sub-Block Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle to accurately represent and compress video frames, particularly in capturing the motion of both camera and objects within frames, leading to inefficiencies in bandwidth and accuracy.
Innovation Solution
The implementation of sub-block based motion prediction techniques, where a video block is partitioned into multiple sub-blocks with varying dimensions, allowing for more precise motion compensation and prediction by generating a prediction block as a combination of intermediate prediction blocks from different sub-block patterns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If fixed sub-block sizes are used in motion compensation, then the processing complexity is reduced, but the motion prediction accuracy deteriorates
Solution Approach 1:
The video block is divided into multiple sub-blocks with different dimensions based on the block's position and motion characteristics. This segmentation allows each sub-block to be processed with appropriate granularity, improving motion prediction accuracy while managing complexity through adaptive partitioning rather than uniform division.
Solution Approach 2:
The sub-block partitioning scheme is dynamic and adapts to different video blocks based on their dimensions and motion characteristics. The partitioning pattern changes from fixed to variable based on the specific requirements of each block, allowing the system to optimize between accuracy and complexity for each individual case.
2Measurement precision
If variable dimension sub-blocks are used, then motion prediction accuracy is improved, but the processing complexity increases
Solution Approach 1:
Different sub-blocks within the same video block can have different dimensions and processing requirements based on local motion characteristics. This local quality approach allows the system to apply appropriate processing intensity to each region, improving overall accuracy without uniformly increasing processing complexity across the entire block.
Solution Approach 2:
The system changes the dimension parameters of sub-blocks based on the characteristics of the parent block and motion information. By adjusting sub-block dimensions as a variable parameter rather than using fixed sizes, the system optimizes the balance between prediction accuracy and processing efficiency for each specific coding scenario.
3Productivity
If multiple sub-block patterns are applied, then compression efficiency is improved, but the algorithm complexity increases
Solution Approach 1:
The sub-block partitioning mechanism serves multiple functions: it adapts to different block sizes, handles various motion patterns, and optimizes compression efficiency. This multi-functionality is achieved through a unified adaptive partitioning algorithm rather than multiple separate processing paths, reducing overall algorithm complexity while maintaining high compression efficiency.
Data Source
AI summary
Methods, systems, and devices related to sub-block based motion prediction in video coding are described. In one representative aspect, a video processing method includes partitioning a video block into a first set of sub-blocks according to a first pattern, partitioning the video block into a second set of sub-blocks according to a second pattern, in which at least one sub-block in the second set has a different size than a sub-block in the first set, and determining a prediction block corresponding to a combination of a first intermediate prediction block that is predictively generated from the first set of sub-blocks and a second intermediate prediction block that is predictively generated from the second set of sub-blocks.