Inter-Frame Prediction With Adaptive Partitioning for Irregular Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face challenges in efficiently handling irregular textures and motions in natural videos, leading to increased complexity and reduced encoding and decoding performance due to the need for deeper block partitioning.
Innovation Solution
An inter prediction method utilizing Adaptive Partitioning Mode (APM) that allows for arbitrary shape partitioning based on picture contents, using at least one first and one second reference block to determine a prediction value, which can be actual or simulated partitioning, thereby improving accuracy and reducing complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If deeper block partitioning is used to handle complex textures and motions, then the accuracy of matching actual textures or motions is improved, but the encoding and decoding complexity greatly increases
Solution Approach 1:
The current block is divided into multiple sub-blocks through adaptive partitioning, allowing different reference blocks to be selected for different sub-blocks. This segmentation enables more precise matching of complex textures and motions while maintaining manageable complexity by processing smaller, independent sub-blocks rather than requiring extremely deep partitioning of the entire block.
Solution Approach 2:
Different sub-blocks within the current block can use different reference blocks and prediction modes according to their local characteristics. This allows the prediction accuracy to be optimized locally for each sub-block's specific texture or motion pattern, improving overall prediction accuracy without uniformly increasing complexity across the entire block.
2Adaptability or versatility
If arbitrary shape partitioning based on picture contents is implemented, then the adaptability to different video contents is improved, but the device complexity increases
Solution Approach 1:
The partitioning structure is made dynamic and adaptive based on picture contents. The encoder determines the appropriate partitioning mode and reference blocks according to the actual video content characteristics, allowing the system to adapt to different textures and motions. This dynamic adaptation improves content versatility while managing complexity through content-driven decision-making rather than fixed complex structures.
Solution Approach 2:
The partitioning parameters (such as partitioning mode, reference block selection) are changed adaptively based on picture contents. By adjusting these parameters according to the actual video content, the system achieves high adaptability to different video scenarios while avoiding the need for a fixed, overly complex partitioning structure that would increase device complexity unnecessarily.
Data Source
AI summary
Provided are methods for inter prediction, and a decoder. The decoder decodes a bitstream to determine an inter prediction mode parameter for a current block; determines at least one first reference block and at least one second reference block for the current block when the inter prediction mode parameter indicates that an adaptive partitioning mode (APM) is used for the current block to determine an inter prediction value of the current block, the APM being used for partitioning of arbitrary shapes based on picture contents; and determines a prediction value of the current block according to the at least one first reference block and the at least one second reference block.