Triangulation-Based Adaptive Subsampling of Motion Vector Fields
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies face challenges in accurately predicting frames using motion estimation and compensation, often resulting in inaccurate predictions and blocking artifacts due to the limited number of motion vectors transmitted.
Innovation Solution
The proposed solution involves an apparatus and method for deriving motion vectors by obtaining a set of sample positions and their associated motion vectors, then using triangulation to determine additional sample positions and derive additional motion vectors based on information in the bitstream, thereby enhancing adaptive sampling without explicit position signaling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If block-based motion estimation with limited motion vectors is used, then device complexity is reduced, but prediction accuracy deteriorates and blocking artifacts increase
Solution Approach 1:
The system uses the transmitted motion vectors themselves to derive additional motion vectors through triangulation. The decoder self-generates additional motion information from the limited transmitted data, eliminating the need for the encoder to transmit all motion vectors while maintaining prediction accuracy.
Solution Approach 2:
Triangulation serves as an intermediary process that transforms a small set of transmitted motion vectors into a dense motion vector field. This intermediary derivation step bridges the gap between limited transmitted data and the need for comprehensive motion information at all sample positions.
2Measurement precision
If adaptive sampling with content-dependent block splitting is used, then prediction accuracy is improved, but position signaling cost increases
Solution Approach 1:
The decoder determines sample positions and derives motion vectors autonomously using triangulation based on transmitted bitstream information. No explicit position signaling is required because the decoder self-determines where to place additional sample positions within triangles formed by existing positions.
Solution Approach 2:
The image is divided into triangular regions based on existing sample positions. This segmentation into triangles provides a structured framework for determining additional sample positions and applying adaptive sampling without requiring explicit position signals for each sample.
3Measurement precision
If more motion vectors are transmitted, then prediction accuracy is improved, but bitstream size increases
Solution Approach 1:
Instead of transmitting a complete dense motion vector field, the system transmits only a sparse set of motion vectors and relies on the decoder to self-generate the remaining motion vectors through triangulation. This dramatically reduces bitstream size while maintaining prediction accuracy through decoder-side derivation.
Solution Approach 2:
Rather than transmitting all necessary motion vectors, the system transmits only a partial set and performs excessive derivation at the decoder side. This partial transmission approach reduces bitstream size while the excessive derivation ensures complete motion information is available for accurate prediction.
Data Source
AI summary
The present disclosure relates to an apparatus and a method for providing a plurality of motion vectors related to an image coded in a bitstream. The method includes obtaining a set of sample positions within the image, obtaining respective motion vectors associated with the set of sample positions, deriving an additional motion vector based on information coded in the bitstream, determining an additional sample position located within a triangle, which is formed by three sample positions of the set of sample positions, based on the respective motion vectors associated with the three sample positions, the triangle not including the rest of the sample positions of the set of sample positions, adding the additional sample position to the set of sample positions, and associating the derived additional motion vector with the additional sample position.