Video Decoder Spatial Correlation Motion Vector Derivation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video encoding and decoding technologies face challenges in efficiently utilizing spatial correlation for motion vector derivation, leading to suboptimal prediction and increased bandwidth usage due to the lack of effective methods to account for the spatial correlation between neighboring samples and hypothesis blocks.
Innovation Solution
The proposed solution involves a decoder-side motion vector derivation technique that utilizes spatial correlation to determine a motion vector for a current block by calculating correlation values between neighboring samples and hypotheses based on a set of samples in a reference picture, allowing for better prediction block selection and reduced residual data signaling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional motion vector derivation methods are used without spatial correlation, then the decoding process is simpler and faster, but prediction accuracy is suboptimal and bandwidth usage increases
Solution Approach 1:
The patent performs preliminary actions by pre-calculating and storing spatial correlation values between neighboring blocks during the encoding phase. These pre-computed correlation data are then available for direct retrieval and use during decoding, enabling accurate motion vector derivation without requiring complex real-time calculations at the decoder.
Solution Approach 2:
The patent introduces spatial correlation values as an intermediary element that mediates between the current block and its neighboring blocks. These correlation values serve as a bridge to derive motion vectors by comparing similarity metrics, allowing the decoder to achieve accurate motion estimation without direct complex analysis of the entire image sequence.
2Measurement precision
If spatial correlation is fully utilized for motion vector derivation, then prediction accuracy improves and residual data is reduced, but the computational burden and processing time increase
Solution Approach 1:
The patent applies preliminary action by computing and storing spatial correlation values during the encoding phase. This pre-computation allows the decoder to retrieve and use these correlation data directly without performing expensive real-time calculations, significantly reducing decoding time while maintaining high prediction accuracy.
Solution Approach 2:
The patent uses copying by retrieving pre-computed spatial correlation values from storage during decoding. Instead of recalculating these complex correlation metrics in real-time, the decoder copies the pre-computed values from memory, enabling fast and accurate motion vector derivation without the computational burden of re-calculating spatial correlations.
3Productivity
If motion vector derivation does not account for spatial correlation, then the decoding process is faster and less complex, but the residual between prediction block and current block increases
Solution Approach 1:
The patent implements feedback by using the decoded spatial correlation values to continuously refine motion vector estimation. The correlation data from neighboring blocks provides feedback information that guides the motion vector derivation process, enabling the system to adapt and optimize prediction accuracy while maintaining efficient decoding operations.
Data Source
AI summary
A method of decoding video data includes determining a plurality of hypotheses of a current block based on a plurality of motion vectors. Each of the plurality of motion vectors is associated with one of the plurality of hypotheses, and each of the plurality of hypotheses is based on a set of samples in a reference picture having a motion vector that identifies a top-left sample of the set of samples. The method includes determining one or more neighboring samples in the same picture as the current block, for each of the plurality of hypotheses, determining respective correlation values between at least one sample of a respective hypothesis and at least one sample of the one or more neighboring samples, determining the motion vector for the current block based on the determined respective correlation values, and reconstructing the current block based on the determined motion vector.