Multi-Frame Motion Compensation Synthesis for Low-Cost Video Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-hypothesis motion compensation techniques for video coding incur higher rate costs and computational complexity due to additional motion vector data transmission and derivation, leading to reduced compression efficiency and accuracy.
Innovation Solution
Implement multi-frame motion compensation synthesis that utilizes motion vectors of previously decoded and buffered reference frames to combine multiple prediction blocks, without additional rate or computational cost, by following a reference-block trajectory and applying specific weighting schemes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multi-hypothesis motion compensation techniques are used, then prediction quality is improved, but rate cost and computational complexity increase
Solution Approach 1:
The patent segments the motion compensation process into multiple prediction blocks, each derived from different reference frames or motion hypotheses. By dividing the prediction into separate components (first prediction block from first reference frame, second prediction block from second reference frame), the system can combine these segmented predictions to achieve improved overall prediction quality while managing complexity through structured processing
Solution Approach 2:
The patent merges multiple prediction blocks into a final prediction block by combining the first prediction block and second prediction block. This merging process leverages information from multiple reference frames simultaneously, improving prediction accuracy by synthesizing complementary information while maintaining a unified output structure
2Measurement precision
If multi-hypothesis motion compensation techniques are used, then prediction quality is improved, but rate cost increases
Solution Approach 1:
The patent applies partial motion compensation by using multiple reference frames selectively. Instead of requiring full multi-frame references for all blocks, the system applies motion compensation only where beneficial, using a first reference frame for some blocks and a second reference frame for others. This partial application reduces the overall rate cost while maintaining improved prediction quality where needed
Data Source
AI summary
A motion vector for a current block of a current frame is decoded. The motion vector for the current block refers to a first reference block in a first reference frame. A first prediction block of two or more prediction blocks is identified in the first reference frame and using the first reference block. A first grid-aligned block is identified based on the first reference block. A second reference block is identified using a motion vector of the first grid-aligned block in a second reference frame. A second prediction block of the two or more prediction blocks is identified in the second reference frame and using the second reference block. The two or more prediction blocks are combined to obtain a prediction block for the current block.