Video Coding Motion Compensation With Uni-Prediction Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High memory bandwidth requirements for motion compensation in video coding, particularly in HEVC, especially for smaller prediction unit sizes, pose a bottleneck for efficient video processing in devices like smartphones and set-top boxes.
Innovation Solution
Restricting inter-predicted prediction units (PUs) of specific small sizes in bi-predicted slices to uni-prediction mode during encoding and decoding processes to reduce memory bandwidth needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If bi-prediction is used for small prediction units in HEVC, then prediction accuracy is improved, but memory bandwidth requirements increase significantly
Solution Approach 1:
The patent applies local quality by differentiating the prediction mode based on prediction unit size. Small PUs (4×4, 8×4, 4×8) are restricted to uni-prediction while larger PUs can use bi-prediction. This localized approach optimizes memory bandwidth usage by applying bi-prediction only where it provides significant benefit (larger blocks), while accepting uni-prediction for smaller blocks where the memory overhead is less justifiable.
Solution Approach 2:
The patent changes the prediction mode parameter based on PU size. By introducing a size-based condition that switches between uni-prediction and bi-prediction modes, the system dynamically adjusts the prediction approach to balance accuracy requirements against memory bandwidth constraints. This parameter change resolves the contradiction by adapting the prediction strategy to the specific spatial scale of each prediction unit.
2Productivity
If HEVC uses larger block sizes and 8-tap filters, then coding efficiency is improved, but memory bandwidth requirements for motion compensation increase
Solution Approach 1:
The patent applies local quality by restricting bi-prediction to specific PU sizes rather than uniformly applying it across all blocks. This selective approach ensures that the enhanced prediction accuracy of bi-prediction is used only where it provides the most benefit (larger PUs), while reducing memory bandwidth consumption for smaller PUs where the benefit is less significant.
Solution Approach 2:
The patent implements partial action by not enabling bi-prediction for all prediction units, but only for those meeting specific size criteria. This partial application of bi-prediction achieves a balance between coding efficiency improvement and memory bandwidth consumption, avoiding the excessive memory usage that would result from universal bi-prediction while still capturing the benefits where most needed.
Data Source
AI summary
Motion compensation requires a significant amount of memory bandwidth, especially for smaller prediction unit sizes. The worst case bandwidth requirements can occur when bi-predicted 4×8 or 8×4 PUs are used. To reduce the memory bandwidth requirements for such smaller PUs, methods are provided for restricting inter-coded PUs of small block sizes to be coded only in a uni-predictive mode, i.e., forward prediction or backward prediction. More specifically, PUs of specified restricted sizes in bi-predicted slices (B slices) are forced to be uni-predicted.


