Multi-hypothesis Inter Prediction Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-Efficiency Video Coding (HEVC) faces challenges in reducing bandwidth requirements for Multi-hypothesis mode, particularly in Inter prediction, where existing methods do not effectively optimize coding settings to improve prediction efficiency and reduce computational complexity.
Innovation Solution
The proposed solution involves a Multi-hypothesis (MH) mode that combines a first predictor based on a first hypothesis with at least one second predictor based on a second hypothesis, adjusting coding-control settings such as prediction direction, filter taps, block size, and reference pictures to derive motion information, and using these settings to generate additional motion candidates for improved Inter prediction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If Multi-hypothesis mode is used for Inter prediction, then prediction efficiency is improved, but bandwidth requirement increases
Solution Approach 1:
The patent extracts only the essential motion information from multiple hypotheses rather than transmitting complete motion data for each hypothesis. By selecting and transmitting only critical motion parameters (such as motion vector differences or selected hypothesis indicators) instead of full motion information, the bandwidth requirement is reduced while maintaining the prediction efficiency benefits of multi-hypothesis mode.
Solution Approach 2:
The patent applies partial action by using a subset of the full multi-hypothesis information set. Instead of utilizing all available hypothesis data which would maximize bandwidth consumption, the method selectively uses only the necessary portion of motion information from multiple hypotheses to achieve sufficient prediction accuracy, thereby reducing transmitted data while maintaining improved prediction efficiency.
2Measurement precision
If multiple motion candidates are generated for Multi-hypothesis mode, then coding performance is improved, but computational complexity increases
Solution Approach 1:
The patent performs preliminary action by pre-generating and caching motion candidates during the encoding process before actual prediction is needed. Motion vectors and candidate information are prepared in advance and stored in candidate lists, allowing the decoder to benefit from multiple hypotheses without performing computationally intensive motion estimation at decode time. This preliminary preparation improves coding performance while managing computational complexity through advance computation.
Solution Approach 2:
The patent applies dynamics by adaptively adjusting the number and type of motion candidates generated based on picture characteristics, block size, and prediction mode. The system dynamically modifies the complexity of multi-hypothesis processing - using more candidates for difficult prediction regions and fewer candidates for simpler regions - thereby improving coding performance where needed while reducing overall computational complexity through selective application.
Data Source
AI summary
A method and apparatus of Inter prediction for video coding using Multi-hypothesis (MH) are disclosed. If an MH mode is used for the current block: at least one MH candidate is derived using reduced reference data by adjusting at least one coding-control setting; an Inter candidate list is generated, where the Inter candidate list comprises said at least one MH candidate; and current motion information associated with the current block is encoded using the Inter candidate list at the video encoder side or the current motion information associated with the current block is decoded at the video decoder side using the Merge candidate list. The coding control setting may correspond to prediction direction setting, filter tap setting, block size of reference block to be fetched, reference picture setting or motion limitation setting.


