Multi-Hypothesis Motion Compensation Signaling Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-hypothesis motion compensation (MHMC) coding systems in video compression are limited by high signalling overhead and complexity, particularly when expanding the number of hypotheses beyond two, which increases bandwidth and power consumption, and lack flexibility in representing image data.
Innovation Solution
The proposed techniques allow for the development of multiple coding hypotheses for an input pixel block, enabling flexible block sizes and prediction modes, with advanced syntax elements to efficiently signal and combine prediction data, reducing overhead and enhancing decoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the number of hypotheses is increased beyond two, then the flexibility in representing image data is improved, but the signalling overhead and bandwidth increase considerably
Solution Approach 1:
The patent segments the hypothesis selection process by introducing a flag-based mechanism that divides the signalling into optional components. The first hypothesis is always present, while additional hypotheses are conditionally included based on flags, allowing the system to be divided into minimal and extended configurations.
Solution Approach 2:
The patent applies partial action by allowing the use of only one or two hypotheses when sufficient, rather than always using all available hypotheses. The system performs the minimum necessary signalling (one hypothesis) and can optionally add more (up to two additional hypotheses) only when needed for complex scenarios.
2Measurement precision
If the number of hypotheses is increased, then the prediction accuracy is improved, but the power consumption and complexity increase
Solution Approach 1:
The patent makes the hypothesis configuration dynamic by allowing the encoder to select between different numbers of hypotheses (1, 2, or 3 total) based on the specific coding scenario. The system can adaptively adjust the complexity level rather than being fixed, enabling optimal balance between accuracy and complexity for each block.
Solution Approach 2:
The patent changes the parameter of hypothesis count from a fixed value to a variable that can be adjusted between 1 and 3 hypotheses. This parameter change is controlled through the signalling mechanism that allows selective inclusion of additional hypotheses based on their utility.
3Manufacturing precision
If more hypotheses are used, then the video quality is improved, but the bandwidth consumption increases by 33% or more
Solution Approach 1:
The patent segments the bandwidth consumption by separating the essential hypothesis signalling from optional additional hypotheses. The base configuration uses minimal bandwidth for one hypothesis, while additional hypotheses consume extra bandwidth only when their quality improvement benefit justifies the additional 33% overhead.
4Adaptability or versatility
If the hypothesis signalling is expanded, then the coding flexibility is improved, but the data prefetching and memory management complexity increases
Solution Approach 1:
The patent makes the memory management dynamic by allowing the decoder to allocate and prefetch memory based on the actual number of hypotheses present in each coding block. Rather than always preparing for maximum hypotheses, the system adapts memory usage to the actual configuration signaled by the flags.
Data Source
AI summary
The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.