Prediction Image Interpolation for Low-Bandwidth OBMC Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding and decoding technologies face challenges with large memory bandwidth requirements, increased processing amounts, and reduced prediction accuracy due to OBMC processing in motion compensation.
Innovation Solution
The solution involves optimizing video decoding and encoding devices to manage memory access and processing efficiently by employing specific PU partition modes and improved inter-prediction parameter handling, including bilateral matching and template matching techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If OBMC processing is performed to generate prediction images using interpolation images from target PU and neighboring PU, then prediction accuracy is improved, but memory bandwidth requirement increases
Solution Approach 1:
The patent applies different processing strategies to different regions: OBMC processing is applied only to boundary regions between PUs where it provides benefit, while non-boundary regions use standard motion compensation. This selective application maintains prediction accuracy at boundaries while reducing overall memory bandwidth requirements.
Solution Approach 2:
The patent segments the PU processing into boundary regions and non-boundary regions, applying OBMC processing only where necessary at boundaries. This segmentation allows the system to maintain prediction accuracy where needed while reducing the overall computational and memory burden.
2Measurement precision
If OBMC processing is performed to generate prediction images using interpolation images from target PU and neighboring PU, then prediction accuracy is improved, but processing amount increases
Solution Approach 1:
The patent applies OBMC processing selectively to boundary regions where prediction accuracy benefits are most significant, rather than uniformly across all regions. This local application reduces the total processing amount while maintaining accuracy where it matters most.
Solution Approach 2:
By segmenting the processing into boundary and non-boundary regions, the patent reduces overall processing complexity while maintaining prediction accuracy at critical boundary areas through OBMC.
3Measurement precision
If OBMC processing is performed to generate prediction images using interpolation images from target PU and neighboring PU, then prediction accuracy degrades due to overlapping region reduction for chroma components
Solution Approach 1:
The patent applies different OBMC processing strategies to different color components: full OBMC processing for luminance components where accuracy is critical, and reduced OBMC processing for chroma components where the overlapping region reduction causes less degradation. This differential approach balances overall prediction accuracy.
Solution Approach 2:
The patent changes the OBMC processing parameters selectively for different color components, applying different weight coefficients and overlapping region reductions for chroma versus luminance, thereby optimizing the balance between processing efficiency and prediction accuracy for each component type.
Data Source
Figure 1A~1F
Figure 2A~2H
Figure 3
AI summary
In motion compensation processing performed in a case of generating a prediction image, overlapped block motion compensation (OBMC) processing which generates an interpolation image of a target PU is improved by using a PU interpolation image generated with the use of an inter-prediction parameter added to the target PU and an OBMC interpolation image generated with the use of a motion parameter of a neighboring PU of the target PU. The present invention includes an interpolation image generation unit configured to generate an interpolation image by applying motion information of a target PU and filter processing to a sub-block on the reference image corresponding to a target sub-block; and an additional interpolation image generation unit configured to generate an additional interpolation image by applying motion information of a neighboring sub-block neighboring the target sub-block and filter processing to the sub-block on the reference image corresponding to the target sub-block. In a case of the OBMC processing being ON (S11), the interpolation image generation unit and the additional interpolation image generation unit configures the number of taps of each filter in the filter processing in the interpolation image generation unit and the additional interpolation image generation unit to be smaller, compared to a case of the OBMC processing being OFF (S12).