Motion Compensation Boundary Filtering for Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video encoding and decoding methods, such as those in HEVC, face inefficiencies in inter slice coding due to complex post-processing requirements for prediction block filtering, which increases computational complexity and memory bandwidth demands.
Innovation Solution
The proposed solution involves filtering the boundary between a prediction block and a reconstructed neighboring block during the encoding and decoding processes, simplifying the OBMC process by applying filtering at the motion prediction stage to smooth prediction residuals before reconstruction, thereby reducing computational complexity and memory access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If filtering is performed on the boundary between prediction block and reconstructed neighboring block during post-processing, then blocking artifacts are reduced and visual quality is improved, but computational complexity and memory bandwidth demands increase
Solution Approach 1:
The patent applies filtering during the motion prediction stage rather than in post-processing. By performing the filtering action preliminarily when the prediction block is generated, the boundary smoothing is achieved before the block is reconstructed and stored, thereby avoiding the need for complex post-processing operations and reducing both computational complexity and memory bandwidth requirements.
Solution Approach 2:
The patent introduces an intermediary filtering operation that acts on the prediction block boundary using reconstructed neighboring block samples as reference. This intermediary process smooths the boundary in between the prediction and reconstruction stages, achieving quality improvement without requiring full post-processing of the reconstructed block, thus reducing computational burden.
2Manufacturing precision
If filtering is performed on the boundary between prediction block and reconstructed neighboring block during post-processing, then blocking artifacts are reduced and visual quality is improved, but memory bandwidth requirements increase
Solution Approach 1:
By performing filtering preliminarily during the prediction stage, the patent avoids the need to load and process the entire reconstructed block in post-processing. Only the necessary boundary samples are accessed and filtered, significantly reducing memory bandwidth requirements while still achieving boundary smoothing quality improvement.
3Productivity
If complex post-processing filtering is applied to prediction blocks, then coding efficiency is improved, but processing time and computational resources increase
Solution Approach 1:
The patent moves the filtering operation to the prediction stage, performing it preliminarily before reconstruction. This timing shift maintains coding efficiency by ensuring smooth boundaries are present in the final reconstructed block, while reducing processing time by avoiding redundant post-processing operations on already reconstructed data.
Data Source
AI summary
At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a prediction block for a current block is obtained. A reconstructed neighboring block of the prediction block is obtained. Filtering is performed on a boundary between the prediction block and the reconstructed neighboring block. At the encoder side, the prediction residual is obtained as the difference between the filtered prediction block and the current block, and then encoded. At the decoder side, the prediction residual is added to the filtered prediction block to reconstruct the current block.