Selective Video Frame Filtering for Decoding Complexity Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increased decoding complexity due to the use of deep learning-based loop filtering tools in video decoding terminals, which reduces the promotion and practical application of these tools, as they require excessive computing resources for CTUs with minimal gains, leading to high decoding complexity without significant quality improvement.
Innovation Solution
A method where a video encoding terminal filters a reconstructed video frame to determine blocks with significant gains and transmits indication information to the decoding terminal, allowing it to only filter blocks with larger gains, thereby reducing the number of blocks participating in filtering and maintaining video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If deep learning-based loop filtering tools are used to filter all CTUs in the video frame, then video quality is improved, but decoding complexity increases significantly
Solution Approach 1:
The patent applies different filtering operations to different regions of the video frame based on their characteristics. Specifically, it identifies important regions (such as regions containing important objects or high-activity areas) and applies deep learning-based loop filtering only to these regions, while using conventional filtering or no filtering for other regions. This selective approach maintains video quality in critical areas while significantly reducing the overall computational burden and decoding complexity.
Solution Approach 2:
The patent segments the video frame into multiple regions based on importance, activity level, or other criteria. By dividing the frame into different zones, the system can apply appropriate filtering strategies to each segment independently, rather than uniformly processing the entire frame with computationally intensive deep learning filters.
2Reliability
If deep learning-based loop filtering is applied to all blocks, then filtering completeness is improved, but computational resources are wasted on blocks with minimal gains
Solution Approach 1:
The patent implements partial filtering by selectively applying deep learning-based loop filtering only to important regions of the video frame rather than all blocks. The system identifies regions that benefit most from filtering and concentrates computational resources there, while using simpler or no filtering for less critical areas, thereby avoiding waste of computational resources on blocks with minimal gains.
Solution Approach 2:
The patent changes the filtering parameters (such as filter strength, filter type, or whether to apply filtering at all) based on the characteristics of different regions. By dynamically adjusting these parameters according to regional importance or content characteristics, the system optimizes the balance between filtering effectiveness and computational resource consumption.
Data Source
AI summary
Embodiments of this disclosure provide a video encoding and decoding method and devices relate to artificial intelligence technologies applied to video encoding and decoding, and are implemented to reduce decoding complexity and improve filtering efficiency when the video quality is not significantly affected by performing video filtering using machine learning technologies. The video encoding method may include obtaining a reconstructed video frame from encoded data of an encoded video frame, the encoded video frame comprising at least two encoding blocks; filtering the reconstructed video frame, to obtain filtering gains corresponding to the at least two encoding blocks; determining, according to a distribution of the filtering gains of the at least two encoding blocks, a target encoding block among the at least two encoding blocks that is to be filtered when being decoded at a decoder; and including into the encoded data of the encoded video frame, an indication information for indicating that the target encoding block is to be filtered.


