Selective Video Frame Filtering for Decoding Complexity Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increased decoding complexity due to the use of deep learning-based loop filtering tools in video decoding terminals, which reduces the promotion and practical application of these tools, as they require excessive computing resources for CTUs with minimal gains, leading to high decoding complexity without significant quality improvement.

Innovation Solution

A method where a video encoding terminal filters a reconstructed video frame to determine blocks with significant gains and transmits indication information to the decoding terminal, allowing it to only filter blocks with larger gains, thereby reducing the number of blocks participating in filtering and maintaining video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If deep learning-based loop filtering tools are used to filter all CTUs in the video frame, then video quality is improved, but decoding complexity increases significantly

Engineering Contradiction:
Improvevideo qualityVSAvoiddecoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different filtering operations to different regions of the video frame based on their characteristics. Specifically, it identifies important regions (such as regions containing important objects or high-activity areas) and applies deep learning-based loop filtering only to these regions, while using conventional filtering or no filtering for other regions. This selective approach maintains video quality in critical areas while significantly reducing the overall computational burden and decoding complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the video frame into multiple regions based on importance, activity level, or other criteria. By dividing the frame into different zones, the system can apply appropriate filtering strategies to each segment independently, rather than uniformly processing the entire frame with computationally intensive deep learning filters.

Inventive Principle:
Principle #1Segmentation

2Reliability

If deep learning-based loop filtering is applied to all blocks, then filtering completeness is improved, but computational resources are wasted on blocks with minimal gains

Engineering Contradiction:
Improvefiltering completenessVSAvoidcomputational resources
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent implements partial filtering by selectively applying deep learning-based loop filtering only to important regions of the video frame rather than all blocks. The system identifies regions that benefit most from filtering and concentrates computational resources there, while using simpler or no filtering for less critical areas, thereby avoiding waste of computational resources on blocks with minimal gains.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent changes the filtering parameters (such as filter strength, filter type, or whether to apply filtering at all) based on the characteristics of different regions. By dynamically adjusting these parameters according to regional importance or content characteristics, the system optimizes the balance between filtering effectiveness and computational resource consumption.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12022069B2Video encoding method and apparatus, video decoding method and apparatus, electronic device, and storage medium
Publication Date: 2024.06.25 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12022069B2 patent drawing
  • US12022069B2 patent drawing
  • US12022069B2 patent drawing

AI summary

Embodiments of this disclosure provide a video encoding and decoding method and devices relate to artificial intelligence technologies applied to video encoding and decoding, and are implemented to reduce decoding complexity and improve filtering efficiency when the video quality is not significantly affected by performing video filtering using machine learning technologies. The video encoding method may include obtaining a reconstructed video frame from encoded data of an encoded video frame, the encoded video frame comprising at least two encoding blocks; filtering the reconstructed video frame, to obtain filtering gains corresponding to the at least two encoding blocks; determining, according to a distribution of the filtering gains of the at least two encoding blocks, a target encoding block among the at least two encoding blocks that is to be filtered when being decoded at a decoder; and including into the encoded data of the encoded video frame, an indication information for indicating that the target encoding block is to be filtered.