Region-Specific Video Filtering for Rate-Distortion Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in achieving higher coding efficiency and improved picture quality, particularly due to blockwise coding artifacts, which are not adequately addressed by existing adaptive deblocking filters, and there is a need for more efficient methods to optimize the trade-off between picture quality and transmission bandwidth.

Innovation Solution

The proposed solution involves a decoder and encoder system that subdivides a picture into different regions and applies specific one-dimensional filters in various directions to improve picture quality, using filter indication information to apply distinct filters to different regions based on their characteristics, optimizing the rate-distortion function to minimize additional transmission data, and employing separable filters to reduce computational complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If an adaptive deblocking filter is applied within the motion-compensated prediction loop, then blocking artifacts are reduced and picture quality is improved, but coding efficiency and transmission bandwidth are not optimized sufficiently

Engineering Contradiction:
Improvepicture qualityVSAvoidcoding efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The picture is divided into multiple regions, and different filtering operations are applied to different regions based on their characteristics. This segmentation allows the filter to focus computational resources on regions that need deblocking while skipping regions that don't, thereby improving coding efficiency while maintaining picture quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different filtering strengths and types are applied to different regions of the picture based on local characteristics such as block boundaries, texture complexity, and gradient information. This local adaptation ensures that filtering is applied only where necessary, optimizing the trade-off between picture quality improvement and coding efficiency.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If multiple different filters are applied to different regions of the picture, then picture quality is enhanced, but the complexity of the filtering system increases

Engineering Contradiction:
Improvepicture qualityVSAvoidfiltering system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Instead of using completely different filter structures for different regions, the invention varies parameters such as filter strength, filter type (e.g., asymmetric vs. symmetric), and filter application regions. This approach maintains picture quality enhancement while keeping the filtering system manageable through parameter adaptation rather than structural complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The filtering system dynamically selects and applies different filter configurations based on real-time analysis of picture characteristics. This dynamic adaptation allows the system to handle diverse picture content effectively without requiring a permanently complex filtering architecture, as the complexity is activated only when and where needed.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If filtering is applied to improve picture quality, then distortion is reduced, but additional transmission data and computational resources are required

Engineering Contradiction:
Improvepicture qualityVSAvoidtransmission data overhead
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The invention applies filtering selectively to only those regions of the picture that require it, rather than applying uniform filtering to the entire picture. By identifying and filtering only the regions with blocking artifacts or high gradient areas, the system reduces distortion where needed while minimizing the additional transmission data and computational resources required.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9571861B2Decoder, encoder, method for decoding and encoding, and data stream for a picture, using separate filters
Publication Date: 2017.02.14 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US9571861B2 patent drawing
  • US9571861B2 patent drawing
  • US9571861B2 patent drawing

AI summary

A decoder for decoding a picture is described, having: an extractor adapted to extract a first subset of syntax elements from a received data stream and a second subset of syntax elements being disjoint from the first subset of syntax elements, wherein the second subset of syntax elements has filter indication information defining a first filter for a first region of at least two different regions of the picture and a second filter for a second region of the at least two different regions of the picture; a pre-decoder adapted to pre-decode the picture based on the first subset of syntax elements to produce a reconstructed version of the picture; and a filter stage adapted to apply the first filter to the first region of the reconstructed picture to obtain a first filtered version of the reconstructed version of the picture and to apply the second filter to the second region of the first filtered version of the reconstructed version of the picture to obtain a second filtered version of the reconstructed version of the picture.