Adaptive Bilateral Filter for Video Ringing Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies, such as those in HEVC and VVC, face challenges in effectively removing ringing artifacts, especially in chroma components, which are not fully addressed by existing in-loop filters.

Innovation Solution

The implementation of a bilateral filter that applies different filtering methods based on video unit characteristics, such as transform coefficient levels, quantization parameters, and syntax elements, to selectively apply filtering to luma and chroma components, thereby addressing artifacts like ringing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a bilateral filter is applied to filter samples in video units, then ringing artifacts are reduced and coding efficiency is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improveringing artifact reductionVSAvoidfiltering process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies different bilateral filter parameters and operations to different video units (CU, TU, CTU) based on their specific characteristics such as transform coefficient levels, quantization parameters, and coding modes. This localized adaptive filtering allows the system to reduce ringing artifacts effectively in regions where they occur while avoiding unnecessary computational complexity in regions where the filter would have minimal impact or could introduce artifacts.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the bilateral filter application based on real-time analysis of video unit properties including transform coefficient levels, quantization parameters, and coding modes. The filter strength and parameters are adapted during the encoding/decoding process to optimize artifact reduction while minimizing computational overhead, transforming a static filtering approach into a dynamic one that responds to local video characteristics.

Inventive Principle:
Principle #15Dynamics

2Reliability

If bilateral filter parameters are adjusted for different video unit types and sizes, then filtering effectiveness is improved, but control complexity increases

Engineering Contradiction:
Improvefiltering effectivenessVSAvoidparameter control complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the video processing into different units (CU, TU, CTU) and applies specific bilateral filter parameters to each segment based on its characteristics. This segmentation allows independent optimization of filter parameters for different video unit types and sizes, improving filtering effectiveness while managing complexity through structured organization of the control logic.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes bilateral filter parameters adaptively based on video unit characteristics such as transform coefficient levels, quantization parameters, and coding modes. By systematically varying parameters like filter strength and kernel size according to these characteristics, the system achieves effective filtering across different video unit types without requiring a completely complex control mechanism.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If the bilateral filter is applied selectively based on transform coefficient levels and quantization parameters, then coding efficiency is improved, but decision-making complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddecision logic complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary analysis of video unit characteristics (transform coefficient levels, quantization parameters, coding modes) before applying the bilateral filter. This preliminary evaluation stage determines the appropriate filter parameters and application strategy in advance, allowing the system to achieve high coding efficiency by only applying the filter when and where it is most beneficial, while the decision logic is pre-structured based on these characteristics.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240137505A1Conditions for usage of adaptive bilateral filters
Publication Date: 2024.04.25 BYTEDANCE INC
  • US20240137505A1 patent drawing
  • US20240137505A1 patent drawing
  • US20240137505A1 patent drawing

AI summary

A mechanism for processing video data is disclosed. The mechanism determines whether to apply a bilateral filter to filter samples in a video unit based on video information related to the samples. A conversion is performed between a visual media data and a bitstream based on the bilateral filter and the samples.