Adaptive Bilateral Filter for Video Block Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding methods fail to fully leverage image properties for improved compression efficiency, particularly in preserving image details and reducing bit rate while maintaining video quality.

Innovation Solution

The method involves reconstructing image blocks using inverse quantization and inverse transform, followed by refinement with neighboring blocks, employing adaptive bilateral filtering, and coefficient truncation based on quantization parameters and image variance to enhance compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If transform coefficients are truncated to reduce bit rate, then compression efficiency is improved, but image quality deteriorates

Engineering Contradiction:
Improvebit rateVSAvoidimage quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

A bilateral filter is introduced as an intermediary process between inverse transform and final image reconstruction. The filter uses pixel intensity and gradient information from neighboring blocks to interpolate and refine the reconstructed image, compensating for information lost during coefficient truncation and maintaining image quality while enabling aggressive compression

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The bilateral filter parameters (spatial window size and gradient threshold) are dynamically adjusted based on the quantization parameter and variance of the image block. This adaptive parameter adjustment allows the system to optimize the balance between compression ratio and image quality for different content characteristics

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If bilateral filtering is applied to refine reconstructed images, then image quality is improved, but computational complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The bilateral filtering is applied selectively based on local image characteristics. The filter is primarily applied at block boundaries where discontinuities occur, rather than uniformly across the entire image. This localized application reduces computational complexity while maintaining image quality improvement where it is most needed

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of applying full bilateral filtering to all image blocks, the method applies filtering selectively to blocks that benefit most from it, determined by variance thresholds and boundary detection. This partial application reduces overall computational complexity while maintaining quality for critical regions

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If adaptive bilateral filtering with variable parameters is used, then image refinement performance is improved, but device complexity increases

Engineering Contradiction:
Improveimage refinement performanceVSAvoidfiltering parameter management
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The bilateral filter parameters are adaptively adjusted based on the quantization parameter (QP) and the variance of the image block. Higher QP values (coarser quantization) trigger stronger filtering with larger spatial windows, while low-variance regions use milder filtering. This adaptive parameter adjustment optimizes refinement performance across different compression levels and content types

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system uses feedback from the quantization process and image statistics (variance calculation) to dynamically adjust filtering parameters. The variance of the image block serves as a feedback signal that determines the appropriate filtering strength, creating a closed-loop system that adapts to content characteristics

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9930329B2Video encoding and decoding based on image refinement
Publication Date: 2018.03.27 INTERDIGITAL MADISON PATENT HLDG
  • US9930329B2 patent drawing
  • US9930329B2 patent drawing
  • US9930329B2 patent drawing

AI summary

A particular implementation forms an initial reconstructed image block from inverse quantization and inverse transform, and further refines the reconstructed image block using pixels from neighboring reconstructed blocks. The image block may be refined using a bilateral filter, whose space parameter and range parameter are adaptive to the quantization parameter. The particular implementation can be used in both encoding and decoding when reconstructing an image block. When used in encoding, the particular implementation can be used jointly with coefficient truncation, where some non-zero transform coefficients are set to zero. The number of remaining non-zero transform coefficients after coefficient truncation may be adaptive to the quantization parameter, the variance of the image block, the number of non-zero transform coefficients of the image block, and the index of the last non-zero transform coefficient in a zigzag scanning order.