Subblock Deblocking Filter for Video Coding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional de-blocking filtering methods are inefficient for small block sizes in new video partition structures, leading to increased computational load and interaction between boundaries, which affects video encoding and decoding processes.

Innovation Solution

A method that applies de-blocking processing to sub-block boundaries within a current block, allowing for constrained filtering based on sub-block mode prediction, such as Advanced Temporal Motion Vector Prediction or affine mode, to reduce the number of samples filtered and minimize interaction between boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional de-blocking filtering methods are applied to small block sizes, then video quality improvement is achieved, but computational load increases significantly

Engineering Contradiction:
Improvevideo qualityVSAvoidcomputational load
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The current block is divided into multiple sub-blocks, and de-blocking filtering is applied selectively to sub-block boundaries rather than the entire block boundary. This segmentation approach reduces the number of samples that need to be filtered, thereby reducing computational load while maintaining video quality improvement where it is most needed at sub-block transitions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different filtering approaches are applied to different regions: sub-block boundaries receive de-blocking filtering to improve local video quality, while other areas may use alternative methods or no filtering. This local quality principle allows computational resources to be concentrated where they provide the most benefit, reducing overall computational load

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If de-blocking filtering is applied to all block boundaries, then blocking artifacts are reduced, but interaction between boundaries increases

Engineering Contradiction:
Improveblocking artifact reductionVSAvoidboundary interaction
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

By segmenting the block into sub-blocks and applying de-blocking filtering only at sub-block boundaries, the patent reduces the number of boundaries that interact with each other. This segmentation isolates the filtering operations, reducing the complexity of boundary interactions while still addressing blocking artifacts at the most critical sub-block level

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and applies de-blocking filtering specifically to sub-block boundaries, separating this operation from the traditional whole-block boundary filtering. This extraction allows for targeted artifact reduction at sub-block boundaries without the complexity of coordinating filtering across all block boundaries

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If sub-block mode prediction is used, then coding efficiency is improved, but de-blocking filtering complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidde-blocking filtering complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent leverages the sub-block structure created by sub-block mode prediction and applies de-blocking filtering at these sub-block boundaries. While the sub-block structure adds complexity, the filtering is applied in a systematic and localized manner that prevents exponential complexity growth, maintaining a reasonable balance between coding efficiency and filtering complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11924444B2Method and apparatus of subblock deblocking in video coding
Publication Date: 2024.03.05 HFI INNOVATION INC
  • US11924444B2 patent drawing
  • US11924444B2 patent drawing
  • US11924444B2 patent drawing

AI summary

Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream corresponding to compressed data including the current block in the current picture at a video decoder side, and determines a first boundary associated with the current block, wherein the first boundary corresponds to one vertical boundary or one horizontal boundary of the current block. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a filtered-reconstructed current block, using a plurality of first reference samples at a same side of the first boundary, and replaces a first set of the first reference samples by one or more padding values. The method then generates a filtered decoded picture including the filtered-reconstructed current block.