Sub-block Deblocking Filter for Video Coding Artifacts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques face challenges in efficiently addressing blocking artifacts in video data, particularly with the introduction of flexible block structures and advanced prediction modes, which can lead to increased computational complexity and reduced coding efficiency.

Innovation Solution

The method involves partitioning current blocks into sub-blocks using Short Distance Intra Prediction (SDIP) or Sub-Block Transform (SBT) and applying a constrained de-blocking filter with adjusted boundary strength values to align internal block boundaries with de-blocking grids, thereby improving filtering efficiency and reducing artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If flexible block structures and advanced prediction modes are used, then coding efficiency is improved, but blocking artifacts increase

Engineering Contradiction:
Improvecoding efficiencyVSAvoidblocking artifacts
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent applies different boundary strength values to different boundaries based on their local characteristics. Internal block boundaries within sub-blocks use a first boundary strength value, while external boundaries use a second boundary strength value. This localized differentiation allows effective artifact reduction at critical boundaries while maintaining coding efficiency benefits from flexible block structures.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the block structure into sub-blocks with internal boundaries, allowing differential de-blocking filter application. By dividing the coding block into sub-blocks and applying specific boundary strength values to internal boundaries, the patent addresses blocking artifacts locally without compromising the overall coding efficiency improvements from flexible block structures.

Inventive Principle:
Principle #1Segmentation

2Object-generated harmful factors

If de-blocking filter is applied to all boundaries, then blocking artifacts are reduced, but computational complexity increases

Engineering Contradiction:
Improveblocking artifactsVSAvoidcomputational complexity
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

The patent applies de-blocking filter with different boundary strength values selectively to different boundaries. Internal block boundaries use a first boundary strength value while external boundaries use a second boundary strength value, allowing computational resources to be focused on boundaries that most need filtering while reducing unnecessary computation at boundaries that require less processing.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the boundary strength parameter based on boundary location and type. By setting different boundary strength values (first boundary strength value for internal boundaries, second boundary strength value for external boundaries), the patent optimizes the de-blocking filter strength to balance artifact reduction with computational complexity management.

Inventive Principle:
Principle #35Parameter changes

3Object-generated harmful factors

If boundary strength is increased to remove artifacts, then filtering effectiveness is improved, but distortion of original image data increases

Engineering Contradiction:
Improveblocking artifactsVSAvoidimage data accuracy
Core Design Contradiction:
Object-generated harmful factorsVSManufacturing precision

Solution Approach 1:

The patent applies different boundary strength values to different boundaries based on their specific needs. Internal block boundaries within sub-blocks receive a first boundary strength value that is optimized for their characteristics, while external boundaries receive a second boundary strength value. This localized approach ensures effective artifact removal without excessive filtering that would distort original image data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent adjusts the boundary strength parameter dynamically based on boundary location and type. By setting appropriate boundary strength values for different boundaries, the patent optimizes filtering effectiveness while preventing over-filtering that would cause distortion of the original image data.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11356699B2Method and apparatus of sub-block deblocking in video coding
Publication Date: 2022.06.07 HFI INNOVATION INC
  • US11356699B2 patent drawing
  • US11356699B2 patent drawing
  • US11356699B2 patent drawing

AI summary

Method and apparatus for constrained de-blocking filter are disclosed. According to one method, a current block is partitioned into a plurality of sub-blocks using SDIP (Short Distance Intra Prediction mod). A first Bs (boundary strength) for an internal block boundary of the plurality of sub-blocks is determined by setting the first Bs to a second Bs of an Intra-coded boundary block of the current block. De-blocking process is applied, using the first Bs, to reconstructed samples across the internal block boundary of the plurality of sub-blocks to generate filtered-reconstructed samples. In another method, the current block is partitioned into two sub-blocks using SBT (sub-block transform) horizontally or vertically and the first Bs (boundary strength) is determined for an internal block boundary between the two sub-blocks by setting the first Bs to a second Bs of a non-zero cbf (coded block flag) block of the two sub-blocks in step.