Deblocking Filter Control for Triangle Merge Prediction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In video encoding and decoding, the deblocking filter control in VVC does not adequately account for weighted averaging in triangle merge prediction, leading to potential discontinuity and deterioration in image quality at block boundaries.

Innovation Solution

An encoding and decoding device with a filter controller that adjusts deblocking filter application based on the position of merged areas generated through weighted averaging in triangle merge prediction, ensuring appropriate filter control across block boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the deblocking filter control is based only on motion vector information without considering weighted averaging in triangle merge prediction, then the processing complexity is reduced, but discontinuity occurs at block boundaries leading to deterioration in image quality

Engineering Contradiction:

Improvedeblocking filter control complexityVSAvoiddiscontinuity at block boundary

Core Design Contradiction:

Device complexityVSObject-affected harmful factors

Solution Approach 1:

The patent segments the block boundary into two types: boundaries adjacent to merged areas (where weighted averaging occurs) and boundaries not adjacent to merged areas. This segmentation allows the filter controller to apply different deblocking filter control strategies to different boundary segments, preventing discontinuity at boundaries adjacent to merged areas while maintaining processing efficiency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by making the deblocking filter control dependent on the local characteristic of whether a boundary is adjacent to a merged area. Boundaries adjacent to merged areas receive enhanced filter control to prevent discontinuity, while other boundaries use standard control, thus optimizing image quality where needed without unnecessarily increasing overall complexity.

Inventive Principle:

Principle #3Local quality

2Object-affected harmful factors

If the deblocking filter is applied to all block boundaries regardless of weighted averaging, then image quality is maintained, but encoding efficiency deteriorates due to excessive filtering

Engineering Contradiction:

Improvediscontinuity at block boundaryVSAvoidencoding efficiency

Core Design Contradiction:

Object-affected harmful factorsVSProductivity

Solution Approach 1:

The patent segments block boundaries into those adjacent to merged areas and those not adjacent, applying deblocking filter control only where necessary. This selective approach prevents discontinuity at critical boundaries while avoiding excessive filtering at other boundaries, thus maintaining encoding efficiency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by using only the necessary portion of deblocking filter control - specifically at boundaries adjacent to merged areas where weighted averaging causes discontinuity. This avoids the excessive filtering that would occur if the deblocking filter were applied uniformly to all boundaries, thereby preserving encoding efficiency.

Inventive Principle:

Principle #16Partial or excessive action

3Object-affected harmful factors

If triangle merge prediction with weighted averaging is used to improve image quality, then visual performance is enhanced, but the deblocking filter control becomes insufficient leading to discontinuity at boundaries

Engineering Contradiction:

Improveimage quality deteriorationVSAvoidcontinuity at block boundary

Core Design Contradiction:

Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent segments boundaries into those adjacent to merged areas (where triangle merge prediction with weighted averaging is applied) and other boundaries. This segmentation enables the deblocking filter controller to specifically address continuity issues at boundaries where weighted averaging is used, ensuring reliability where triangle merge prediction is applied.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent uses feedback by having the filter controller determine boundary strength based on information about whether boundaries are adjacent to merged areas. This feedback mechanism ensures that the deblocking filter control is appropriately adjusted in response to the presence of weighted averaging, maintaining continuity at boundaries where triangle merge prediction is used.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12015789B2Encoding device, decoding device and program for triangle merge protection on boundary between two blocks

Publication Date: 2024.06.18 NIPPON HOSO KYOKAI

AI summary

An encoding device 1 includes: a merge predictor 181a configured to generate area prediction images using motion vectors of a plurality of divided areas obtained by dividing an encoding-target block and merge areas at boundaries of a plurality of the generated area prediction images through weighted averaging to generate a prediction block of the encoding-target block: and a filter controller 161 configured to control the deblocking filter based on a position of a merged area merged by the merge predictor 181a through the weighted averaging.