Deblocking Filter Boundary Strength for FVC Artifacts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing deblocking filter in HEVC/H.265 is inadequate for addressing blocking artifacts caused by newly introduced encoding processes in Future Video Coding (FVC), leading to potential residual artifacts.

Innovation Solution

An image processing apparatus and method that applies a deblocking filter to block boundaries based on a boundary strength value set according to information associated with newly introduced encoding processes, such as adaptive transform and prediction modes, to effectively reduce blocking artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the boundary strength value bS is set by the HEVC/H.265 method, then the deblocking filter can be applied to block boundaries, but blocking artifacts remain when newly introduced encoding processes are used

Engineering Contradiction:
Improveblocking artifact reductionVSAvoidcompatibility with new encoding processes
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent modifies the boundary strength value determination by incorporating parameters from newly introduced encoding processes (transform types, prediction modes, intra-block copy flags, affine motion compensation flags) into the existing HEVC/H.265 boundary strength calculation. This allows the deblocking filter to adapt its strength based on the specific encoding process used, resolving the contradiction between maintaining HEVC compatibility and adapting to new encoding methods.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The boundary strength value is made dynamic by adjusting it according to the actual encoding process applied to each block. Instead of using a fixed HEVC method, the system dynamically selects and combines multiple boundary strength determination methods based on the presence of new encoding processes, allowing the deblocking filter to adapt to varying encoding conditions and effectively reduce blocking artifacts.

Inventive Principle:
Principle #15Dynamics

2Productivity

If new encoding processes are introduced to improve coding efficiency, then coding efficiency increases, but blocking artifacts occur due to signal characteristic differences between blocks

Engineering Contradiction:
Improvecoding efficiencyVSAvoidblocking artifacts
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent applies different boundary strength determination methods to different block boundaries based on the local encoding process used. By examining the specific encoding parameters (transform type, prediction mode, intra-block copy usage, affine motion compensation) of each block, the system locally adjusts the boundary strength value to match the signal characteristics of that specific region, thereby reducing blocking artifacts while preserving the benefits of new encoding processes.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The boundary strength determination uses a composite approach that combines multiple methods: the original HEVC/H.265 boundary strength method and additional determination methods specific to new encoding processes. This composite boundary strength calculation integrates information from different encoding techniques to create a more comprehensive and accurate boundary strength value that accounts for the diverse signal characteristics introduced by new encoding processes.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS10924735B2Image processing apparatus and image processing method
Publication Date: 2021.02.16 SONY GROUP CORP
  • US10924735B2 patent drawing
  • US10924735B2 patent drawing
  • US10924735B2 patent drawing

AI summary

An image processing apparatus including a decoding section that decodes an encoded stream to generate a decoded image, and a filtering section that applies, with respect to a block boundary of the decoded image generated by the decoding section, a deblocking filter to pixels positioned near the block boundary based on a boundary strength value set on the basis of information associated with a newly introduced encoding process or a newly introduced main encoding process.