Adaptive Block Filtering for Image Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods, such as those using the MPEG2 and MPEG4 standards, face inefficiencies in encoding and decoding due to the uniform application of filter coefficients across entire frames, leading to degradation in encoding efficiency, especially when frames are divided into multiple slices.

Innovation Solution

An image processing apparatus and method that determines whether a control block includes a processing-target slice area and creates filter control information to selectively apply filtering, only performing filtering on areas where it improves image quality, thereby optimizing encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If filtering is uniformly applied across entire frames, then image quality is improved, but encoding efficiency is degraded

Engineering Contradiction:
Improveimage qualityVSAvoidencoding efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The frame is divided into multiple slices, and filtering is applied selectively to each slice based on its specific characteristics. This allows different regions to receive appropriate filtering treatment, improving overall image quality while avoiding unnecessary filtering operations in regions where they are not needed, thus maintaining encoding efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different filter coefficients are applied to different slices based on their local image characteristics. This local adaptation ensures that filtering is optimized for each region's specific needs, improving image quality where necessary while avoiding degradation of encoding efficiency in regions where uniform filtering would be wasteful.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If filtering is applied to all slices, then image quality is improved, but bit rate increases

Engineering Contradiction:
Improveimage qualityVSAvoidbit rate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

Filter control information is extracted and transmitted only for slices that require filtering, rather than for all slices. This reduces the amount of additional data that needs to be encoded and transmitted, thereby limiting the increase in bit rate while still achieving image quality improvement where filtering is beneficial.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Filtering is applied partially - only to those slices that benefit from it - rather than excessively applying it to all slices. This selective approach achieves sufficient image quality improvement without the penalty of increased bit rate that would result from universal filtering application.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If filter control information is transmitted for each slice, then filtering precision is improved, but device complexity increases

Engineering Contradiction:
Improvefiltering precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Filter control information for multiple slices is merged into a unified data structure that can be processed efficiently. This reduces the complexity of handling filter control information by treating it as a cohesive unit rather than separate individual pieces, thereby maintaining filtering precision while reducing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The filter control information structure is designed to be universal, capable of handling different slice types and filtering requirements through a single unified mechanism. This multi-functionality reduces device complexity by avoiding the need for separate processing paths for different slice configurations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10841580B2Apparatus and method of adaptive block filtering of target slice based on filter control information
Publication Date: 2020.11.17 SONY GROUP CORP
  • US10841580B2 patent drawing
  • US10841580B2 patent drawing
  • US10841580B2 patent drawing

AI summary

Provided is an image processing apparatus including: area determination unit configured to determine whether or not an area of a control block functioning as control unit for filtering of an image includes a processing-target slice area of a plurality of slices formed in a frame of an encoded image; control information creation unit configured to create filter control information representing whether or not the filtering is performed for the area of the control block including a processing-target slice for each area of the control block including the processing-target slice when the area determination unit determines that the area of the control block includes the area of the processing-target slice; and filter unit configured to perform filtering for the image based on the filter control information created by the control information creation unit.