Image Processing Apparatus Slice-Independent Adaptive Loop Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In image coding schemes like HEVC, processing time increases due to the need for parallel processing of slices, as information required for adaptive loop and offset filters often resides in different slices, causing dependencies and reducing throughput.

Innovation Solution

An image processing apparatus that obtains necessary information for a focused pixel within its own slice, using reference information from other pixels, and performs adaptive loop and offset filtering independently, without relying on external slice information, allowing for slice-by-slice processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If adaptive loop filter and offset filter are applied to improve image quality, then coding efficiency is improved, but processing time increases due to slice dependencies

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent divides the image into multiple slices and processes each slice independently for adaptive loop filter and offset filter operations. By segmenting the processing domain, filters can be applied within each slice without waiting for other slices, eliminating inter-slice dependencies and enabling parallel processing while maintaining image quality improvements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary classification of pixels into different types (e.g., smooth, textured, edge) before applying filters. This preliminary action allows the system to pre-determine which filter operations are needed for each pixel based on local characteristics, avoiding unnecessary filter computations and reducing overall processing time while maintaining image quality.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If filter information is obtained from neighboring slices, then filter accuracy is improved, but throughput is reduced due to processing dependencies

Engineering Contradiction:
Improvefilter accuracyVSAvoidthroughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies different filter operations and parameters to different local regions within slices based on pixel classification. Instead of requiring global slice information, the system determines filter accuracy locally by analyzing pixel characteristics within the current slice, such as variance, gradient, or texture properties, enabling independent slice processing without compromising filter accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces pixel classification as an intermediary step that mediates between raw pixel data and filter application. This classification mechanism enables the system to determine appropriate filter operations using only local information within each slice, eliminating the need for inter-slice data exchange while maintaining filter accuracy through adaptive parameter selection.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If complex filtering operations are performed on all pixels, then image quality is improved, but computational complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies complex filtering operations only to a subset of pixels that are classified as benefiting from such operations, rather than processing all pixels uniformly. By performing partial action on selected pixels based on local characteristics, the system maintains image quality improvements in critical regions while significantly reducing overall computational complexity.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent dynamically changes filter parameters based on local pixel characteristics such as variance, gradient magnitude, or texture measures. This parameter adaptation allows the system to apply strong filtering only where needed (high complexity regions) and use simpler or no filtering in uniform regions, optimizing the balance between image quality improvement and computational complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11095889B2Image processing apparatus and method
Publication Date: 2021.08.17 SONY GROUP CORP
  • US11095889B2 patent drawing
  • US11095889B2 patent drawing
  • US11095889B2 patent drawing

AI summary

The present technique relates to an image processing apparatus and method that allow to suppress an increase in processing time. The image processing apparatus includes an information control unit that obtains information required for image processing for a focused pixel, using only information belonging to a slice including the focused pixel, the focused pixel being a processing target, and the information being obtained using reference information belonging to a different pixel than the focused pixel; and an image processing unit that performs the image processing using the information obtained by the information control unit. The present disclosure can be applied to image processing apparatuses.