Image Processing Apparatus Noise Reduction Sharpening Filter

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods amplify noise during sharpening, and they increase the processing load due to complex calculations required for gain estimation and storage of varying sharpening filters for different image capturing conditions.

Innovation Solution

An image processing apparatus that acquires noise information and gain information using a sharpening filter based on optical characteristics, allowing for noise reduction during sharpening while minimizing processing load by estimating gain from a real-space sharpening filter and adjusting the sharpening degree based on noise characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If sharpening processing is performed on an image using PSF or OTF, then image sharpness is improved, but noise in the image is amplified

Engineering Contradiction:
Improveimage sharpnessVSAvoidnoise amplification
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent changes the domain parameter from frequency space (OTF) or point spread function (PSF) to real space by using a sharpening filter. This parameter change allows the system to achieve sharpening while controlling noise amplification through the filter design in real space, resolving the contradiction between image sharpness and noise amplification.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If gain information is calculated using Fourier transform for each image capturing condition, then sharpening accuracy is improved, but processing load increases

Engineering Contradiction:
Improvesharpening accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing the sharpening filter in real space before image processing. This eliminates the need for complex Fourier transform calculations during actual image sharpening, reducing processing load while maintaining sharpening accuracy through the pre-prepared filter.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the gain calculation from the frequency domain (Fourier transform) and represents it directly in real space through a sharpening filter. This extraction removes the computationally intensive Fourier transform step while preserving the essential sharpening function, thereby reducing processing load.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11120529B2Image processing apparatus, imaging apparatus, lens apparatus, image processing method, and recording medium
Publication Date: 2021.09.14 CANON KK
  • US11120529B2 patent drawing
  • US11120529B2 patent drawing
  • US11120529B2 patent drawing

AI summary

An image processing apparatus includes a first acquisition unit configured to acquire noise information about a noise characteristic of an input image generated by image capturing using an optical system, a second acquisition unit configured to acquire a sharpening filter in a real space, the sharpening filter being based on an optical characteristic of the optical system, and a third acquisition unit configured to acquire gain information about gain of the sharpening filter using components of the sharpening filter. The image processing apparatus performs sharpening processing on the input image based on the noise information and the gain information.