Image Processing Apparatus Adaptive Correlation for Sharpness and Noise

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques face challenges in improving sharpness without amplifying noise, particularly when using low-frequency recovery and high-frequency suppression filters, as they often degrade image quality due to inaccurate correlation determination caused by noise amplification during sharpness improvement.

Innovation Solution

An image processing apparatus that switches between using pre-recovery and recovered image data for correlation determination based on the frequency characteristics of the recovery filter, ensuring accurate correlation determination and effective noise reduction by employing a sharpness recovery unit, correlation determination unit, noise removal unit, and switching unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sharpness recovery processing is applied to improve image sharpness, then sharpness is improved, but noise is amplified

Engineering Contradiction:
ImprovesharpnessVSAvoidnoise amplification
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies different processing strategies to different regions of the image based on local characteristics. The correlation determination unit evaluates whether each pixel region should undergo noise reduction by comparing it with peripheral pixels, allowing selective noise reduction only in regions where it does not degrade sharpness, thus resolving the contradiction between noise reduction and sharpness preservation

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically changes the processing parameters based on image characteristics. The switching unit selects between different correlation determination modes (using pre-recovery image or recovered image) depending on the recovery characteristics, and the correlation determination unit adjusts the threshold and processing intensity accordingly to balance noise reduction and sharpness preservation

Inventive Principle:
Principle #35Parameter changes

2Object-generated harmful factors

If edge-saving type noise reduction process is applied after sharpness recovery, then noise is reduced, but sharpness may be degraded

Engineering Contradiction:
ImprovenoiseVSAvoidsharpness
Core Design Contradiction:
Object-generated harmful factorsVSMeasurement precision

Solution Approach 1:

The patent performs correlation determination for each pixel to locally assess whether noise reduction should be applied. By comparing target pixels with peripheral pixels and evaluating correlation values, the system selectively applies noise reduction only where appropriate, preserving sharpness in regions where it is critical while reducing noise in suitable areas

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies noise reduction partially rather than uniformly across the entire image. The correlation determination unit identifies specific regions where noise reduction can be applied without degrading sharpness, and the switching unit controls the extent of noise reduction based on recovery characteristics, avoiding excessive smoothing that would degrade image quality

Inventive Principle:
Principle #16Partial or excessive action

3Object-generated harmful factors

If pre-recovery image is used for correlation determination, then noise amplification is reduced, but inaccurate correlation determination occurs due to pre-recovery noise

Engineering Contradiction:
Improvenoise amplificationVSAvoidcorrelation determination accuracy
Core Design Contradiction:
Object-generated harmful factorsVSMeasurement precision

Solution Approach 1:

The patent dynamically switches between using pre-recovery image and recovered image for correlation determination based on the recovery characteristics. The switching unit selects the appropriate image source adaptively, allowing the system to optimize between noise reduction and correlation accuracy depending on the specific processing conditions and filter characteristics

Inventive Principle:
Principle #15Dynamics

4Measurement precision

If recovered image is used for correlation determination, then accurate correlation determination is achieved, but noise amplification occurs

Engineering Contradiction:
Improvecorrelation determination accuracyVSAvoidnoise amplification
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent changes the processing parameters dynamically based on recovery characteristics. The switching unit selects between different correlation determination modes (pre-recovery image mode or recovered image mode) depending on the sharpness recovery filter characteristics, allowing optimal parameter selection to balance correlation accuracy and noise control

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10699385B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2020.06.30 CANON KK
  • US10699385B2 patent drawing
  • US10699385B2 patent drawing
  • US10699385B2 patent drawing

AI summary

Disclosed is an image processing apparatus including: a sharpness recovery unit configured to recover sharpness of an input image; a correlation determination unit configured to determine a correlation between a target pixel and peripheral pixels of the input image; a noise removal unit configured to perform smoothing of the target pixel determined as having a correlation with the peripheral pixels in a recovered image output from the sharpness recovery unit; and a switching unit configured to switch between a mode in which the correlation determination unit uses the target pixel and the peripheral pixels of the pre-recovery input image in the correlation determination and a mode in which the correlation determination unit uses the target pixel and the peripheral pixels of the recovered input image in the correlation determination, depending on recovery characteristics used in the determination of the correlation determination unit.