Restoration Filter Generation Device for Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing devices face challenges in preventing overcorrection of the modulation transfer function (MTF) values for RGB images during the point-image restoration process on luminance system images, leading to potential adverse effects on image quality.

Innovation Solution

A restoration filter generation device that acquires and processes modulation transfer functions (MTFs) for each color, selecting the maximum MTF value to generate a restoration filter that suppresses MTF values to 1.0 or less in a specific spatial frequency range, thereby preventing overcorrection and ensuring accurate image restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If point-image restoration process is performed on luminance system image using synthesized PSF, then image degradation is reduced, but overcorrection occurs for particular wavelengths causing MTF values to exceed 1.0

Engineering Contradiction:
Improveimage restoration accuracyVSAvoidMTF value control
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent changes the approach from using synthesized PSF to using measured MTF values for each color channel. By directly measuring the optical transfer function for R, G, and B channels and using these measurements to create restoration filters, the system achieves accurate restoration without overcorrection, as the measured MTF values inherently represent the actual optical characteristics without requiring synthesis assumptions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical synthesis process of creating PSF from multiple color channels with a direct measurement approach. Instead of mechanically combining R, G, B PSFs to create a luminance PSF, the system directly measures the MTF for each channel and uses these measurements to generate restoration filters, eliminating the overcorrection problem inherent in synthesis methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If separate restoration filters are created for each color channel, then accurate color-specific restoration is achieved, but computational load increases significantly

Engineering Contradiction:
Improvecolor-specific restoration accuracyVSAvoidcomputation load
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges the restoration process by creating a single restoration filter from the measured MTF values of all color channels, rather than maintaining separate restoration filters for each channel. This consolidation reduces computational complexity while still achieving accurate color-specific restoration, as the measured MTF values for each channel are incorporated into the unified filter design.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If restoration filter is designed to maximize MTF recovery, then image sharpness is improved, but noise amplification occurs

Engineering Contradiction:
Improveimage sharpnessVSAvoidnoise amplification
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent incorporates feedback mechanisms by using the measured MTF values to inform the restoration filter design. The measured optical transfer function provides feedback about the actual system characteristics, allowing the restoration filter to be tailored to the specific optical properties. This feedback approach enables the filter to recover image sharpness accurately while avoiding excessive amplification that would occur with generic or over-aggressive restoration methods.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10083500B2Restoration filter generation device and method, image processing device and method, imaging device, and non-transitory computer-readable medium
Publication Date: 2018.09.25 FUJIFILM CORP
  • US10083500B2 patent drawing
  • US10083500B2 patent drawing
  • US10083500B2 patent drawing

AI summary

A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.