Image Restoration Filter Generation for Aperture-Dependent OTF Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing image restoration processing methods require large volumes of data and computation due to the variation of optical transfer functions (OTFs) with aperture value, object distance, and focal length, leading to increased costs and processing times in image pickup apparatuses.

Innovation Solution

An image pickup apparatus and method that store and generate image restoration filters based on optical transfer functions, which are specific to image pickup conditions and positions, allowing for efficient data reduction and computation optimization by switching between different OTFs and filters depending on aperture values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image restoration processing is performed using detailed OTF data for all image pickup conditions, then image restoration accuracy is improved, but data volume and computation time increase significantly

Engineering Contradiction:
Improveimage restoration accuracyVSAvoiddata volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments the image restoration process into two distinct paths based on aperture value: (1) for small aperture values, use pre-calculated detailed OTF data from storage; (2) for large aperture values, generate OTF data on-demand using a diffraction phenomenon calculation function. This segmentation reduces overall data volume while maintaining restoration accuracy for both cases.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary calculation and storage of OTF data only for small aperture values where diffraction effects are minimal. For large aperture values, the system prepares a calculation function that can generate OTF data when needed, avoiding the need to store massive amounts of pre-calculated data for all possible conditions.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If image restoration processing is performed using detailed OTF data for all image pickup conditions, then image restoration accuracy is improved, but processing time increases

Engineering Contradiction:
Improveimage restoration accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the image restoration process into two distinct paths based on aperture value: (1) for small aperture values, use pre-calculated detailed OTF data from storage; (2) for large aperture values, generate OTF data on-demand using a diffraction phenomenon calculation function. This segmentation reduces overall data volume while maintaining restoration accuracy for both cases.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary calculation and storage of OTF data only for small aperture values where diffraction effects are minimal. For large aperture values, the system prepares a calculation function that can generate OTF data when needed, avoiding the need to store massive amounts of pre-calculated data for all possible conditions.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If comprehensive OTF data is stored for all image pickup conditions, then restoration quality is improved, but device cost increases

Engineering Contradiction:
Improverestoration qualityVSAvoiddevice cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image restoration process into two distinct paths based on aperture value: (1) for small aperture values, use pre-calculated detailed OTF data from storage; (2) for large aperture values, generate OTF data on-demand using a diffraction phenomenon calculation function. This segmentation reduces overall data volume while maintaining restoration accuracy for both cases.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the need for storing comprehensive OTF data for all aperture values with a mathematical calculation function based on diffraction phenomenon theory. This substitution reduces storage requirements and device complexity while maintaining the ability to generate accurate OTF data when needed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The approach enables highly accurate image restoration processing with reduced data and computation volumes, improving processing speed and cost-effectiveness in image pickup apparatuses.

Implementation Method 1

an image pickup element to photoelectrically convert an object image formed via an image pickup optical system to obtain an original image

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 2

These adverse effects include various types of aberrations, such as spherical aberration, coma aberration, curvature of field, and astigmatism, and light diffraction

Methodology Applied
Scientific EffectLight diffraction: Diffraction

Data Source

PatentUS9674431B2Image pickup apparatus, image processing apparatus, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2017.06.06 CANON KK
  • US9674431B2 patent drawing
  • US9674431B2 patent drawing
  • US9674431B2 patent drawing

AI summary

An image pickup apparatus includes an image pickup element which obtains an original image, a storage unit which stores a first optical transfer function different depending on an image pickup condition and on a position in the original image and an image restoration filter or a function designed to generate a second optical transfer function, a data obtaining unit which obtains the first optical transfer function when the aperture value is less than a predetermined value, and the image restoration filter or the second optical transfer function generated based on the function designed to generate the second optical transfer function when the aperture value is not less than the predetermined value, a filter generating unit which generates an image restoration filter based on the first or second optical transfer function, and an image processing unit which generates the restored image by using the image restoration filter.