Point Image Restoration for Spherical Aberration Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing devices struggle to restore image quality degraded by spherical aberration, particularly high spherical aberration near the outer edge of the pupil, leading to increased costs due to the need for expensive imaging optical systems.

Innovation Solution

An image processing device that performs point image restoration processing using a restoration filter based on the point spread function of the imaging optical system, with a determination unit that decides whether to apply restoration processing based on the modulation transfer function in specific spatial frequencies, reducing data and operational costs by only processing when necessary.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If point image restoration processing is performed using a restoration filter based on point spread function, then image quality degraded by spherical aberration can be restored, but the device complexity and computational cost increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent pre-calculates and stores restoration filters for multiple F numbers before actual image processing. When an image is captured, the system simply selects the pre-computed filter corresponding to the current F number, avoiding the need to perform complex restoration filter calculations in real-time. This preliminary preparation significantly reduces the computational burden during actual image restoration while maintaining the ability to correct spherical aberration effectively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent dynamically selects different restoration filters based on the actual F number used during image capture. Instead of using a single fixed restoration filter, the system adapts by choosing from multiple pre-computed filters that correspond to different F numbers. This dynamic selection ensures optimal restoration performance for each specific imaging condition while avoiding the complexity of real-time filter adaptation.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If restoration processing is applied to all captured images, then all degraded images can be improved, but data processing time and operational costs increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent incorporates a determination unit that evaluates each captured image to decide whether restoration processing is actually needed. The unit assesses factors such as the presence of significant spherical aberration and the potential benefit of restoration. Only images that meet certain criteria undergo restoration processing, while others are processed directly. This feedback-based selection mechanism avoids unnecessary restoration operations, reducing processing time and operational costs while maintaining image quality for images that truly need restoration.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If expensive imaging optical systems are used to reduce spherical aberration, then image quality improves, but system cost increases

Engineering Contradiction:
Improveimage qualityVSAvoidsystem cost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent replaces the need for expensive mechanical/optical solutions (high-precision imaging optical systems designed to minimize spherical aberration) with a computational approach. Instead of relying on complex optical design and expensive lenses, the system uses software-based restoration filters that mathematically correct spherical aberration effects. This substitution of mechanical/optical complexity with computational processing achieves similar image quality improvement at lower system cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a computational model (restoration filter) that replicates the effect of perfect optical performance. Rather than building expensive optical systems that physically prevent spherical aberration, the system captures images with simpler optics and then applies restoration filters that copy or recreate the appearance of images that would have been captured by a perfect optical system. This allows achieving high image quality without the need for expensive optical hardware.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10699387B2Point image restoration device and method
Publication Date: 2020.06.30 FUJIFILM CORP
  • US10699387B2 patent drawing
  • US10699387B2 patent drawing
  • US10699387B2 patent drawing

AI summary

Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having the lens unit including a lens and the imaging element, and a determination unit that determines to perform the point image restoration processing using the point image restoration processing unit in a case where a modulation transfer function in a predetermined spatial frequency in which the point image restoration processing contributes is smaller than a threshold value. Here, the modulation transfer function is changed by an imaging condition. The point image restoration processing unit performs the point image restoration processing only in a case where the determination unit determines to perform the point image restoration processing.