Image Sharpening Using Virtual Optical Information Outside Image Circle

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image sharpening methods fail to correct blurs outside the image circle of an imaging optical system, as they rely on optical information that is not defined for areas outside this circle, leading to incomplete image processing and unnatural sharpening results.

Innovation Solution

An image processing apparatus and method that acquire and utilize first optical information outside the image circle, generated based on second optical information within the circle, to perform sharpening processing, using unsharp mask processing and PSF-based filters, even when the image circle does not encompass the entire image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the image circle of the imaging optical system is designed to be small to reduce optical system size, then the imaging system can be made compact, but the image circle cannot encompass the entire image sensor, causing no optical information to reach areas outside the image circle

Engineering Contradiction:
Improveoptical system sizeVSAvoidoptical information outside image circle
Core Design Contradiction:
Volume of moving objectVSLoss of information

Solution Approach 1:

The patent creates a virtual copy of optical information by generating first optical information outside the image circle based on second optical information within the image circle. This copying approach allows the system to reconstruct optical characteristics in areas where no actual optical information reaches, enabling sharpening processing across the entire image sensor without requiring a larger image circle

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary processing step where optical information is generated through calculation and interpolation. The image processing apparatus acts as an intermediary that synthesizes optical information for areas outside the image circle by using optical information from areas within the image circle, thereby bridging the gap between limited optical coverage and full sensor utilization

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If existing sharpening methods are applied outside the image circle, then sharpening processing can be attempted, but the methods fail because no optical information (PSF, OTF) is available outside the image circle

Engineering Contradiction:
Improvesharpening processing coverageVSAvoidsharpening accuracy without optical information
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary action by pre-generating first optical information outside the image circle based on second optical information within the image circle before sharpening processing is applied. This advance preparation ensures that optical information is available for all areas where sharpening will be performed, including regions outside the image circle where no direct optical information reaches

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter state of optical information by transforming it from a state of non-existence outside the image circle to a usable state through mathematical generation. By calculating first optical information from second optical information, the system transforms the parameter availability from zero to positive values, enabling reliable sharpening processing across the entire image sensor

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11599973B2Image processing apparatus, lens apparatus, and image processing method for sharpening processing
Publication Date: 2023.03.07 CANON KK
  • US11599973B2 patent drawing
  • US11599973B2 patent drawing
  • US11599973B2 patent drawing

AI summary

An image processing apparatus includes an information acquisition unit configured to acquire first optical information outside an image circle of an imaging optical system, and a processing unit configured to perform sharpening processing, based on the first optical information, for an input image generated by imaging using the imaging optical system. The first optical information is optical information generated based on second optical information within the image circle of the imaging optical system.