Image Processing Unit Correcting Diffraction Blur via Spatial High Frequency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging apparatuses cannot avoid diffraction blur that has already been caused with the aperture open, limiting the resolution of downsized image sensors.
Innovation Solution
An image processing apparatus that receives image data of the same object formed by light of different wavelengths and adds spatial high frequency components from one image data to another, where the second image data is generated using light receiving elements at intervals shorter than the smallest area that the first wavelength can converge, to enhance resolution beyond the diffraction limit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the lens is stopped down to increase depth of field, then depth of field is improved, but diffraction blur increases and resolution deteriorates
Solution Approach 1:
The invention segments the imaging process into multiple wavelength channels. By capturing images at different wavelengths (e.g., blue, green, red) separately and then combining them, the system can use the shorter wavelength images (which have less diffraction blur) to correct the longer wavelength images, thereby maintaining resolution while achieving the desired depth of field through computational synthesis
Solution Approach 2:
The invention uses shorter wavelength light as an intermediary to correct the diffraction blur in longer wavelength images. The high-frequency spatial information from the shorter wavelength images (which are less affected by diffraction) serves as a mediator to restore and enhance the resolution of the longer wavelength images that have greater diffraction blur
2Manufacturing precision
If the aperture is kept open to avoid diffraction blur, then resolution is improved, but depth of field deteriorates
Solution Approach 1:
The imaging process is segmented into multiple wavelength captures. The system takes images at different wavelengths with the aperture open (maintaining resolution) and then computationally combines them to achieve the depth of field effect, separating the resolution capture from the depth of field synthesis
Solution Approach 2:
The invention dynamically adjusts the synthesis process based on the captured multi-wavelength images. By adaptively combining the high-resolution open-aperture images with depth of field requirements through computational methods, the system achieves both resolution and depth of field control
3Productivity
If image sensor pixels are reduced in size to increase pixel count, then productivity is improved, but resolution deteriorates due to diffraction limit
Solution Approach 1:
The invention adds a wavelength dimension to the imaging process. Instead of relying solely on increasing pixel density in the spatial domain, the system captures and processes images across multiple wavelength dimensions, using the shorter wavelength data to provide high-frequency information that enhances resolution beyond what the pixel density alone could achieve
Solution Approach 2:
The shorter wavelength light acts as an intermediary that provides high-frequency spatial information. This information mediates the resolution limitation imposed by the pixel size and diffraction, allowing the system to achieve higher effective resolution than would be possible with the reduced-size pixels alone
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach effectively enhances the resolution of image data corresponding to light of a long wavelength without requiring new optical materials or devices, maintaining spatial color continuity and reducing false colors in color images.
Implementation Method 1
incident light is diffracted and thus causes diffraction blur, which leads to a problem, wherein making each pixel of the image sensor smaller than the size of the diffraction blur does not enhance resolution (diffraction limit)
Data Source
AI summary
An image processing apparatus (30) generating an image with high resolution over a diffraction limit includes an image input unit (101) receiving red image data and green image data, which represent images of an object by red light and green light, respectively, and receiving a blue image data representing an image of the object by blue light having a wavelength shorter than the red and the green light. Further, the image processing apparatus (30) includes an image processing unit (103) correcting the red and the green image data by adding thereon a spatial high frequency component contained in the blue image data, such that the image input unit (101) receives, as the blue image data, image data generated by light receiving elements provided at intervals shorter than a size of a smallest area that the red and the green light can converge.