Image Processing Apparatus Extended Depth of Field Infrared
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing methods struggle to achieve a visible light image with an extended depth of field in environments with insufficient reflected light, leading to deteriorated moving image performance and signal-to-noise ratio, while also causing multiple subjects at different distances to be out of focus.
Innovation Solution
An image processing apparatus and method that acquires visible light and infrared image signals focused at different distances, extracts brightness, hue, and saturation information, and generates a visible light image with an extended depth of field using edge information from both signals, allowing for improved focus and image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the aperture of the imaging lens is narrowed to deepen the depth of field, then multiple subjects at different distances can be simultaneously in focus, but the signal-to-noise ratio of images deteriorates in environments with insufficient reflected light
Solution Approach 1:
The patent combines visible light imaging and infrared imaging into a single integrated system. The imaging element captures both visible light images (for depth of field control) and infrared images (for signal enhancement in low-light conditions), merging the advantages of both wavelength ranges to resolve the contradiction between depth of field and signal-to-noise ratio
Solution Approach 2:
The patent changes the wavelength parameter by introducing infrared imaging alongside visible light imaging. By capturing images at different wavelengths (visible and infrared) and processing them together, the system achieves both deep depth of field and high signal-to-noise ratio, as infrared light provides better penetration in low-light environments
2Reliability
If the aperture of the imaging lens is widened to improve the signal-to-noise ratio in low-light environments, then moving image performance is maintained, but the depth of field becomes shallower causing multiple subjects at different distances to be out of focus
Solution Approach 1:
The system merges visible light images (with shallow depth of field when aperture is wide) and infrared images (with different focus characteristics) to produce a composite image that achieves both high signal-to-noise ratio and extended depth of field, resolving the contradiction between aperture size and focus range
Solution Approach 2:
The patent adds the infrared wavelength dimension to the traditional visible light imaging. By processing images from both wavelength ranges together, the system extends the effective depth of field beyond what is achievable with visible light alone, while maintaining wide aperture settings for better light gathering
3Manufacturing precision
If an optical system bringing different distances into focus is used to extend depth of field, then multiple subjects can be in focus, but out-of-focus images from the wrong optical system cause contrast decline and fuzziness
Solution Approach 1:
The patent implements dynamic selection of image data based on focus quality. The processing unit dynamically determines which optical system's image data to use for each subject based on distance and focus characteristics, switching between visible light and infrared image data to maintain high contrast and avoid fuzziness
Solution Approach 2:
The system uses feedback from focus detection to control image processing. By detecting which subjects are in focus and which are out of focus, the processing unit selectively combines or replaces image data from different optical systems to maintain overall image contrast and sharpness across multiple distance planes
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables the acquisition of a visible light image with an extended depth of field, maintaining image quality and focus across varying distances, even in low-light conditions, by compensating for out-of-focus regions with infrared image information.
Implementation Method 1
an imaging element in which are arranged a plurality of photoelectric conversion units having sensitivity with respect to visible light or infrared light
Data Source
AI summary
An image processing apparatus including a first acquisition unit for acquiring a visible-light image signal representing a visible-ray image which comes into focus at a first distance and an infrared image signal representing an infrared-ray image which comes into focus at a second distance that is shorter than the first distance and an infrared-ray image which comes into focus at a third distance that is longer than the first distance; a second acquisition unit for acquiring first brightness information, hue information, and saturation information from the visible-light image signal and at least second brightness information from the infrared image signal; a third acquisition unit for acquiring third brightness information based on edge information obtained from the first brightness information and edge information obtained from the second brightness information; and a generation unit for generating a second visible-light image using the third brightness information, the hue information, and the saturation information.