Single-Sensor Image Fusion With Independent RGB and IR Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing technologies in low illumination scenarios suffer from decreased signal-to-noise ratio and image quality deterioration due to parallax issues in dual sensor fusion and difficulty in separating RGB and IR components, leading to blurry fused images.
Innovation Solution
An image obtaining method that adjusts visible light exposure parameters and infrared illuminator intensity independently based on luminance differences to capture and fuse visible light and infrared images, improving signal-to-noise ratio and detail quality without blur.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If dual sensor fusion is used to capture visible light and infrared images, then image quality in low illumination scenarios is improved, but parallax occurs and calibration complexity increases
Solution Approach 1:
The patent merges the visible light and infrared image capture functions into a single sensor device. The image sensor is configured to capture both visible light images and infrared images simultaneously, eliminating the need for separate sensors and their associated calibration procedures. This combining approach maintains the dual-spectrum imaging capability while removing the parallax and calibration complexity issues inherent in dual sensor systems.
2Loss of information
If optical splitting is performed to separate RGB and IR components, then component separation is achieved, but complete separation is difficult and fused images become blurry
Solution Approach 1:
The patent segments the image data processing at the data level rather than attempting optical separation. After capturing the combined visible light and infrared image data through a single sensor, the processor separately processes the visible light component and infrared component from the captured data. This segmentation approach achieves complete component separation without the optical interference and blurriness that plague optical splitting methods.
Solution Approach 2:
The patent introduces digital signal processing as an intermediary between capture and final image output. The processor acts as a mediator that receives the combined sensor data, separates the visible light and infrared components through digital processing, and then fuses them. This intermediary processing step enables complete separation and precise control of each component, avoiding the optical limitations of physical splitting methods.
3Productivity
If independent adjustment of visible light exposure and infrared illuminator is implemented, then adjustment efficiency is improved and image quality is enhanced, but control complexity increases
Solution Approach 1:
The patent implements dynamic, independent control of the visible light exposure parameters and infrared illuminator intensity. The system can adjust the exposure time, gain, and other visible light parameters separately from the infrared illuminator intensity, allowing each to be optimized for its specific requirements. This dynamic independent adjustment enables efficient optimization of both components without being constrained by fixed ratios or coupled control mechanisms.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method enhances image quality by achieving a better signal-to-noise ratio and clearer details in low illumination conditions, simplifying the fusion algorithm and reducing complexity.
Implementation Method 1
obtaining first original image data, where the first original image data is captured by using an image sensor
Implementation Method 2
luminous intensity of an infrared illuminator
Data Source
Figure 1
Figure 2a~2b
Figure 3a~3b
AI summary
This application provides an image obtaining method and apparatus. The image obtaining method according to this application includes: obtaining first original image data, where the first original image data is captured by using an image sensor based on an initial visible light exposure parameter and luminous intensity of an infrared illuminator; obtaining luminance of a visible light image based on the first original image data; adjusting the visible light exposure parameter based on a first difference, where the first difference is a difference between the luminance of the visible light image and preset target luminance of the visible light image; obtaining luminance of an infrared image based on the first original image data; adjusting the luminous intensity of the infrared illuminator based on a second difference, where the second difference is a difference between the luminance of the infrared image and preset target luminance of the infrared image; obtaining second original image data, where the second original image data is captured by using the image sensor based on an adjusted visible light exposure parameter and an adjusted luminous intensity of the infrared illuminator; and fusing, based on the second original image data, to obtain a target image. This application improves adjustment efficiency and obtains a target image with a better signal-to-noise ratio and better details.