Single Sensor Image Fusion via Near-Infrared Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image fusion methods, such as those using binocular cameras, face challenges with complex structures and high costs, and often result in images with misaligned viewpoints due to different camera perspectives, leading to reduced image quality.
Innovation Solution
An apparatus and method for image fusion that uses a single image sensor with a light compensator and filter assembly to generate and fuse images through controlled near-infrared light compensation during different exposures, allowing for the acquisition of visible and near-infrared images with aligned viewpoints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If binocular cameras are used to acquire images at different visible light intensities, then image acquisition capability is improved, but device complexity and cost increase
Solution Approach 1:
The single image sensor is designed to perform multiple functions by capturing both visible light images and near-infrared images through different exposure settings. The same sensor unit acquires images under different lighting conditions (high visible light intensity and low visible light intensity), eliminating the need for separate camera systems and reducing overall device complexity while maintaining adaptability.
Solution Approach 2:
The patent combines the functions of multiple camera systems into a single image sensor setup. By merging the visible light capture and near-infrared capture capabilities into one sensor with controlled exposure periods and light compensation, the system achieves the same functionality as binocular cameras but with simplified structure and reduced cost.
2Adaptability or versatility
If binocular cameras are used to acquire images at different visible light intensities, then image acquisition capability is improved, but cost increases
Solution Approach 1:
A single image sensor is designed to perform multiple functions by capturing both visible light images and near-infrared images through different exposure settings. The same sensor unit acquires images under different lighting conditions (high visible light intensity and low visible light intensity), eliminating the need for separate camera systems and reducing overall device complexity while maintaining adaptability.
Solution Approach 2:
The patent uses a single image sensor to create multiple image signals (first image signal and second image signal) representing different lighting conditions. Instead of using multiple physical cameras, the system creates copies of the imaging function through software-controlled exposure and light compensation, significantly reducing hardware costs.
3Adaptability or versatility
If different cameras are used to capture images, then various lighting conditions are covered, but viewpoint alignment deteriorates
Solution Approach 1:
The patent combines the functions of multiple camera systems into a single image sensor setup. By merging the visible light capture and near-infrared capture capabilities into one sensor with controlled exposure periods and light compensation, the system achieves the same functionality as binocular cameras but with simplified structure and reduced cost.
Solution Approach 2:
The imaging process is segmented into different exposure periods (first exposure period for visible light, second exposure period for near-infrared) within a single sensor system. This temporal segmentation allows the same sensor to capture different types of light at different times, maintaining consistent viewpoint while covering various lighting conditions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach simplifies the structure, reduces costs, and enhances image quality by aligning viewpoints, enabling efficient acquisition and fusion of images with different brightness information while maintaining the same perspective.
Implementation Method 1
the light filter assembly includes a first light filter, wherein the first light filter allows visible light and part of near-infrared light to pass through
Implementation Method 2
the first light compensation apparatus is configured to perform near-infrared light compensation, wherein the near-infrared light compensation is performed in at least part of the exposure period of the first preset exposure
Data Source
AI summary
Provided is an apparatus for image fusion, including: an image sensor, a light compensator, a light filter assembly, and an image processing unit, the image sensor being on a light output side of the light filter assembly; wherein the image sensor is configured to generate and output a first image signal and a second image signal through a plurality of exposures; the light compensator comprises a first light compensation apparatus configured to perform near-infrared light compensation; the light filter assembly comprises a first light filter; and the image processing unit is configured to acquire a fused image by processing the first image signal and the second image signal.