Bi-spectral Camera Sensor with Panchromatic Pixels
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional bi-spectral visible-near-infrared cameras are bulky, costly, and power-intensive due to the use of two independent sensors and a beam splitter, limiting their application in on-board systems and requiring specialized optics, while existing solutions for simultaneous acquisition of visible and near-infrared images using a single sensor suffer from reduced sensitivity and image quality.
Innovation Solution
A camera system utilizing a matrix sensor with a combination of colored and panchromatic pixels, where panchromatic pixels are numerous and scattered, and innovative digital processing reconstructs high-quality visible and near-infrared images by interpolating signals from both types of pixels, allowing for the use of commercial off-the-shelf components and achieving high sensitivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If two independent matrix sensors and a beam splitter are used to acquire visible and near-infrared images, then image quality and sensitivity are improved, but device size, cost, power consumption, and weight increase
Solution Approach 1:
The patent combines two separate matrix sensors (visible and near-infrared) into a single integrated sensor array. Each pixel can detect both visible and near-infrared light, eliminating the need for separate sensors and a beam splitter. This merging approach maintains high image quality while significantly reducing device size, cost, power consumption, and weight.
Solution Approach 2:
The sensor array is designed with universal pixels that can perform multiple functions - detecting both visible light and near-infrared radiation. This multi-functionality allows a single sensor to replace two specialized sensors, achieving the same measurement precision with reduced system complexity.
2Device complexity
If a single matrix sensor with color filters is used to reduce device size, then device complexity is reduced, but sensitivity and image quality deteriorate
Solution Approach 1:
The sensor array is segmented into different pixel types: some pixels are optimized for visible light detection with color filters, while others are panchromatic pixels optimized for near-infrared detection. This segmentation allows each pixel type to maintain high sensitivity for its designated wavelength range while the overall system achieves compact design.
Solution Approach 2:
Different regions of the sensor array have different qualities - visible-sensitive pixels in some locations and near-infrared-sensitive panchromatic pixels in others. This local differentiation ensures that each pixel contributes optimally to its spectral range, maintaining high sensitivity while enabling single-sensor operation.
3Measurement precision
If panchromatic pixels are added to the sensor array to improve sensitivity, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent merges panchromatic pixels with color-filtered pixels into a single integrated sensor array. The panchromatic pixels are distributed throughout the array and work together with the color-filtered pixels to provide both visible and near-infrared detection capabilities. This integration improves sensitivity without requiring separate sensor systems.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves high sensitivity and quality in simultaneous acquisition of visible and near-infrared images, reducing bulk, cost, and power consumption, while enabling the use of commercial optics and improving image fidelity.
Implementation Method 1
each pixel being adapted to generate an electrical signal representative of the light intensity at a point in an optical image
Data Source
Figure 1A~1B
Figure 2
Figure 3A~3B
AI summary
System for simultaneous acquisition of colour and near-infrared images comprising a single matrix sensor comprising a first, second and third type of pixels sensitive to respective visible colours and a fourth type of pixel, panchromatic, these pixels also being sensitive in the near-infrared; and a circuit for processing signals configured to: reconstruct a first set of monochromatic images on the basis of signals generated by the pixels of the first, second and third type, respectively; reconstruct a panchromatic image on the basis of signals generated by the pixels of the fourth type; reconstruct a second set of monochromatic images on the basis of signals generated by the pixels of the first, second and third type, and of said panchromatic image; reconstruct a colour image on the basis of the images of the first set and of the panchromatic image, and reconstruct at least one near-infrared image on the basis of the images of the second set and of the panchromatic image. Visible - near-infrared bi-spectral camera comprising such an acquisition system and method implemented by means of such a camera.