Dual-spectrum camera system based on single sensor and image processing method

Abstract

The present invention provides a dual-spectrum camera system based on single sensor and an image processing method, and relates to the technical field of image collection. The system comprises a lens,an image sensor and a logic beam split module and an image fusion module which are connected in order; the image sensor comprises a RGB light-sensitive unit and an IR light-sensitive unit, a light-inpath of the RGB light-sensitive unit is provided with an infrared cut-off filtering layer; the image sensor receives incident light to generate original images and send the original images to the logic beam split module; and the logic beam split module performs conversion of the original images to divide the original image into a visible image and an infrared image and send the visible image andthe infrared image to the image fusion image to generate a fused image. The objective of the invention is to provide a dual-spectrum camera system based on single sensor and an image processing methodto allow the optical construction of the dual-spectrum camera system to be simpler so as to facilitate the more miniaturized size of the camera device and reduction of the cost and improve the imageeffect.

Description

technical field [0001] The invention relates to the technical field of image acquisition and processing, in particular to a dual-spectrum camera system and image processing method based on a single sensor. Background technique [0002] Traditional color cameras only collect and use information in the visible light band. In low-light, foggy days and other scenarios, as the intensity of visible light decreases or scene information is blocked, the color image effect will be seriously degraded; and in these scenarios, through Proper exposure control can get clear infrared images with high signal-to-noise ratio; but on the other hand, infrared images only have grayscale information and no color information. A dual-spectrum camera is a camera device that can collect and process images in the visible and infrared bands. By collecting visible light images and infrared images at the same time, and then using image fusion technology to be compatible with the advantages of the above tw...

AI Technical Summary

Problems solved by technology

For this type of solution, the hardware configuration cost of dual-lens and dual-sensor is high, and the problem of stereoscopic parallax cannot be avoided between the two lenses, which brings technical difficulties to the registration and fusion between visible light and infrared images.

An improvement based on the dual-lens solution is to use a single-lens dual-sensor solution. By adding a beam splitting mechanism inside the camera, visible light and infrared light are separated and imaged on two sensors respectively; this solution can avoid the problem of stereo parallax, but The hardware configuration of the spectroscopic system and dual sensors increases the size and cost of the camera

[0004] In addition, for application scenarios such as low illumination and fog penetration, conventional image fusion methods usually directly weight the brightness component of visible light images and infrared images, and the resulting color fusion images are difficult to avoid due to inconsistent grayscale features of infrared images and visible light images. The brightness and color distortion caused by

In general, the existing dual-spectrum camera system still has complex optical structure, large volume, high cost, and color cast and color cast due to the inconsistency of the grayscale features of the infrared image and the visible light image during the image fusion process. The problem of brightness distortion

Images