Dual-spectrum camera system and image processing method based on single sensor

Abstract

The invention provides a dual-spectrum camera system based on a single sensor and an image processing method, and relates to the technical field of image acquisition and processing. The camera system includes a lens, an image sensor, a logical light splitting module and an image fusion module connected in sequence; the image sensor includes RGB photosensitive unit and IR photosensitive unit, the RGB photosensitive unit is provided with an infrared cut-off filter layer on the optical path; the image sensor receives the incident light to generate an original image and sends it to the logic light splitting module; the logic light splitting module converts the original image into visible light images and infrared images, and send them to the image fusion module to generate a fused image. The purpose of the embodiments of the present invention is to provide a dual-spectrum camera system and image processing method based on a single sensor, so that the optical structure of the dual-spectrum camera system is simpler, which is beneficial to the smaller size and lower cost of the camera equipment, and improves the image quality. Effect.

Description

Technical field[0001]The present invention relates to the technical field of image acquisition and processing, in particular to a dual-spectrum camera system based on a single sensor and an image processing method.Background technique[0002]Traditional color cameras only collect and use information in the visible light band. In low-light, haze and other scenes, as the intensity of visible light decreases or scene information is blocked, the color image effect will be severely degraded; and in these scenes, through Appropriate exposure control can get a clear, high-signal-to-noise ratio infrared image; but on the other hand, infrared images have only grayscale information and no color information. The dual-spectrum camera is a camera device that can collect and process images in the visible and infrared light bands. By simultaneously collecting visible and infrared images, and then using image fusion technology to be compatible with the advantages of the above two images, an enhanced ...

AI Technical Summary

Problems solved by technology

For this type of solution, the hardware configuration cost of dual-lens and dual-sensor is high, and the problem of stereoscopic parallax cannot be avoided between the two lenses, which brings technical difficulties to the registration and fusion between visible light and infrared images.

An improvement based on the dual-lens solution is to use a single-lens dual-sensor solution. By adding a beam splitting mechanism inside the camera, visible light and infrared light are separated and imaged on two sensors respectively; this solution can avoid the problem of stereo parallax, but The hardware configuration of the spectroscopic system and dual sensors increases the size and cost of the camera

[0004] In addition, for application scenarios such as low illumination and fog penetration, conventional image fusion methods usually directly weight the brightness component of visible light images and infrared images, and the resulting color fusion images are difficult to avoid due to inconsistent grayscale features of infrared images and visible light images. The brightness and color distortion caused by

In general, the existing dual-spectrum camera system still has complex optical structure, large volume, high cost, and color cast and color cast due to the inconsistency of the grayscale features of the infrared image and the visible light image during the image fusion process. The problem of brightness distortion

Images