An Image Fusion System Based on Low Light and Infrared Sensors

Abstract

The invention relates to an image fusion system based on low-light and infrared sensors, which is divided into low-light and infrared sensor information collection modules, FPGA core processing modules, DSP co-processing modules and output display modules; external low-light and infrared sensors collect The video image is input into the device through the interface; the video image is input for image preprocessing: including image denoising, image enhancement and image registration. Image denoising and image enhancement processing require low latency and are implemented in the FPGA chip. , the image registration algorithm requires a large amount of calculation and is implemented in the DSP chip; the pre-processed video images are fused through the FPGA chip, including grayscale fusion and pseudo-color fusion; the FPGA control logic can select one channel of image output through the interface : Single low-light video, single infrared video, grayscale fusion video and pseudo-color fusion video. The invention realizes a high-precision, low-latency and good scalability image fusion system, which has important practical significance for nighttime observation and exploration applications.

Description

technical field [0001] The invention relates to an image fusion system based on low-light and infrared sensors, which is suitable for observation and detection of outdoor scenes by a sighting system at night, and belongs to the technical field of digital image processing. Background technique [0002] Different image sensors can receive spectral signals of different bands, and the response to the spectrum far exceeds the ability of the human eye, so richer image information can be obtained. In practical applications, people often need to combine the information provided by different sensors for analysis and processing. In view of the consideration of portability, the information of multiple sensors in more application scenarios needs to be displayed through a display device; image fusion technology is a kind of Multi-source images obtained by various sensors are refined and integrated into one image to obtain a more accurate and comprehensive description of the same scene. ...

AI Technical Summary

Problems solved by technology

[0005] Patent (publication number) CN107045208A proposes a method of optical fusion, the system delay is low, but there are problems that the information of a single sensor cannot be viewed and the collected images cannot be saved; while the full digital fusion method can solve the problem of optical fusion However, due to the limitations of hardware and the performance of the sensor, the actual source images often cannot be directly fused by the fusion algorithm to achieve effective image fusion, and need to be fused after preprocessing such as image correction, enhancement, and registration.

[0006] The patent (publication number) CN107203987A proposes an all-digital fusion system, and proposes a system solution using a multi-core heterogeneous processor AM572x plus a multi-core heterogeneous processor DSP. Image preprocessing is performed by the camera's image processor (ISP) chip Realized, but the scalability is relatively poor

Images