Infrared image and visible light image fusion method, system, device and terminal

Abstract

The invention belongs to the technical field of image fusion, and discloses an infrared image and visible light image fusion method, system, device and terminal, and the infrared image and visible light image fusion method comprises the steps: obtaining an infrared image and a visible light image; carrying out registration and graying processing on the obtained infrared image and visible light image to obtain a registered grayed infrared image and visible light image; performing edge extraction on the visible light image by using a Canny operator to obtain edge information and texture information of the visible light image; fusing the grayed infrared image and the visible light image by using a deep learning algorithm to obtain a preliminary fusion result; and superposing the edge information and the texture information of the visible light image and the fusion image to obtain a final fusion result. According to the method, the shallow layer features and the deep layer features of the infrared image and the visible light image can be effectively extracted, and detail enhancement is carried out on the fused image, so that the fused image with good quality can be obtained in any scene.

Description

technical field [0001] The invention belongs to the technical field of image fusion, and in particular relates to a fusion method, system, device and terminal of an infrared image and a visible light image. Background technique [0002] In recent years, with the popularization and development of various sensors, the ability of relevant personnel to collect information on the same scene has been rapidly improved. However, each type of sensor has its own advantages and disadvantages due to its own physical characteristics. The images captured by ordinary cameras are rich in color and contain a lot of detail information and texture information, but the image quality is easily disturbed by the external environment. When the image quality is greatly reduced in strong light, dark, rainy and snowy weather environments. The image captured by the infrared camera has a prominent target and is not easily affected by the external environment, but the resolution of the infrared image is ...

AI Technical Summary

Problems solved by technology

[0013] Aiming at the problems existing in the prior art, the present invention provides a fusion method, system, device and terminal of an infrared image and a visible light image, and particularly relates to a fusion method, system, device and terminal of an infrared image and a visible light image based on a deep neural network , which aims to solve the technical problems in the existing infrared image and visible light image fusion methods, such as the unnatural brightness of the fusion image and the lack of detailed texture information.

Images