Real-time visible light image and infrared image multi-channel fusion method and device

Abstract

The invention discloses a real-time visible light image and infrared image multi-channel fusion method and device, and the method comprises the steps: decomposing a visible light matrix corresponding to a visible light image to obtain a visible light low-frequency matrix and a visible light high-frequency matrix, and decomposing an infrared matrix corresponding to an infrared image to obtain a visible light low-frequency matrix and a visible light high-frequency matrix; obtaining an infrared low-frequency matrix and an infrared high-frequency matrix; according to the visible light low-frequency weight and the infrared low-frequency weight, fusing the visible light low-frequency matrix and the infrared low-frequency matrix to obtain a low-frequency fusion matrix, and according to the visible light high-frequency weight and the infrared high-frequency weight, fusing the visible light high-frequency matrix and the infrared high-frequency matrix to obtain a high-frequency fusion matrix; and fusing the low-frequency fusion matrix and the high-frequency fusion matrix based on a preset fusion mode to generate a fusion matrix corresponding to the visible light image and the infrared image. Visibly, the visible light image and the infrared image can be fused by implementing the method, so that the resolution of the main body content and the background area in the image is improved, and meanwhile, the meticulous degree of the image texture is improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a real-time visible light image and infrared image multi-channel fusion method and device. Background technique [0002] In the field of image analysis, visible light images have a large amount of information and high pixel intensity, which can provide more intuitive details for computer vision tasks, but the image quality of visible light images is easily affected by the data collection environment (such as lighting and weather conditions), As a result, the difference between the main content (such as people) that needs to be highlighted in the visible light image and the background area is not clear enough; while the infrared image generated based on infrared thermal imaging technology can significantly distinguish the main content in the infrared image from the thermal radiation difference on the surface of the object. However, since the infrared image is usually a gr...

AI Technical Summary

Problems solved by technology

[0002] In the field of image analysis, visible light images have a large amount of information and high pixel intensity, which can provide more intuitive details for computer vision tasks, but the image quality of visible light images is easily affected by the data collection environment (such as lighting and weather conditions). As a result, the difference between the main content (such as people) that needs to be highlighted and the background area in the visible light image is not clear enough; while the infrared image generated based on infrared thermal imaging technology can significantly distinguish the main content and the background area in the infrared image according to the difference in thermal radiation on the surface of the object The background area, but because the infrared image is usually a grayscale image that is difficult for the human eye to distinguish, and the contrast of the infrared image is low and the image is blurred, the image texture of the infrared image is not detailed enough

Images