Method for real-time fusion of infrared image and visible image

Abstract

The invention relates to a method for real-time fusion of an infrared image and a visible image. The method is characterized in that straw hat conversion is used for fusing the infrared image to be fused and the visible image to be fused so that a first fusion result image can be obtained; trigger comparison operation is used for fusing the infrared image to be fused and the visual image to be fused so that a second fusion result image can be obtained; the first fusion result image and the second fusion result image serve as original data, secondary image fusion is conducted through a pixel averaging method, and therefore a final fusion result image is obtained.

Description

technical field [0001] The invention relates to a real-time fusion method of an infrared image and a visible light image. Background technique [0002] Visible light images contain rich detailed texture information and spectral information of the captured scene, but they cannot reflect objects that are occluded by smoke or hidden in low light conditions, especially people or objects that are deliberately camouflaged. Infrared imaging sensors have a strong ability to penetrate smoke and dust, can work day and night, and can capture objects with thermal radiation. However, infrared imagers are only sensitive to temperature distribution and cannot obtain rich texture information and spectral information of the shooting scene. Based on the complementary characteristics of the two sensors, the visible light image and the infrared image are fused to obtain a more comprehensive image describing the scene, which contains both the information in the visible light image and the inform...

AI Technical Summary

Problems solved by technology

Fusion effect refers to whether the complementary information of the two can be effectively fused together. For example, if the fusion effect is not good at a fire scene, the target will be missed, and eventually the lives of others will be threatened. In the field of military reconnaissance, if the fusion effect is not good, Objects with low thermal radiation or small targets will not be detected, and the consequences will be disastrous

Real-time fusion refers to whether it can meet the needs in practical applications. In times of crisis, time is life. In practical applications, it is usually necessary to synthesize the fused images into video, and finally realize video fusion. If the fusion takes a long time, it cannot Satisfy the actual needs, thus losing the use value

Therefore, the fusion result must meet these two conditions at the same time. However, classic fusion methods such as wavelet transform and lifting wavelet transform can meet the real-time requirements, but the fusion effect is not good. The image based on filter bank developed in recent years Fusion such as curvelet transform, contourlet transform, etc. meet the requirements of the fusion effect but take a long time

Images