Unmanned aerial vehicle infrared and visible light image fusion method based on target pre-extraction

Abstract

The invention belongs to the field of image processing and computer vision, and relates to an unmanned aerial vehicle infrared and visible light image fusion method based on target pre-extraction. Themethod comprises the following steps of Registering the infrared image and the visible light image of the unmanned aerial vehicle by adopting a registration algorithm based on image gradient mutual information; Carrying out target pre-extraction on the infrared image and the visible light image after registration by adopting a target pre-extraction algorithm based on frequency spectrum residue; And carrying out image fusion on pre-extracted areas of the infrared image and the visible light image after registration by adopting an area blocking fusion algorithm. According to the method, the problem that the infrared image and the visible light image cannot be fused due to different visual angles or visual fields is effectively solved, the whole image is prevented from participating in the fusion operation, and the algorithm calculation amount is reduced; On the premise that decomposition transformation is not carried out on the image, the target pre-extraction region is uniformly segmented, the mode of calculating the fusion weight of each segmented sub-region based on the significance of the pre-extraction region is more scientific, and the fusion result is more authentic.

Description

technical field [0001] The invention belongs to the fields of image processing and computer vision, and relates to an infrared and visible light image fusion method based on target pre-extraction for fusion of infrared and visible light images in drone aerial video. technical background [0002] In recent years, UAVs, as an emerging combat force, have played an irreplaceable role under the conditions of informationized operations. Vigorously developing UAV equipment technology is of great strategic significance for improving the combat capabilities of troops. With the widespread use of sensors and the increasing enhancement of sensor imaging technology, the use of imaging sensors on drones has made breakthroughs in military and civilian applications for drones. Due to the limitations of environmental conditions such as light and climate, the images taken by single-source sensors will be affected to a certain extent, leading to misjudgment of targets, which can no longer meet...

AI Technical Summary

Problems solved by technology

[0011] The technology of the present invention solves the problem: Based on the characteristics of UAV video images and the defects of the domestic existing technology in the fusion of UAV infrared and visible light images, and considering the performance and adaptability of the algorithm, a UAV based on target pre-extraction is proposed. Infrared and visible light image fusion technology solves many problems of image fusion in UAV video processing system

Images