Multi-sensor joint detection and display method based on unmanned aerial vehicle platform

Abstract

The invention discloses a multi-sensor joint detection and display method based on an unmanned aerial vehicle platform, which is achieved by using a binocular camera module, an infrared thermal imagermodule, an information fusion processing module and an augmented reality presentation module. The binocular visible light camera module and the infrared thermal imager module are both mounted on theunmanned aerial vehicle platform; the binocular camera module comprises two monocular camera modules arranged on the left side and the right side respectively, the binocular camera module is used forsensing visible light information of the environment, and the infrared thermal imager module is used for sensing infrared information of the environment. Fusion processing, including calibration, correction, registration and target recognition, of perception information of the binocular camera module and the infrared thermal imager module is completed through the information comprehensive processing module, and fusion display of the perception information is completed through the augmented reality fusion display module. The method can more effectively detect and locate the target, has great advantages for target detection in a complex environment, and can be widely applied to disaster area search and rescue, military reconnaissance and the like.

Description

technical field [0001] The invention relates to the fields of visual imaging, thermal imaging, multi-source information fusion, and augmented reality, and in particular to a multi-sensor joint detection and display method based on an unmanned aerial vehicle platform. Background technique [0002] Unmanned aerial vehicles have played an increasingly important role in both military and civilian applications. With the development of the performance of UAVs, carrying multiple sensors to realize multi-source detection has gradually become a new application direction with broad potential. [0003] For sensors that meet the detection capabilities in complex environments, considering factors such as volume, weight, and energy consumption, the payloads that are more suitable for drones are mainly visible light cameras, infrared thermal imaging, and lidar. Visible light cameras capture visible light spectrum information, which is the closest to human visual information, and visible l...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the detection problem of unmanned aerial vehicles in complex environments, especially the detection of living bodies, the present invention proposes a multi-sensor joint detection and display method based on the unmanned aerial vehicle platform, which uses a binocular camera module, an infrared thermal imager module, Information fusion processing module, augmented reality presentation module, etc., in which binocular visible light camera module (abbreviated as binocular camera module) and infrared thermal imager module (abbreviated as infrared thermal imager) are mounted on the UAV platform. The eye camera module includes two monocular camera modules placed on the left and right sides respectively. The binocular camera module is used to sense the visible light information of the environment, and the infrared thermal imager module is used to sense the infrared information of the environment. The fusion processing of the sensory information of the eye camera module and the infrared thermal imager module, including calibration, correction, registration, target recognition, etc., uses the augmented reality fusion display module to complete the fusion display of the sensory information

Images