The invention discloses a multi-
modal fusion unmanned aerial vehicle
remote sensing image target detection method and
system, aims to improve the target detection precision under a low illumination condition and reduce the calculation overhead, and is particularly suitable for unmanned aerial vehicle
remote sensing image processing. The method comprises the following main steps: S1, carrying out denoising,
standardization and
size adjustment on an input
remote sensing image, ensuring
image quality and consistency, and stabilizing subsequent
processing steps; and S2, based on a Retinex principle, enhancing the low-illumination image through a double-
branch network, and improving details and contrast of the image. And S3, carrying out feature interaction fusion on the enhanced
RGB image and the
infrared image by adopting a Transform model based on a self-attention mechanism, capturing complementary information of different
modes, and generating fusion features for target detection. And S4, target regression and classification are carried out by adopting a multi-scale detection head based on FPN and PAN structures, and the detection precision of targets of different sizes is enhanced. Through multi-
modal feature fusion, adaptive anchor frame generation and multi-scale detection, the target detection precision in low-illumination and complex environments is effectively improved, the calculation overhead is low, and the method is suitable for target detection tasks of real-time unmanned aerial vehicle remote sensing images. Experimental results show that the method is excellent in performance on VisDrone and LLVIP data sets, and the target detection precision is remarkably improved especially under the low illumination condition.