The invention discloses a multi-
modal visual fusion complex scene
small target detection tracking method and
system, and relates to the technical field of unmanned aerial vehicle target tracking, and the method comprises the steps: employing a visible light camera, an
infrared thermal imager and a
laser radar sensor which are carried on an unmanned aerial vehicle platform, and synchronously collecting RGB images,
thermal infrared images and
point cloud data; the consistency of the multi-
modal data is ensured through data preprocessing and space-
time alignment; constructing a lightweight double-
branch network to extract multi-scale features, generating a fusion feature map by adopting adaptive weighted fusion, and generating depth information by utilizing
point cloud to assist in
scale estimation; a
small target detection head is designed based on the fusion feature map, and precise detection is realized in combination with a feature
pyramid network, adaptive scale prediction and a
context awareness suppression mechanism; furthermore, through multi-mode cooperative tracking, including target association, spatio-
temporal context modeling, trajectory prediction and a re-detection mechanism, tracking continuity is ensured.