一种基于脑-机信号融合的目标检测方法

By constructing a brain-computer signal fusion model that integrates multi-head attention mechanism and cross-modal knowledge distillation, and combining EEG and image features, the problem of insufficient accuracy and robustness of target detection in UAV aerial images is solved, achieving high-precision and robust target detection results.

CN116524380BActive Publication Date: 2026-07-17NAT UNIV OF DEFENSE TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
NAT UNIV OF DEFENSE TECH
Filing Date
2023-05-08
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Target detection accuracy and robustness in drone aerial images are low; computer vision methods struggle to effectively identify targets in complex backgrounds; EEG single-modal detection is susceptible to environmental noise interference; and existing combined methods are under-researched in this field.

Method used

A brain-computer signal fusion model based on multi-head attention mechanism and cross-modal knowledge distillation is constructed. Target detection is performed by fusing EEG features and image features. The model utilizes MCGRAM to process the frequency-space-time features of EEG data and EfficientNet to process image data. Combined with a multimodal feature fusion module, it achieves high generalization, strong robustness, and high accuracy in target detection.

Benefits of technology

High-precision and robust target detection was achieved in drone aerial images, improving the automatic target detection performance in the monitoring system and effectively complementing the advantages and disadvantages of computer vision and EEG.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116524380B_ABST
    Figure CN116524380B_ABST
Patent Text Reader

Abstract

本发明公开了一种基于脑‑机信号融合的目标检测方法,包括:构建样本集,样本集包括若干带标签的图像数据与脑电数据,且图像数据与脑电数据一一对应;构建基于多头注意力机制和跨模态知识蒸馏的脑‑机信号融合模型;基于样本集训练脑‑机信号融合模型,得到训练后的脑‑机信号融合模型;将待测的脑电数据和图像数据同时输入训练后的脑‑机信号融合模型,通过对输入的脑电数据和图像数据进行特征提取、特征融合和特征分类,得到目标检测结果。本发明应用于脑‑机接口技术与目标检测技术领域,可充分融合计算机和人脑的信息,提高了目标的检测精度,增强了系统的鲁棒性和泛化能力对于监控系统中的自动目标检测具有重要意义和实用价值。
Need to check novelty before this filing date? Find Prior Art