基于非线性特征提取的路侧端雷达与摄像头融合的三维目标检测方法、设备、介质

By introducing Kolmogorov-Arnold networks (KANs) to improve image and point cloud encoders, and combining multi-head cross-attention and KAN kernel convolution, the nonlinear feature fusion capability of roadside multimodal 3D perception is enhanced, solving the problems of insufficient robustness and generalization ability in existing technologies, and realizing high-precision detection in complex traffic scenarios.

CN121074864BActive Publication Date: 2026-07-17SOUTHEAST UNIV +1

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SOUTHEAST UNIV
Filing Date
2025-08-11
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies lack effective nonlinear feature fusion mechanisms in roadside multimodal 3D perception, resulting in insufficient robustness and generalization ability, especially limiting detection accuracy in complex traffic scenarios.

Method used

Kolmogorov-Arnold Networks (KANs) are used to improve image and point cloud encoders. Cross-modal weights are dynamically calculated through multi-head cross-attention, and nonlinear fusion is performed using KAN kernel convolution, thereby improving the feature extraction and fusion capabilities of high-dimensional data.

Benefits of technology

It significantly improves the 3D detection accuracy in complex traffic scenarios, enhances the ability to perform high-dimensional nonlinear modeling of image texture semantics and point cloud geometric features, optimizes cross-modal fusion strategies, and eliminates fusion degradation phenomena.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121074864B_ABST
    Figure CN121074864B_ABST
Patent Text Reader

Abstract

本发明涉及一种基于非线性特征提取的路侧端雷达与摄像头融合的三维目标检测方法、设备、介质,其中三维目标检测方法包括:同步完成图像与点云的数据增强与降采样;利用柯尔莫哥洛夫‑阿诺德网络改进的编码器提取高维非线性特征并投影至统一鸟瞰空间;以多头交叉注意力建立跨模态依赖;用非线性卷积按权重融合生成一体化鸟瞰特征图;经解码器与检测头输出目标三维坐标、尺寸及类别。与现有技术相比,本发明引入柯尔莫哥洛夫‑阿诺德网络对图像和点云编码器进行非线性增强,并在鸟瞰空间内通过多头交叉注意力动态计算跨模态权重,最后利用KANs卷积完成加权融合,从而在保证感受野一致的同时显著提升复杂交通场景下的三维检测精度。
Need to check novelty before this filing date? Find Prior Art