The application provides a traffic target detection and recognition method based on sound-vibration time-frequency characteristics and cross-attention
fusion mechanism. First, sound-vibration signals of different traffic targets are collected by a sound-
vibration sensor, and normalized least
mean square (NLMS)
noise filtering preprocessing is performed. Second, the preprocessed sound-vibration signals are subjected to
variational mode decomposition (VMD), and scale spectrum segmentation method and summation
fuzzy entropy minimum value method are adopted to decompose the sound-vibration signals into multiple intrinsic mode functions (IMFs). Third, Mel spectrograms are extracted from the sound
signal IMFs, and
wavelet transform time-frequency diagrams are extracted from the vibration
signal IMFs, and the results are subjected to CNN
convolution pooling, and
transformer encoder is further used to extract sound-vibration
signal characteristics of different traffic targets. Finally, cross-attention mechanism is used for coding, sound signal characteristics and vibration signal characteristics are fused into new characteristics, and
Softmax function and Dropout function are used for normalization and
overfitting prevention. The application has the advantages of low
algorithm complexity, strong real-time performance and low cost, and solves the traffic target detection problem under
extreme climate, weather, light and other scenes.