The invention relates to the field of fault
diagnosis methods, in particular to a fault diagnosis method based on multi-
modal deep learning, and the method comprises the specific steps: S1, carrying out the
processing of an original vibration
signal of a bearing through
continuous wavelet transform, and converting the original vibration
signal into a time-frequency image; s2, constructing a multi-scale Mamba
network model, and capturing a long-term dependency relationship in the
time sequence data; s3, constructing a high-efficiency
network model for extracting time-frequency features; s4, introducing a cross attention mechanism, and dynamically splicing the two
modal features; and S5, verifying by using an MEF-Net model, and comparing the performance of the MEF-Net model with other reference models, thereby solving the problems that the integrity, accuracy and reliability of data are influenced due to the introduction of
noise in the
data acquisition process at the present stage, and the accuracy, accuracy and reliability of the data are influenced due to the inaccuracy, gradient disappearance,
overfitting and the like of the data. Therefore, the problems of poor model
training effect and low accuracy are solved.