The invention provides a multi-
modal MRI classification method and
system, and relates to the technical field of medical
image processing, and the method comprises the steps: obtaining a structural
magnetic resonance imaging sMRI image and a
functional magnetic resonance imaging fMRI image of a testee; inputting the two images into an attention guidance dynamic classification neural network, predicting a
label of the testee, and obtaining a
classification result; according to the attention guidance dynamic classification neural network, two groups of features are extracted from the sMRI image and the fMRI image, the two groups of features are fused by using a multi-scale attention sub-network, and classification is carried out based on the fused features. According to the invention, an attention guidance dynamic classification neural network is designed, different brain networks are constructed for testees, cross-
modal inclusiveness integration and cross-
modal consensus filtering operation are combined,
feature extraction is realized in a shallow layer aspect,
feature selection and feature classification are further carried out through a multi-scale attention sub-network, and the accuracy of feature classification is improved. Therefore, the detection and diagnosis precision of brain diseases can be improved.