The invention discloses a post-
stroke cognitive impairment prediction method based on multi-
modal feature fusion. The method comprises the steps that firstly, multi-
modal information of a
stroke patient is collected, wherein the multi-
modal information comprises a three-dimensional
brain MRI image, an EEG electroencephalogram
signal and clinical
medical record information; secondly, converting MRI into a
tensor, and inputting the
tensor into a multi-scale spatial-temporal
feature extraction backbone network to obtain MRI modal features; the EEG electroencephalogram signals are subjected to electroneurographic signals and are combined with Transform, and EEG modal features are obtained; the clinical
medical record information of the
stroke patient is converted into semantic sentences, the semantic sentences are input into a two-channel semantic
encoder for encoding extraction, and clinical
medical record information features are obtained. And finally, inputting the MRI modal features, the EEG modal features and the clinical medical
record information features into a three-modal fusion device to obtain fusion features, and outputting probability prediction through a classifier. The post-stroke
cognitive impairment prediction method achieves accurate prediction of post-stroke
cognitive impairment, and significantly improves robustness and medical interpretation.