The invention provides an intelligent
disease identification and classification method and
system based on multi-
modal data fusion, and the method comprises the steps: S1, collecting multi-
modal data of a medical image, a physiological
signal and
genome data, and carrying out the preprocessing of the multi-
modal data; s2, extracting multi-scale features from the medical image through a
convolutional neural network, extracting
time sequence features from the physiological
signal by using a bidirectional LSTM network, and extracting
gene association features from the
genome data based on a graph neural network; s3, fusing the three modal features by using a self-attention mechanism, dynamically adjusting the weight, and generating a global feature; and S4, inputting the global features into a classification network, and completing
disease classification based on a
cross entropy loss function. The
system comprises a data preprocessing module, a multi-modal
feature extraction module, a fusion module and a classification module, multi-modal deep fusion, self-attention
weight distribution and
modular design are provided, and the accuracy, robustness and clinical adaptability of
disease classification can be improved.