The invention discloses a tumor
immunotherapy curative effect prediction method and
system based on multi-
modal data, and the method comprises the steps: firstly, obtaining the multi-source tumor data of a patient, including
pathological image data, medical image data,
genome and molecular data, and clinical and demographic indexes; secondly,
processing the multi-source tumor data to form a unified
data set; thirdly, aiming at different
modal data, adopting a corresponding
feature extraction sub-network to extract each
modal depth feature; then, a cross-modal attention mechanism is adopted to realize feature dynamic weighting and deep fusion, and unified multi-modal fusion representation is obtained; then, constructing a prediction model, and outputting an
immunotherapy benefited
population classification identification result, RECIST
curative effect multi-classification prediction and survival prediction; and finally, generating a visual result and a feature contribution degree
ranking of a prediction basis, and forming a clinical auxiliary decision report. According to the method, the prediction accuracy and stability can be remarkably improved, and meanwhile, the method has result
interpretability and clinical application value.