The invention provides a brand new
programmed death ligand 1 (PD-L1) level and
immunotherapy response prediction
algorithm based on the application of a
deep learning technology in medical images in combination with methods of multi-
modal feature fusion, a self-attention mechanism, adversarial learning and the like. The
algorithm comprises the following steps of data preprocessing,
encoder feature extraction,
radiomics feature extraction, multi-
modal feature fusion, PD-L1 level prediction and
immunotherapy response prediction. According to the invention, the
pathological image (Hamp; according to the method, a CT image (e.g., E
staining section), a CT image and clinical data are integrated into a
deep learning model for predicting the PD-L1 level of an
esophageal squamous cell carcinoma (ESCC) patient. In addition, by extracting PD-L1 features of an
immunotherapy patient, a model for predicting immunotherapy response is constructed. By fusing multi-
modal data, auc of the model in a PD-L1 prediction task is equal to 0.835, auc of the model in an immunotherapy reaction task is equal to 0.806, a new thought and method are provided for related research in the field of tumor treatment, and beneficial reference is provided for
clinical treatment.