The invention discloses an
intestinal polyp identification method based on images and multi-
modal data. The method comprises the following steps: acquiring
pathological images of a plurality of microscopes, objective
magnification information corresponding to the
pathological images, and text information corresponding to enteroscopes; performing data preprocessing on each frame of acquired
pathological image and text information to obtain a training
data set; a multi-scale multi-
modal feature classification network is constructed, the training
data set is used for training, and a trained multi-scale multi-
modal feature fusion classification network is obtained; the method comprises the following steps: collecting a
microscope pathological image of a patient, obtaining corresponding
enteroscope text information, respectively carrying out data preprocessing, and inputting into a multi-scale multi-modal
feature fusion classification network to obtain
disease category prediction of a model. According to the method, pathological images and
enteroscope text information are fully fused, accurate classification and prediction of
disease types are finally achieved, the effect and efficiency of multi-modal diagnosis of intestinal diseases are improved, and therefore the accuracy of
patient diagnosis is improved.