The invention discloses a multi-
modal enhanced representation collaborative learning pneumonia image recognition method, which comprises the following steps of: aiming at
chest radiograph image data, respectively extracting visual
modal features and text
modal features, and generating rich feature representation fused with context
semantics through a multi-modal
feature coding strategy; a collaborative learning mechanism is adopted, complementarity of visual and text features is combined, the model is guided to carry out feature optimization and decision reasoning, and robustness and
interpretability of the model are improved; in the classification reasoning stage, multi-modal auxiliary information is utilized to refine
pathological region features, and fine-grained differences are effectively captured; and through an auxiliary information constraint mechanism, the recognition capability of the model on a tiny
pathological mode is enhanced, and the pneumonia classification accuracy and generalization capability are improved. The method can be widely applied to
computer vision tasks in the fields of medical image auxiliary diagnosis,
disease detection and the like.