The invention belongs to the technical field of medical image intelligent diagnosis, and provides a
breast cancer focus benign and malignant discrimination method based on a gated multi-expert mechanism. The method comprises the following steps: firstly, carrying out
standardization and semantic preprocessing on a
mammary gland X-
ray image, a BI-RADS
imaging report and structured clinical data, embedding age,
mammary gland density and focus position information into a text template in a
natural language form, and realizing unified expression of multi-
modal input; secondly, extracting image features by utilizing a ResNet network and a simplified CLIP model, obtaining a text
semantic vector by adopting a Bio-ClinicalBERT model, and establishing two sub-paths of a lump expert and a
calcification expert in a Transform structure; further, an expert weight is dynamically generated through a gating routing mechanism, and soft routing fusion is executed; and finally, outputting benign and malignant results of the
breast cancer focus by the
binary classification module. According to the method, deep fusion and dynamic
collaboration of the
mammary gland X-
ray image, the BI-RADS text and the
clinical information are realized, and the accuracy and
interpretability of
breast cancer discrimination can be remarkably improved.