The invention discloses a multi-source heterogeneous medical data fusion and intelligent diagnosis method, and relates to the technical field of medical
data processing and intelligent diagnosis, and the method comprises the specific steps: firstly, synchronously collecting medical images and clinical text data of a patient, and carrying out the correlation and integration to form a heterogeneous diagnosis
data set; performing standardized
feature extraction to obtain a
feature set in a unified format; then constructing a parallel model, fusing features by using a cross-
modal attention alignment technology, and guiding correction by means of a
knowledge graph; and finally, the cross-
modal diagnosis features are input into the
reference model,
automatic focus positioning is realized through
processing, and a
visual marker graph is output. Heterogeneous data of medical images and clinical texts are synchronously integrated, and the diagnosis feature reliability is improved through
standardization processing,
feature fusion and the like; a focus sensing
mask is generated through comparison with a normal model, a multi-scale
feature fusion technology is combined to realize automatic and accurate positioning of the focus, a large amount of
labeled data is not needed, the process is simplified, and the diagnosis efficiency and accuracy are improved.