This invention belongs to the field of medical
image processing, and specifically relates to a
system and method for predicting the
pathological differentiation degree of
liver cancer by fusing multi-sequence
magnetic resonance imaging and
semantic information. The
system includes steps such as acquiring multi-sequence
lesion region images, generating structured diagnostic text,
feature extraction and fusion, and predicting the
pathological differentiation degree of
liver cancer based on the fused features. By converting professional medical features conforming to the diagnostic standards of the liver
imaging report and
data system contained in the multi-sequence
lesion region images into structured diagnostic text information, and using the
lesion region images and structured diagnostic text as input, a bidirectional cross-
modal attention mechanism is employed to align and complement visual features in the images that are difficult to quantify with
semantic information in the text. This creates a synergistic effect between image and text information, enabling the model to capture deep
pathological correlations that cannot be effectively expressed by a
single image modality. This invention improves the accuracy and reliability of prediction, providing a more precise basis for
clinical decision-making.