The application discloses a kind of multi-
modal gastric
cancer risk prediction method and
system based on gate attention mechanism, it is related to gastric
cancer risk prediction technical field, including, to
abdominal CT image, gastric organ recognition result and health text information preprocessing, fusion
standardization CT image and gastric organ recognition result, construct organ priori enhancement image.To organ priori enhancement image and health text information extract image feature and text feature, respectively calculate self-attention and cross-attention, according to self-attention entropy and cross-attention
peak value generation image and the gate fusion coefficient of text, the weighted fusion of the output of two kinds of attention obtains gate fusion feature, and then calculates self-attention and cross-attention and is added in equal proportion to obtain fusion feature, and the risk of target sample suffering from gastric
cancer is classified and output.The application makes image feature and text feature complement each other, improves the accuracy and stability of gastric
cancer risk prediction, is suitable for health management auxiliary, and is not used as
clinical diagnosis basis.