The invention discloses the technical field of
pathology and space transcriptomics, and particularly relates to a
gene expression prediction method and
system based on multi-
modal comparative learning and a guidance mechanism.
Cutting the histological slice image into image blocks according to space coordinates; according to the method, a local
convolution branch and a global Transform
branch are combined to extract image features, the image features are mapped to a shared
potential space through projection, soft contrast, hard contrast and
global consistency constraints are introduced into the space, and cross-
modal alignment of an image
modal and a
gene expression modal is realized; an expression prediction head is introduced in the training stage, representation learning is directly guided by a regression
signal, and the relation between
feature learning and
gene expression prediction is broken through; in the
inference stage, k-nearest neighbor retrieval and a multi-distance weighted aggregation strategy are combined to infer a
gene expression profile of an unknown position. According to the method, the accuracy and robustness of space
gene expression prediction can be effectively improved, the
tissue space heterogeneity structure is kept, and the method has high clinical application and scientific research and popularization value.