The present application relates to the technical field of medical
image analysis and computational
pathology, and proposes a
cancer survival prediction method based on a visual
language model. The method first acquires a
pathological whole field slice image of a
cancer patient, detects the tissue area of the slice and divides it into
multiple image blocks, and extracts visual features of the image blocks through a pre-trained visual
encoder. Then, a
metastasis diagnosis model is used to predict the image blocks, generate
metastasis pseudo-labels and uncertainty information at the image
block level, and obtain
metastasis priors. On this basis, an adaptive hierarchical prompting mechanism is constructed, including slice-level survival semantic prompts and image block-level metastasis semantic prompts, and corresponding text semantic features are generated through a visual
language model text
encoder. Subsequently, the image block visual features, metastasis
prior information and text semantic features are combined to generate slice-level representation features through a concept-guided
feature aggregation module. Finally, the slice-level representation is optimized using an uncertainty
perception calibration strategy, and the survival risk prediction result of the
cancer patient is output according to the calibrated features. The present application can effectively utilize the multi-scale
tissue morphology information and metastasis-related
semantic information in the
pathological whole field slice under the condition of few samples, realize the automatic prediction of cancer survival risk, and can be applied to a computer-aided
pathological diagnosis and prognosis
evaluation system.