The invention discloses a multi-
modal cancer survival prediction method based on a potential differentiation variational auto-
encoder, and the method comprises the following steps: carrying out the tissue region segmentation of an input full-view digital slice, extracting the
pathological features, and carrying out the grouping extraction of the grouping features of input
genome data according to the function category; generating compressed
pathological feature potential distribution through an information
bottleneck theory and an attention mechanism; potential distribution of
genome data is learned through global posteriori, specific potential variables are generated through a functional differentiation network, and missing
genome features are reconstructed; integrating
pathology and genome posteriori based on an expert product technology, and introducing alignment loss to constrain consistency of posteriori distribution; and screening survival related features through a co-attention mechanism, and outputting a
survival probability and risk layering result. By adopting the multi-
modal cancer survival prediction method based on the potential differentiation variational auto-
encoder, the problem of calculation redundancy is solved, multi-
modal joint distribution
estimation under
missing data is realized, and the clinical applicability is improved.