The invention discloses a whole
tissue segmentation method based on multi-
modal large model guidance, and the method comprises the steps: constructing a whole
tissue segmentation label data set covering a path from
skin to an internal endangered organ, carrying out the preliminary segmentation of a whole tissue
structure based on a general segmentation model, and carrying out the segmentation of a whole tissue structure through an image self-adaption prompt box and a human-computer interaction mechanism. Guiding the model to complete iterative
annotation and correction of an organization structure, and constructing standardized full-organization
label data on the basis of the iterative
annotation and correction; the multi-
modal contrast learning model is finely adjusted, the to-be-segmented image is used as an image
modal, the standardized organization template text is used as a language modal, and modeling training of a vision-
semantic consistency relationship is carried out for subsequent significance guidance; a full-
tissue segmentation model based on language
image guidance and memory storage is constructed, a medical general segmentation model is used for
fine tuning, a space adapter and a memory storage learner are designed for
spatial relation learning, a multi-modal contrast learning model after
fine tuning is used for generating a saliency
heat map, and the saliency
heat map is obtained. And full-tissue organ detection and fine classification segmentation based on text information guidance and
spatial relationship learning are realized. Compared with an existing method, the method has the advantages that the problems that organ boundaries are broken, semantic tags are inconsistent, category matching depends on manual definition and the like are effectively relieved, the clinical availability is enhanced while the segmentation precision is improved, and high-quality whole tissue segmentation support is provided for tasks such as particle implantation path planning and the like.