The invention provides a multi-
modal weak supervision medical
image segmentation method, and belongs to the field of medical
image segmentation, and the method comprises the steps: carrying out the
feature extraction of CT and
MR images, and obtaining CT and MR
modal feature representations; fusing same-layer features represented by CT and MR
modal features under each scale; performing down-sampling and multi-layer
convolution processing on the fusion feature representation; respectively decoding the enhanced feature representation, the CT modal feature representation and the MR modal feature representation to obtain a multi-modal prediction map, a CT prediction map and an MR prediction map, calculating
cross entropy loss, respectively calculating multi-view CRF loss of the CT image and the MR image, obtaining intra-modal regular loss, calculating inter-modal consistency loss, adding the
cross entropy, the intra-modal regular loss and the inter-modal consistency loss, and when the total loss is minimum, determining that the total loss is minimum. Obtaining a trained
image segmentation model; inputting CT and
MR images to be segmented into the trained image segmentation model, and outputting segmented images; the invention also provides an image
segmentation system. And multi-modal image information is effectively fused and over-fitting is inhibited under a weak supervision condition.