The invention discloses a
prostate PSMA PET / CT and enhanced MR multi-
modal image registration and fusion method based on
deep learning. The method comprises the following steps: preprocessing acquired PSMA PET / CT and enhanced MRI data; a multi-scale multi-stage registration network comprising the semantic gating
convolution module and a U-CLSTM module is constructed: the SGC module enhances global
perception ability through a V channel, the U-CLSTM module reinforces local feature attention by using a U channel, deformation field iterative optimization is performed in combination with a
pyramid structure, and a multi-scale multi-stage registration network comprising the semantic gating
convolution module and the U-CLSTM module is constructed; and finally, generating a high-precision registration image through Y channel weighted fusion. According to the method,
global information self-adaption and local feature enhancement are combined, the registration precision of a gland anatomical structure and a tumor focus is synchronously improved through a multi-scale
pyramid structure, PSMAPT / CT functional
metabolism information and MRI anatomical structure information are effectively integrated, the generated three-dimensional
fusion image can visually display the spatial position, morphological features and invasion range of a tumor, and the accuracy of the three-dimensional
fusion image is improved. A multi-
modal image basis with high space consistency is provided for
clinical diagnosis, and the diagnosis accuracy of the
prostate cancer is remarkably improved.