The application belongs to the technical field of medical
image fusion, and discloses a
network model and method for
glioma SPECT-
MRI image fusion. The
network model is referred to as DEFSD, which promotes
image fusion by decomposing exclusive features and saliency masks. Specifically, first, the source SPECT image in the RGB space is converted into the
YCbCr space, then the SPECT image and the
MRI image in the Y channel are input into the DEFSD, the DEFSD combines the attribute vector and the object feature map, respectively reconstructs the two source images, and determines the exclusive features of the source images, meanwhile, the features of the highlighted regions are utilized by using the saliency
mask; then the image output by the trained DEFSD is converted into the RGB space together with the SPECT images in the Cb and Cr channels, and finally, the output
fusion image is obtained. The training is carried out on the medical image
data set disclosed by Harvard
Medical School, and the experimental results show that the DEFSD can produce a
fusion image containing a large amount of information unique to each modality, and has obvious groove features in the
lesion area, which is beneficial to early diagnosis of
glioma.