The invention relates to the technical field of
deep learning, in particular to a PET-CT multi-
modal image fusion method and
system based on
deep learning, and the method comprises the following steps: obtaining PET and CT images, carrying out the normalization and registration, fusing a tumor
signal distribution map and an edge response map, generating a focus displacement map, adjusting the
image boundary, calculating the similarity, and generating a boundary guide fusion map. Image
pyramid decomposition and consistency correction are carried out, pixel-by-pixel difference is carried out, an over-threshold residual error region is reconstructed, and a reconstructed image is output. According to the method, the
image alignment precision is improved through normalization and registration, a
signal distribution diagram and an edge response diagram are fused to enhance tumor features, a focus evolution displacement diagram is generated to refine tumor tracking, a fusion diagram structure is adjusted based on similarity, a boundary is corrected,
noise is eliminated, pixel-by-pixel difference and regression reconstruction errors are achieved, and high-quality reconstruction is ensured. And the
image structure consistency, the boundary definition and the
feature extraction precision are optimized.