The invention relates to the technical field of
image fusion, and discloses a sparse aperture optical
system polarization
image fusion method based on
deep learning, and the method comprises the steps: obtaining a
linear polarization degree image, a polarization angle image, and a polarization intensity image through a sparse aperture optical
system, and constructing a polarization
image fusion model comprising an
encoder, a multi-mode fusion module, and a decoder; the
encoder comprises two branches for respectively extracting three polarization image features, the multi-
modal fusion module comprises an edge gradient compensation module for extracting multi-stage edge features, a polarization attention mechanism for adaptively weighting fusion features and a residual aggregation module for reserving original features, and the decoder uses multi-core
deconvolution to decode aggregation features; and constructing a
loss function and training a model in combination with the characteristics of the polarization images, and inputting the three polarization images to be fused into the trained model to obtain a polarization
fusion image. According to the invention, effective fusion of
polarization imaging and sparse aperture imaging can be realized,
noise can be effectively suppressed, and the contrast and resolution of imaging can be improved.