The invention provides a registration and fusion dual-drive misaligned
infrared and visible light
image fusion method, which comprises the following steps of: firstly, extracting multi-scale common features which are irrelevant to
modes and have higher discrimination through a multi-scale
feature extraction module based on comparative learning; then, similarity is calculated according to inter-
modal multi-scale common features, a dense deformation field is generated, and a registration image is obtained; thirdly, inputting the registered image and the corresponding fixed image into a
feature extraction module to obtain image features, and performing
feature fusion through a designed collaborative attention fusion module; the fusion module combines window attention, gradient channel attention and feedback characteristics of
image fusion on registration, and realizes fine alignment of the characteristics and redundant characteristic suppression of
dislocation; and finally, generating a final
fusion image from the fusion features through a feature reconstruction module. In conclusion, collaborative optimization of registration and fusion is achieved, and artifacts generated in the fusion process of the unregistered
infrared and visible light images are effectively reduced.