The invention provides an
infrared and visible light image end-to-end registration method based on phase consistency enhancement, and belongs to the technical field of electric
digital data processing. The invention discloses an
infrared and visible light image end-to-end registration method based on phase consistency enhancement, which comprises the following steps of: firstly, preprocessing
infrared and visible
light source images in an
image database, and dividing the infrared and visible
light source images into a
training set and a
test set; and constructing a feature extractor based on a phase consistency attention
mask, realizing cross-
modal consistency
feature extraction, and focusing an important space region by using phase information. A self-defined ResSobeNet network is adopted for parameter
estimation, and
Haar wavelet transform is used for replacing
pooling operation, so that
information loss in a traditional down-sampling method is avoided. A double-
branch generator structure is designed, affine parameters and an
optical flow field are generated respectively, meanwhile, constraint on rigid registration and non-rigid registration is achieved, and finally a registration result is obtained through
resampling of a space conversion module. According to the method, the problems that cross-
modal consistent features are difficult to extract in the infrared and visible light
image registration process and explicit registration steps are complicated and difficult to generalize are solved, and the method has good universality and practicability.