Infrared visible light image registration method and system based on robust matching and transformation

Abstract

The invention provides an infrared visible light image registration method and a system based on robust matching and transformation, comprising the steps of extracting a feature description subset ofinfrared and visible light images to be registered by using a robust feature point detection algorithm and a feature descriptor, and establishing an initial matching; the parameters of affine transformation model between images to be matched are estimated robustly according to the matching relation of feature points. The infrared images are transformed by interpolation method and the registrationis completed. The invention takes into account the modal difference and scale difference of infrared and visible light images, In the process of feature matching, the stability of the neighborhood structure of the feature points is used to filter out the mismatch, and the parameters of the transform model are estimated by using the parameter estimation based on the uniform space constraint, whichis robust to the image feature extraction of different modes and the feature matching affected by the strong noise.

Description

Technical field [0001] The present invention relates to the technical field of image registration. Specifically, the present invention relates to an infrared-visible light image registration technical scheme based on PIIFD (partial intensity invariant feature descriptor) and robust transformation estimation. Background technique [0002] Image registration is an important technology in the field of image processing, which is to match two or more images acquired at different times, different sensors (imaging equipment) or under different imaging conditions (weather, illuminance, camera position and angle, etc.) , The process of superposition. The key to image registration is to find the transformation relationship in the space domain between two or more images, so that the coordinates of the corresponding points on the images on different images are unified. [0003] In the past few decades, scholars have studied many methods to solve the problem of image registration. From the pe...

AI Technical Summary

Problems solved by technology

[0008] The registration of infrared and visible light images belongs to multi-modal image registration, and its feature extraction is difficult. While the traditional feature extraction methods fail, PIIFD also has great limitations.

Moreover, due to the complexity of the feature extraction stage, the feature matching stage has the characteristics of a high proportion of outliers and a low number of correct matches.

Images