Disclosed in the present invention is a local
feature matching system based on keypoint detection. The
system comprises: an
encoder, a deep
Transformer model and a matching module. An
image pair to be matched (IA, IB) is input into the
encoder, and fine features (formula I), coarse features (formula II), keypoints PA and PB of the
image pair (IA, IB) are extracted; the coarse features (formula II) and the
image pair (IA, IB) are input into the deep
Transformer model, and the deep
Transformer model performs
feature aggregation on an image IA and an image IB to obtain keypoint features (formula III); and the matching module converts the keypoint features (formula III) into a confidence matrix C, performs matching between the keypoint PA and the keypoint PB on the basis of the confidence matrix C, and then performs matching enhancement on the basis of the fine features (formula I), so as to complete the matching of the image pair (IA, IB). A weight (parameter) reuse technique is used to share task parameters between consecutive Transformer
layers on the basis of task requirements, such that a model can maintain a feature expression capability, improving the model performance, and can also effectively reduce the model size. In addition, the use of a multi-scale keypoint
detector reduces the propagation of redundant information and enhances feature specificity, thereby improving the model efficiency.