End-to-end image template matching method based on twin network

An image template and matching method technology, applied in the field of image processing, to achieve the effect of improving robustness, improving performance, and solving the problem of scale difference

Inactive Publication Date: 2021-11-26
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problems existing in the existing template matching method, the present invention proposes an end-to-end image template matching method based on Siamese network, which treats the template matching task as a classification and regression problem, and can better solve the problem of template and reference The problem of scale differences between images can effectively improve the robustness of template matching in complex situations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • End-to-end image template matching method based on twin network
  • End-to-end image template matching method based on twin network
  • End-to-end image template matching method based on twin network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0051] An end-to-end template matching method based on a Siamese network, comprising the following steps:

[0052] S1 design template matching network

[0053] The template matching network is composed of a feature extraction network, a feature fusion network, and a template localization network in sequence. The network takes the template-reference image pair as input, and the output is the predicted classification map and regression map. figure 1 It is a schematic diagram of the specific structure of the entire network.

[0054] S1.1 Build a feature extraction network to extract feature maps of input templates and reference images

[0055] S1.2 Build a feature fusion network to fuse the extracted input template and the feature map of the reference image. The structure of the channel attention module used in this implementation example is as ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of image processing, and particularly relates to an end-to-end image template matching method based on a twin network. The method takes a template matching task as a classification regression problem to be processed and can better solve the problem of scale difference between a template and a reference image, and the robustness of template matching under a complex condition is effectively improved. The method has the following beneficial effects of 1, processing a template matching task as a classification regression task so as to better solve the problem of scale difference, and effectively improve the robustness of template matching under the complex condition; 2, combining a deep cross-correlation operation with a channel attention mechanism, providing a new cross-correlation operation for feature fusion so as to effectively improve the accuracy of template positioning; and 3, in the design of a loss function, using a DIOU for replacing a common IoU to construct the regression loss so as to enable the training process to be stable, accelerate the convergence, and meanwhile further improve the template matching performance.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to an end-to-end image template matching method based on a Siamese Network. Background technique [0002] Template matching is to locate a given template image in a reference image through similarity measurement. It is a basic technology in image processing and computer vision, and is widely used in the fields of target recognition, medical image processing, and remote sensing. Due to different shooting times, angles, and imaging devices, there are often grayscale differences (even heterogeneous sources), scale differences, rotation differences, and viewing angle differences between the template image and the reference image. These differences bring great challenges to the template matching task. Similarity measurement methods used in traditional template matching methods include SAD (Sum of Absolute Differences), SSD (Sum of Squared Differences), NCC (Normalize...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06K9/46G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/22G06F18/253G06F18/214
Inventor 郑永斌任强徐婉莹孙鹏白圣建朱笛杨东旭
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products