Target tracking method and system based on attention mechanism and global reasoning

A technology of target tracking and global reasoning, applied in the field of target tracking methods and systems based on attention mechanism and global reasoning, can solve the problems of tracking failure, lack of good attention to tracking targets, shallow network structure, etc., and achieve good tracking effect. Effect

Pending Publication Date: 2021-11-02
ANHUI UNIVERSITY
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the typical twin networks SiamFC and SiamRPN, the following points out two shortcomings. First, the network structure they use is shallow, the extracted features are not sufficient, and they do not pay attention to the tracking target itself, so in

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target tracking method and system based on attention mechanism and global reasoning
  • Target tracking method and system based on attention mechanism and global reasoning
  • Target tracking method and system based on attention mechanism and global reasoning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to further illustrate the features of the present invention, please refer to the following detailed description and accompanying drawings of the present invention. The accompanying drawings are for reference and description only, and are not intended to limit the protection scope of the present invention.

[0040] Such as Figure 1 to Figure 2 As shown, this embodiment discloses a target tracking method based on attention mechanism and global reasoning, and uses a twin network-based target tracking model for target tracking. The target tracking model includes a template branch and a search branch, a template branch and a search branch. Each branch includes a backbone network, a parallel attention mechanism and a global reasoning module, including the following steps S1 to S3:

[0041] S1. Obtain the initial frame picture and the current frame picture, and use them as inputs for the template branch and the search branch respectively to obtain the first score ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a target tracking method and system based on an attention mechanism and global reasoning, and belongs to the technical field of computer vision, and the method comprises the steps of carrying out the target tracking through a target tracking model based on a twin network, wherein the target tracking model comprises a template branch and a search branch, the template branch and the search branch each comprise a backbone network, a parallel attention mechanism and a global reasoning module; obtaining an initial frame picture and a current frame picture, taking the initial frame picture and the current frame picture as input of the template branch and input of the search branch respectively, and obtaining a first score graph and a second score graph; performing weighted summation on the first score graph and the second score graph to obtain a regression graph; and determining the position of a target according to the regression graph. Compared with an existing tracking algorithm, the method has a better tracking effect.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to an object tracking method and system based on attention mechanism and global reasoning. Background technique [0002] Object tracking is one of the hard problems in the field of computer vision, which is the basis for higher-level visual understanding and scene analysis. Object tracking technology is widely used in video surveillance, human-computer interaction, robotics, video editing, and autonomous driving. The task of visual object tracking is to achieve continuous and stable tracking of moving targets in subsequent frames based on the target position and size information in the initial frame. Achieving long-term stable object tracking is still a challenging task due to object disturbances such as scale variation, rotation, deformation, fast motion, and changes in background illumination of the object. [0003] In recent years, research on the task of visual trackin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/246G06T7/73G06N3/04G06N3/08G06N5/04
CPCG06T7/251G06T7/75G06N3/08G06N5/04G06T2207/10016G06N3/048G06N3/045
Inventor 鲍华束平许克应
Owner ANHUI UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products