Pedestrian re-identification method based on multi-component self-attention mechanism

A pedestrian re-recognition and attention technology, applied in the field of artificial intelligence and computer vision, can solve the problems of poor recognition performance, serious occlusion of pedestrian image pose changes, and the extracted features are not robust enough.

Active Publication Date: 2020-07-03
ZHEJIANG LAB
View PDF6 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In an open environment, due to the complex and changeable monitoring scene, the collected pedestrian images often have interference factors such as background noise, illumination chan

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian re-identification method based on multi-component self-attention mechanism
  • Pedestrian re-identification method based on multi-component self-attention mechanism
  • Pedestrian re-identification method based on multi-component self-attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0084] To make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions and specific operation processes in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. The scope of protection is not limited to the examples described below.

[0085] Such as Figure 1-2 As shown, the embodiment of the present invention discloses a pedestrian re-identification method based on a multi-component self-attention mechanism, including the following steps:

[0086] S1: Pre-trained deep convolutional neural network backbone model .

[0087] The convolutional neural network backbone model in S1 of the above steps uses , and in Pre-training on large-scale data sets makes the backbone network Get the ideal initial value.

[0088] S2: For the backbone model To segment: and ,in correspond ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a pedestrian re-identification method based on a multi-component self-attention mechanism. The method comprises the following steps: firstly, pre-training a deep convolutional neural network backbone model; then, after the backbone model is branched, a multi-component self-attention network is constructed, and multi-component self-attention characteristics are obtained; inputting the multi-component self-attention features into a classifier, and performing joint training to minimize cross entropy loss and metric loss; and finally, inputting a test set picture into the trained model, fusing the output part features to obtain an overall feature, and realizing pedestrian re-identification through metric sorting. According to the method, various challenges existing in the pedestrian re-identification problem are fully considered, a multi-component self-attention mechanism is provided, the attention activation area is effectively expanded, and pedestrian features areenriched; the self-attention module enables the network to pay more sufficient and careful attention to an area with discrimination characteristics, and the spatial attention module and the channel attention module are integrated into the network in a residual form, so that the network is more robust and stable, and is easy to train.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence and computer vision, and in particular relates to a pedestrian re-identification method based on a multi-component self-attention mechanism. Background technique [0002] With the acceleration of urbanization, public safety has become the focus and demand of people's increasing attention. Many important public health areas such as university campuses, theme parks, hospitals, and streets are widely covered with surveillance cameras, creating good objective conditions for automated surveillance using computer vision technology. [0003] In recent years, person re-identification, as an important research direction in the field of video surveillance, has attracted increasing attention. Specifically, pedestrian re-identification refers to the technology of using computer vision technology to judge whether a specific pedestrian exists in an image or video sequence under cross-camera and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06N3/045G06F18/24G06F18/253
Inventor 陆易叶喜勇徐晓刚张逸张文广祝敏航
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products