Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method of person re-identification based on multi-component self-attention mechanism

A pedestrian re-identification and attention technology, applied in the field of artificial intelligence and computer vision, can solve the problems of insufficient robustness of extracted features, severe occlusion of pedestrian image posture changes, poor recognition performance, etc.

Active Publication Date: 2020-09-04
ZHEJIANG LAB
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In an open environment, due to the complex and changeable monitoring scene, the collected pedestrian images often have interference factors such as background noise, illumination changes, posture changes, and severe occlusions. The area of ​​the degree of discrimination leads to the extraction of features that are not robust enough and the recognition performance is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of person re-identification based on multi-component self-attention mechanism
  • A method of person re-identification based on multi-component self-attention mechanism
  • A method of person re-identification based on multi-component self-attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0082] To make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions and specific operation processes in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention, but the The scope of protection is not limited to the examples described below.

[0083] like Figure 1-2 As shown, the embodiment of the present invention discloses a pedestrian re-identification method based on a multi-component self-attention mechanism, including the following steps:

[0084] S1: Pre-trained deep convolutional neural network backbone model B.

[0085] The backbone model of the convolutional neural network in S1 of the above steps uses ResNet, and is pre-trained on the large-scale ImageNet dataset, so that the backbone network B can obtain an ideal initial value.

[0086] S2: Segment the backbone model B:...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a pedestrian re-identification method based on a multi-component self-attention mechanism. The method first pre-trains the backbone model of a deep convolutional neural network; Self-attention features; then input the multi-component self-attention features into the classifier, and jointly train to minimize the cross-entropy loss and measurement loss; finally, input the test set pictures into the trained model, and fuse the output component features to obtain the overall features, which are measured Sorting implements person re-identification. By fully considering various challenges in the pedestrian re-identification problem, the present invention proposes a multi-component self-attention mechanism, which effectively expands the attention activation area and enriches the characteristics of pedestrians; the self-attention module enables the network to pay more attention to The area with discriminative characteristics is where the spatial attention module and channel attention module are integrated into the network in the form of residuals, making the network more robust and stable, and easy to train.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence and computer vision, and in particular relates to a pedestrian re-identification method based on a multi-component self-attention mechanism. Background technique [0002] With the acceleration of urbanization, public safety has become the focus and demand of people's increasing attention. Many important public health areas such as university campuses, theme parks, hospitals, and streets are widely covered with surveillance cameras, creating good objective conditions for automated surveillance using computer vision technology. [0003] In recent years, person re-identification, as an important research direction in the field of video surveillance, has attracted increasing attention. Specifically, pedestrian re-identification refers to the technology of using computer vision technology to judge whether a specific pedestrian exists in an image or video sequence under cross-camera and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06N3/045G06F18/24G06F18/253
Inventor 陆易叶喜勇徐晓刚张逸张文广祝敏航
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products