A crowd analysis method based on an attention mechanism and a deformable convolution neural network

A technology of convolutional neural network and analysis method, which is applied in the field of crowd analysis based on attention mechanism and deformable convolutional neural network, which can solve the problems of environmental noise, decreased accuracy, and inaccurate counting results.

Active Publication Date: 2019-03-08
SUN YAT SEN UNIV
View PDF18 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are two problems with this method: first, this method needs to scan the entire image through a moving window to calculate the number of people, which is very time-consuming; second, the detection method is blocked in a crowded environm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A crowd analysis method based on an attention mechanism and a deformable convolution neural network
  • A crowd analysis method based on an attention mechanism and a deformable convolution neural network
  • A crowd analysis method based on an attention mechanism and a deformable convolution neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0019] figure 1 It is the overall flowchart of the crowd analysis method based on the attention mechanism and deformable convolutional neural network of the present invention:

[0020] In the training phase, first train the Attention Map Generator (AMG) through crowd images and background images (excluding people), and use the trained attention map generator model as an auxiliary density map generator (Density Map Estimator, DME) training components. When tr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a crowd analysis method based on an attention mechanism and a deformable convolution neural network. The method comprises the following steps that in a training stage, firstly,an attention map generator (AMG) is trained through a crowd image and a background image, and the trained attention map generator model is used as a component trained by an auxiliary density map generator (DME); in the testing phase, only the trained density map generator is used to generate the corresponding density map for the input crowd image. The invention combines the attention mechanism togenerate an attention diagram to detect the area of a crowd and to reflect the crowding degree of the crowd area to a certain extent. The attention map is used as a priori knowledge of the crowd to train the deformable convolution neural network, so that the network can overcome the uneven distribution of crowds in the crowd scene, environmental noise and other problems, and generate accurate crowd density map.

Description

technical field [0001] The invention relates to a crowd analysis method based on an attention mechanism and a deformable convolutional neural network. Background technique [0002] With the widespread use of surveillance cameras and people's increasing concern for public safety, crowd analysis has attracted the attention of many researchers in recent years. In order to meet the needs of practical applications, crowd analysis has also developed from simple crowd counting to displaying crowd distribution characteristics through density maps. Crowd density maps contain more spatial distribution information of crowds than simple crowd numbers, which can help us make correct decisions in crowded high-risk environments and prevent accidents such as riots and stampedes. [0003] At present, the methods applied to crowd scene analysis are mainly divided into three categories: detection counting, regression counting and density map analysis. Detection and counting implements crowd ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/53G06F18/241G06F18/214
Inventor 刘宁龙永超牛群吴贺丰
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap