Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Crowd counting method based on multi-scale generative adversarial network

A multi-scale, network technology, applied in the field of image processing and computer vision, can solve problems such as occlusion, crowd image scale change, and confrontation loss

Pending Publication Date: 2020-05-22
TIANJIN UNIV MARINE TECH RES INST
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems existing in the existing technology, this patent is based on the crowd counting method of the multi-scale generative confrontation network, which integrates the features of the single column convolutional neural network at different depths, and solves the problems of scale change and occlusion in the crowd image, and at the same time , the network model is added to the confrontation loss of the discriminator, and a confrontational training method is used to predict the crowd density and generate a higher quality density map

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crowd counting method based on multi-scale generative adversarial network
  • Crowd counting method based on multi-scale generative adversarial network
  • Crowd counting method based on multi-scale generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention needs to solve a given image of a group of people or a frame in a video, and then estimate the density and total number of people in each area of ​​the image.

[0032] The structure of multi-level convolutional neural network is as follows figure 1 As shown in the generator part of the network, in the first three convolution blocks of the network, the multi-scale convolution module (inception ) for multi-scale feature extraction, the multi-scale convolution module uses three different scales The convolution kernels are used to obtain features of different scales, and each multi-scale convolution module expresses multi-scale features for deep features. In order to make the sizes of the specific maps of different scales consistent, this paper uses the pooling method to pool the feature maps of different sizes to a uniform size. Among them, conv-1 uses two layers of pooling, and conv-2 uses one layer of pooling, which is finally the same size as c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

According to the crowd counting method based on the multi-scale generative adversarial network, crowd density prediction is carried out by adopting an adversarial training mode. And the maximum and minimum problems of the generation model and the discrimination model are optimized by adopting a combined alternate iteration training mode, wherein the training generation network is used for generating an accurate crowd density map so as to cheat the discriminator, and on the contrary, the discriminator is trained to be used for discriminating the generated density map and a real density map label. Meanwhile, the output of the discriminator can provide feedback of the density map position and prediction precision for the generator. The two networks compete for training at the same time so asto improve the generation effect until the sample generated by the generator cannot be correctly judged by the discriminator. According to the crowd density detection algorithm provided by the invention, after adversarial loss is introduced, an adversarial training mode is adopted to enable the convolutional neural network to generate a density map with higher quality, so that the accuracy of network crowd counting is improved.

Description

technical field [0001] The invention relates to the fields of image processing and computer vision, in particular to a crowd counting algorithm based on a multi-scale generative confrontation network. Background technique [0002] With the continuous growth of my country's population, there are more and more occasions where large-scale crowds gather. In order to effectively control the number of people in public places and prevent accidents caused by crowd density overload, video surveillance has become the main means at present. In the field of video surveillance and security, crowd analysis has attracted the attention of more and more researchers, and has become a very hot research topic in the field of computer vision. The task of crowd counting is to accurately estimate the total number of crowds in the picture and at the same time give the distribution of crowd density. Image crowd counting can be used in many fields, such as accident prevention, space planning, analy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04G06K9/00
CPCG06V20/53G06N3/045G06F18/22G06F18/214Y02T10/40
Inventor 咸良杨建兴周圆
Owner TIANJIN UNIV MARINE TECH RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products