Multi-scale convolutional neural network-based image crowd counting method

A convolutional neural network and crowd counting technology, which is applied in the field of crowd image analysis, can solve problems such as large network parameters, changes in people's size and scale, and changes in shooting angles, and achieve the effects of improving accuracy and solving scale changes and occlusions

Inactive Publication Date: 2018-03-30
TIANJIN UNIV
View PDF5 Cites 55 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, because most of the crowd images are taken by surveillance cameras and high altitudes, the shooting angles vary greatly, and the size and scale of the people in the captured images vary greatly
The multi-column convolutional neural network proposed by Zhang et al. has high network complexity and large network parameters. The three-column network needs to be pre-trained and then fuse the output features of the multi-column network. It cannot grasp the multi-scale information of a single image at the same time.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-scale convolutional neural network-based image crowd counting method
  • Multi-scale convolutional neural network-based image crowd counting method
  • Multi-scale convolutional neural network-based image crowd counting method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0026] Such as figure 1 As shown, a crowd density detection method based on a multi-scale convolutional neural network of the present invention fuses the features of a single-column convolutional neural network at different depths, and the specific steps are as follows:

[0027] Step 1. Generate a continuous density map label, and convert the labeled image into a continuous estimated density map, which specifically includes the following processing:

[0028] The corresponding density map is generated by manually marking the human head coordinates, and the image with N human head marks is expressed as the following function:

[0029]

[0030] In the formula, δ(x-x i ) is a delta function; x i Indicates the position of a head mark point;

[0031] The expression of the estimated density map F(x) is as follows:

[0032] F(x)=H(x) *

[003...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-scale convolutional neural network-based image crowd counting method. The method comprises the steps of (1), generating a continuous density graph tag, and converting atagged image into a continuous estimation density graph; and (2), obtaining an accurate density graph of a predicted crowd by utilizing a convolutional neural network, setting an initial parameter for the convolutional neural network, calculating out the loss L(theta) of an input picture according to an actual density graph, and updating the parameter of the whole network in each optimization iteration, until a loss value is converged to a relatively small value. Compared with the prior art, the method has the advantages that the problem of huge scale change of the crowd in the single image is solved; based on the single convolutional neural network, features of different hierarchical networks are fused before the predicted density graph is generated, and features of different scales corresponding to different depths are extracted, so that the precision of the predicted density graph is greatly improved; and the problems of scale change, shielding and the like in the crowd image are solved.

Description

technical field [0001] The invention relates to the technical field of crowd image analysis, in particular to a crowd counting algorithm based on a multi-scale convolutional neural network. Background technique [0002] Crowd counting is an intelligent surveillance application that calculates the number of people by predicting the density map of crowd images. With the exponential growth of the world population, rapid urbanization has promoted many large-scale activities, such as sports competitions, public parades, traffic congestion and other issues leading to large-scale crowd gatherings. Therefore, in order to better manage crowds and personal safety, crowd behavior analysis algorithms are of great significance. [0003] With the continuous promotion of deep learning algorithms, the crowd counting algorithm based on convolutional neural network has greatly improved the detection accuracy compared with traditional algorithms. Algorithms based on convolutional neural netw...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/53G06N3/045G06F18/253
Inventor 周圆杨建兴李成浩杜晓婷毛爱玲
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products