Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method utilizing multi-scale multi-task convolutional neural network for population counting of stationary images

A convolutional neural network and crowd counting technology, applied in the field of intelligent monitoring, can solve the problems of uneven crowd distribution and different scales, and achieve the effect of solving the problem of crowd scale differences, improving accuracy, and improving generalization ability.

Active Publication Date: 2018-04-27
CHANGZHOU UNIV
View PDF6 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, crowd counting based on deep learning still has challenges such as uneven crowd distribution and different scales

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method utilizing multi-scale multi-task convolutional neural network for population counting of stationary images
  • Method utilizing multi-scale multi-task convolutional neural network for population counting of stationary images
  • Method utilizing multi-scale multi-task convolutional neural network for population counting of stationary images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The present invention will be further described below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited thereto.

[0050] figure 1 The system flow diagram of the crowd counting method for still images using multi-scale multi-task convolutional neural network is given:

[0051] The crowd counting method proposed by the present invention divides the crowd image into several image sub-blocks, and each image sub-block is processed by up-sampling and down-sampling to obtain information of different scales. Then features are automatically extracted from image sub-patches of all scales by building a multi-scale CNN. These features estimate density maps, crowd density classes and background / foreground classifications in a multi-task learning manner. Finally, the combined density map of the crowd image is reconstructed according to the combined density map of all image sub-blocks, and the number of crowds is calcula...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method utilizing the multi-scale multi-task convolutional neural network for population counting of stationary images. According to the method, firstly, an inverse Gaussian density map is combined with an original Gaussian density map to form a combined density map; secondly, non-overlapping sampling of an input image is carried out to acquire several image sub-blocks, and the network is trained based on the image sub-blocks and corresponding true combined density maps thereof; overlapping sampling of the input image is carried out in the same pace, combined density maps of each image sub-block predicted by the MMCNN are superposed to reconstruct the combined density map of a complete crowd image, and population counting is realized. For the problem of populationscale difference, learning characteristics of different scale networks are measured through a fractional loss function, moreover, the population combined density map, the density level and foreground / background classification are simultaneously predicted in a multi-task mode, estimation accuracy of the combined density map is improved, and thereby an uneven population density problem is ameliorated.

Description

technical field [0001] The invention belongs to the field of intelligent monitoring, in particular to a method for counting crowds of static images by using a multi-scale and multi-task convolutional neural network. Background technique [0002] As an important part of intelligent video surveillance, crowd counting in public places has many applications, including crowd control, abnormal behavior detection, and pedestrian behavior analysis. Crowd counting can be used to detect potential risks and prevent overcrowding at religious or sporting events. Meanwhile, crowd counting can be extended to other fields, such as counting cells or bacteria from microscopic images. [0003] Existing crowd counting methods are generally divided into three categories, namely, counting by detection, counting by clustering, and counting by regression. Through the detection and counting method, crowd counting is realized according to the number of people in the detection scene. However, the d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/53G06N3/045G06F18/214
Inventor 杨彪曹金梦张御宇崔国增邹凌
Owner CHANGZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products