Crowd counting method based on deep learning and apparatus thereof

A crowd counting and deep learning technology, applied in the field of computer vision and machine learning, can solve the problems of loss of image details, low detection and recognition rate, etc., and achieve the effect of improving accuracy and robustness

Active Publication Date: 2017-07-18
深圳市和巨信息技术有限公司
View PDF4 Cites 50 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In terms of target recognition and detection, although network models such as Faster-RCNN, YOLO, SSD, and R-FCN all have good performance, these network models have low detection and recognition rates for objects with small targets due to the network structure. status
At the same time, for high-resolution crowd images and videos, because the image size is large, in order to improve the detection efficiency, the above methods will reduce the image to a certain extent, resulting in further loss of image details.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crowd counting method based on deep learning and apparatus thereof
  • Crowd counting method based on deep learning and apparatus thereof
  • Crowd counting method based on deep learning and apparatus thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] figure 1 It is a flowchart of a crowd counting method based on deep learning provided in Embodiment 1 of the present invention. The method of this embodiment can be executed by a crowd counting device based on deep learning, and the device can be implemented by means of hardware and / or software. refer to figure 1 , the deep learning-based crowd counting method provided in this embodiment may specifically include the following:

[0023] Step 11. Divide the picture of the crowd to be detected into multiple picture blocks.

[0024] Wherein, the picture of the crowd to be detected may be a picture of a dense crowd with high resolution. A high-resolution dense crowd picture means that the picture size is greater than the preset resolution threshold, and the number of people contained in the picture exceeds the preset crowd number threshold. The resolution threshold can be 1280x1024, and the crowd number threshold can be 50, 100, etc. .

[0025] In order to improve the d...

Embodiment 2

[0051] image 3 It is a flowchart of a crowd counting method based on deep learning provided in Embodiment 2 of the present invention. refer to image 3 , the deep learning-based crowd counting method provided in this embodiment may specifically include the following:

[0052] Step 21. Divide the picture of the crowd to be detected into multiple picture blocks.

[0053] Step 22: Based on the pre-trained RPN candidate frame generation model, determine the head candidate frame regions in the plurality of picture blocks and the confidence levels of the head candidate frame regions.

[0054] Step 23: Screen the determined human head candidate frame areas according to the confidence level to obtain the area to be detected.

[0055] Step 24, using the region to be detected as an input of the Fast-RCNN correction model to obtain a new confidence level of the region to be detected.

[0056] Step 25. Determine the region to be detected whose new confidence level is greater than the...

Embodiment 3

[0064] This embodiment provides a crowd counting device based on deep learning. Figure 4 It is a structural diagram of a crowd counting device based on deep learning provided in Embodiment 3 of the present invention, such as Figure 4 As shown, the crowd counting device based on deep learning can include:

[0065] Picture division module 31, is used for dividing the crowd picture to be detected into a plurality of picture blocks;

[0066] The head candidate frame area module 32 is used to determine the confidence of the head candidate frame area and the head candidate frame area in the plurality of picture blocks based on the RPN candidate frame generation model obtained through pre-training;

[0067] The area to be detected module 33 is used to screen the determined head candidate frame area according to the confidence level to obtain the area to be detected;

[0068] The crowd number module 34 is configured to classify and predict the region to be detected based on the pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose a crowd counting method based on deep learning and an apparatus thereof. The method comprises the following steps of dividing a crowd picture to be detected into a plurality of picture blocks; based on an RPN candidate frame acquired from training in advance, generating a model, and determining head candidate frame areas in the plurality of picture blocks and degrees of confidence of the head candidate frame areas; according to the degrees of confidence, screening the determined head candidate frame areas and acquiring an area to be detected; and based on a Fast-RCNN correction model acquired from the training in advance, carrying out classification prediction on the area to be detected, and according to a classification prediction result, determining a crowd number included in the crowd picture to be detected. In the embodiments of the invention, the crowd counting method under high resolution is provided, and accuracy and robustness of crowd counting are increased.

Description

technical field [0001] Embodiments of the present invention relate to the technical fields of computer vision and machine learning, and in particular to a deep learning-based crowd counting method and device. Background technique [0002] Video-based crowd counting has a wide range of applications. Whether it is the analysis of the advertising effect of advertising machines, the early warning of the number of people in security monitoring, or the analysis of the flow of people in tourist attractions, the crowd counting technology based on video is a method worth promoting. Traditional crowd counting methods based on face recognition mostly rely on manual feature extraction and professional domain knowledge, which can achieve certain results. However, when counting portraits with different postures and different sides, feature extraction becomes more difficult, so that these methods cannot make more accurate judgments. [0003] At present, deep learning methods based on neu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/53G06F18/214
Inventor 符祖峰向函赵勇谢锋陈胜红
Owner 深圳市和巨信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products