Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A pedestrian abnormal behavior identification method based on 3D convolution

A recognition method and behavioral technology, applied in the field of video processing, can solve problems such as high computing cost, achieve the effect of reducing computing cost, reducing a large amount of redundant information and fuzzy noise, and maintaining recognition performance

Pending Publication Date: 2019-04-16
HANGZHOU DIANZI UNIV
View PDF15 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

State-of-the-art 3D CNN models such as Res 3D and I3D build CNN models in this straightforward manner and use multi-layer 3D convolutions to learn powerful video features, achieving the highest accuracy on multiple datasets, but computational very expensive

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A pedestrian abnormal behavior identification method based on 3D convolution
  • A pedestrian abnormal behavior identification method based on 3D convolution
  • A pedestrian abnormal behavior identification method based on 3D convolution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be described in further detail below with reference to the accompanying drawings.

[0036] The overall framework of video abnormal behavior recognition in the present invention is as follows: figure 1 As shown, it can be seen that behavior recognition can be mainly divided into three parts: data collection, data preprocessing, and the training and use of classifiers. The first is the data collection step. The present invention creates a smaller abnormal behavior data set, which is mainly screened and collected from KTH, CASIA, Kinetics, UCF-101 and other data sets and network video data, including cycling, skateboard / balance car, Fighting, dog walking, falling 5 types of abnormal behaviors and normal walking 1 type of normal behavior 6 types of data sets, similar to the Kinetics data set, each type is divided into training set, verification set and test set, respectively containing about 400, 30 , 70 video clips, and the duration of each vide...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian abnormal behavior identification method based on 3D convolution. The pedestrian abnormal behavior identification method comprises the steps of S1, creating a dataset containing abnormal behaviors such as fighting, dog walking and falling; S2, in combination with the latest video behavior identification scheme, constructing a 3D convolutional neural network considering both precision and speed; S3, preprocessing the images in the data set, and sending the preprocessed images into a 3D convolutional neural network to obtain a video abnormal behavior recognition model; And S4, inputting a tested pedestrian monitoring video, and outputting an abnormal behavior type. According to the identification method provided by the invention, the lightweight 2D convolutional network MobileNet idea is migrated to the 3D network, so that the calculation cost can be reduced on the basis of maintaining the identification performance; Meanwhile, a self-adaptive poolinglayer and a sparse time sampling strategy are adopted, so that a large amount of redundant information and fuzzy noise contained in continuous frames can be reduced.

Description

technical field [0001] The invention belongs to the technical field of video processing, and mainly relates to identification of abnormal behavior of pedestrians, specifically, a method for identifying abnormal behavior of pedestrians based on 3D convolution. Background technique [0002] Behavior recognition has a wide range of applications in real life and has aroused the interest of a large number of research teams. With the rapid development of deep learning technology in the image field, researchers began to believe that deep learning methods can also be used for tasks such as video analysis and understanding. Compared with traditional artificial feature-based methods, models using deep learning methods can automatically obtain meaningful hierarchical feature representations. However, video clips obtained from the Internet or movies are more complex than the video samples in previous standard databases, and these video clips contain a large number of motion components....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/20G06N3/045
Inventor 刘兆森应娜郭春生朱辰都杨鹏李怡菲
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products