A video driver behavior identification method based on a multi-task space-time convolutional neural network

A convolutional neural network and recognition method technology, applied in the field of image processing and pattern recognition, can solve problems such as difficulty in artificial design, inability to make good use of video dynamic information, and inability to realize real-time driver recognition.

Active Publication Date: 2019-05-21
SOUTHEAST UNIV
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

So it is difficult to artificially design general features suitable for all scenarios
[0005] (2) Although the traditional convolutional neural network method can be applied to static image recognition, it cannot make good use of the dynamic information between videos
T

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A video driver behavior identification method based on a multi-task space-time convolutional neural network
  • A video driver behavior identification method based on a multi-task space-time convolutional neural network
  • A video driver behavior identification method based on a multi-task space-time convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] The technical solutions provided by the present invention will be described in detail below in conjunction with specific examples. It should be understood that the following specific embodiments are only used to illustrate the present invention and are not intended to limit the scope of the present invention.

[0069] The video driver's behavior recognition method based on the multi-task spatio-temporal convolutional neural network provided by the present invention, such as Image 6 shown, including the following steps:

[0070] Step 1: Take a video of the driver's behavior and enter it into the behavior dataset. All the videos are taken by the built-in vehicle monitoring camera, the camera model is Logitech C920. The driver behavior dataset is recorded by 120 people, with a total of 3252 videos covering 6 different driving behaviors, such as figure 1 As shown, they are:

[0071] C0: normal driving

[0072] C1: Take your hands off the steering wheel

[0073] C2: ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video driver behavior identification method based on a multi-task space-time convolutional neural network. A multi-task learning strategy is introduced into a training processof a space-time convolutional neural network and is applied to driver behavior identification in a monitoring video. Auxiliary driver positioning and optical flow estimation tasks are implicitly embedded into the video classification tasks, so that the convolutional neural network model is promoted to learn richer driver local space and motion time characteristics, and the driver behavior recognition accuracy is improved. Compared with an existing driver identification method, the multitask space-time convolutional neural network architecture designed by the invention combines interframe information, is high in generalization and identification accuracy, can be used for real-time driver behavior identification under a monitoring video, and has an important application value in the field of traffic safety.

Description

technical field [0001] The invention belongs to the field of image processing and pattern recognition, and relates to a video driver behavior recognition method based on a multi-task spatio-temporal convolutional neural network. Background technique [0002] According to the official report of the World Health Organization, 1.25 million people die in traffic accidents every year in the world. As one of the most frequent accidents, the occurrence of serious traffic accidents is usually attributed to drivers' illegal driving, car failure, bad weather conditions, etc. Among them, more than 80% of traffic accidents are related to drivers' illegal driving. Some bad driving behaviors, such as taking hands off the steering wheel, making phone calls, looking down at mobile phones, smoking, etc., distract the driver's attention and pose a certain degree of safety hazard. Therefore, driver behavior monitoring technology has important research significance for road safety and intellig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCY02T10/40
Inventor 路小波胡耀聪陆明琦
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap