Driver behavior identification method based on multi-scale attention convolutional neural network

A technology of convolutional neural network and recognition method, which is applied in the field of driver behavior recognition based on multi-scale attentional convolutional neural network, which can solve problems such as differences in steering wheel methods and difficulty in accurate recognition

Active Publication Date: 2019-07-26
SOUTHEAST UNIV
View PDF2 Cites 67 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (2) Different drivers have different driving habits, for example, there are obvious differences in the way of holding the steering wheel
This makes the driver present a large intra-class variance in the image pose, and at the same time, the occlusion of light also makes it difficult for accurate recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Driver behavior identification method based on multi-scale attention convolutional neural network
  • Driver behavior identification method based on multi-scale attention convolutional neural network
  • Driver behavior identification method based on multi-scale attention convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0080] A driver behavior recognition method based on multi-scale attention convolutional neural network, comprising the steps of:

[0081] Step 1: Take an image dataset for driver behavior recognition. All images are recorded by the built-in on-board camera at different angles and under different light conditions. The driver behavior dataset has a total of 42816 pictures, covering 6 different driving behaviors, such as figure 1 As shown, they are:

[0082] C0: safe driving;

[0083] C1: Driving without the steering wheel;

[0084] C2: Driving on the phone;

[0085] C3: Looking down at the phone;

[0086] C4: smoking and driving;

[0087] C5: Talk to passengers;

[0088] The captured image data set is divided into a training set and a test set, each containing 17,087 training images and 25,729 testing images.

[0089] Step 2: Perform data enhancement on the captured driver behavior data set and incorporate the enhanced samples into the training data at the same time, wh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a driver behavior identification method based on a multi-scale attention convolutional neural network. The method comprises the following steps: (1) shooting an image data setfor driver behavior identification; (2) carrying out data enhancement on the shot driver behavior data set and simultaneously bringing samples obtained by enhancement into training data; (3) constructing a neural network model which comprises three modules, namely a multi-scale convolution module, an attention module and a classification module; (4) training a multi-scale attention convolutional neural network; using a Pytorch open source tool i for building a network model, and using a random gradient descent method for optimizing network parameters; and (5) testing the multi-column convolutional neural network. According to the invention, the multi-scale model and the attention mechanism are introduced into the driver behavior identification task to extract the behavior fine-grained feature representation with the distinction degree, so that the driver behavior identification accuracy can be further improved.

Description

technical field [0001] The invention relates to the technical fields of image processing and pattern recognition, in particular to a driver behavior recognition method based on a multi-scale attention convolutional neural network. Background technique [0002] In recent years, with the continuous improvement of technology and living standards, cars have entered thousands of households. At present, the number of cars in China has reached 325 million, second only to the United States. The popularity of automobiles has brought a lot of convenience to people's travel, but it has also caused potential hidden dangers to traffic safety. According to relevant statistics from the Ministry of Communications of China, there were 212,846 traffic accidents nationwide in 2017, resulting in 63,093 deaths, and more than 80% of the traffic accidents were closely related to the illegal driving behavior of drivers. Due to the weak awareness of traffic regulations, bad driving behaviors such a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V20/597G06N3/045G06F18/214G06F18/241Y02T10/40
Inventor 路小波胡耀聪陆明琦
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products