Automobile fatigue driving prediction method

A technology of fatigue driving and prediction method, which is applied in the fields of computer vision and image processing, and can solve problems such as the lack of neural network fatigue detection methods and the inability to apply eye fatigue detection.

Inactive Publication Date: 2017-09-22
FUJIAN NORMAL UNIV
View PDF8 Cites 73 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of the fact that the image classification based on deep learning is effective, and the rapid development of big data and computer hardware promotes the effect of deep learning classification, some researchers use big data for face recognition, but because the target of the ey

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automobile fatigue driving prediction method
  • Automobile fatigue driving prediction method
  • Automobile fatigue driving prediction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] Such as Figure 1-5 Shown in one of them, the present invention discloses a kind of automobile fatigue driving prediction method, and it comprises the following steps:

[0052] Step 1. For any image f(x,y) given by the training data set, set the image at multiple scales to construct an image pyramid and use it as the input of the neural network under the cascade framework below;

[0053] In the present invention, the scale factors for generating the multi-scale image pyramid are 1.2, 1.0, and 0.8. The training and testing image sets of three scales can be generated by using the scale factor. They are used as network input for training, learning and testing respectively.

[0054] In the present invention, the training data set is composed of positive examples (human faces), negative examples (non-human faces), partial human faces and eigenface images in a ratio of 3:1:1:2. Negative example: the image area with an intersection ratio of less than 0.3 with the benchmark ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automobile fatigue driving prediction method. The method comprises the following steps of successively constructing and arranging first to fourth grades of convolutional neural networks, inputting an image, using a first grade of the convolutional neural network to acquire a candidate face window and a corresponding bounding box regression vector, and through the first grade and a second grade of the convolutional neural networks, merging candidate windows which are highly overlapped; for the residual candidate windows, through a third grade of the convolutional neural network, using face characteristic point mark information to predict and identify a human eye area; according to an eye characteristic point, segmenting an eye area, inputting a fourth grade of the convolutional neural network, through a depth learning algorithm, training a depth visual characteristic model of an eye image; making a video collected by a camera successfully pass through a CNN1, a CNN2, a CNN3 and a CNN4, and distinguishing a closing state of eyes; and calculating a driver fatigue visual assessment parameter PERCLOS, and when a PERCLOS value is greater than 40%, determining that a driver begins to feel fatigue or is in a fatigue state, and outputting an early warning signal. By using the method of the invention, the fatigue state of the driver under various conditions of illumination, an attitude and an expression can be detected, detection result robustness is high, and influences of factors of the illumination, the attitude, the expression and the like on driver fatigue detection are effectively overcome.

Description

technical field [0001] The invention relates to the fields of computer vision and image processing, in particular to a method for predicting automobile fatigue driving. Background technique [0002] With the development of the economy, the ownership of cars has increased dramatically. According to the prediction results of the program of the research group of the Development Research Center of the State Council, the number of automobiles in China will reach 56.69 million in 2010, 194 million in 2016, and will exceed 250 million in 2020. The mileage of highways is increasing day by day, and the average speed of highway traffic has been greatly improved, which has undoubtedly played a role in promoting economic development. But at the same time, traffic accidents have also increased accordingly, which has brought great threats to people's lives and property safety. According to statistics provided by the traffic control department of the Ministry of Public Security of China,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/08G08B21/06B60W40/08
CPCG06N3/08G08B21/06B60W40/08B60W2040/0827G06V40/161G06V20/597
Inventor 曾智勇
Owner FUJIAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products