Driver road rage real-time identification and warning method based on facial features

A face feature and driver technology, applied in the field of real-time recognition and early warning of driver's road rage, can solve the problems of difficult real-time performance, unsuitable for driver detection and early warning, and low recognition accuracy

Inactive Publication Date: 2016-07-06
JIANGSU UNIV
View PDF5 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, there are many reports on driver's road rage, most of which mainly analyze the impact of driver's anger on driving safety, but there are no reports on the real-time identification and early warning methods of driver's anger
Although many scholars have made some breakthroug

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Driver road rage real-time identification and warning method based on facial features
  • Driver road rage real-time identification and warning method based on facial features
  • Driver road rage real-time identification and warning method based on facial features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0050] figure 1 Provided the overall process of the present invention, use Kinect to track driver's face from real-time video data, obtain the RGB image and depth (Depth) image of driver's face, then, these two kinds of image information are carried out gray scale, Image size normalization and mean filtering to remove noise and other preprocessing operations are respectively input to the trained CNN (Convolutional Neural Network) model (such as figure 1As shown in , the CNN structure uses two layers) for feature extraction, and the extracted features are input into the Softmax classifier for driver emotion recognition, and then the classification results of 30 consecutive frames of images are fused. The fusion method is to obtain RGB and Depth The recognition results of the channels are accumulated separately, and then multiplied by the preset...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a driver road rage real-time identification and warning method based on facial features. The method comprises the following steps: first, using Kinect to track the face of a driver from real-time video data, and extracting a RGB image and a depth image of the driver face; and then, carrying out graying, image size normalization, median filtering for noise removing and other preprocessing operations on the two types of image information, inputting the image information into a trained CNN model to extract features, inputting the extracted features in a Softmax classifier for classification, fusing the classification results of 30 continuous frames of the RGB image and the depth image of the face, calculating the probability values of two channel confidences, comparing the two confidences, taking the result of highest confidence as a driver facial expression final identification result, and warning the driver according to the identification result. According to the invention, RGB-D driver face feature information is fused, and angry feelings of drivers can still be identified in real time and with high accuracy and warning can be carried out in a night or bad driving environment.

Description

technical field [0001] The invention relates to a method for real-time identification and early warning of driver's road rage, in particular to a method for real-time identification and early warning of driver's road rage based on facial features. Background technique [0002] In recent years, due to the rapid development of the economy, people's living standards have been greatly improved, and the number of private cars owned by citizens has continued to increase. At the same time, the incidence of traffic accidents has also continued to rise. Vehicle and safety issues have become a hot spot of social concern. Among them, driver's road rage is also an important reason affecting safe driving. [0003] The concept of "road rage" first came from foreign psychology. With the increase in the number of cars in China, this psychological problem has also attracted the attention of more and more domestic experts. "Road rage" is a term used to describe the anger caused by the stres...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/176G06V20/597G06N3/045G06F18/23213G06F18/2415
Inventor 毛启容刘鹏刘峰詹永照陈龙
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap