Driver road rage real-time identification and warning method based on facial features

Abstract

The invention discloses a driver road rage real-time identification and warning method based on facial features. The method comprises the following steps: first, using Kinect to track the face of a driver from real-time video data, and extracting a RGB image and a depth image of the driver face; and then, carrying out graying, image size normalization, median filtering for noise removing and other preprocessing operations on the two types of image information, inputting the image information into a trained CNN model to extract features, inputting the extracted features in a Softmax classifier for classification, fusing the classification results of 30 continuous frames of the RGB image and the depth image of the face, calculating the probability values of two channel confidences, comparing the two confidences, taking the result of highest confidence as a driver facial expression final identification result, and warning the driver according to the identification result. According to the invention, RGB-D driver face feature information is fused, and angry feelings of drivers can still be identified in real time and with high accuracy and warning can be carried out in a night or bad driving environment.

Description

technical field [0001] The invention relates to a method for real-time identification and early warning of driver's road rage, in particular to a method for real-time identification and early warning of driver's road rage based on facial features. Background technique [0002] In recent years, due to the rapid development of the economy, people's living standards have been greatly improved, and the number of private cars owned by citizens has continued to increase. At the same time, the incidence of traffic accidents has also continued to rise. Vehicle and safety issues have become a hot spot of social concern. Among them, driver's road rage is also an important reason affecting safe driving. [0003] The concept of "road rage" first came from foreign psychology. With the increase in the number of cars in China, this psychological problem has also attracted the attention of more and more domestic experts. "Road rage" is a term used to describe the anger caused by the stres...

AI Technical Summary

Problems solved by technology

[0004] At present, there are many reports on driver's road rage, most of which mainly analyze the impact of driver's anger on driving safety, but there are no reports on the real-time identification and early warning methods of driver's anger

Although many scholars have made some breakthroughs in the analysis and recognition of emotional information in daily life, these models are complex and difficult to achieve real-time performance. In the case of poor image lighting, the recognition accuracy is not high, so it is not suitable for drivers. Anger detection and early warning

Images