Driver emotion recognition method and terminal device

Abstract

The invention is applicable to the technical field of computer application, and provides a driver emotion recognition method, a terminal device and a computer-readable storage medium. The method includes: obtaining a driver's current voice data; extracting a Mel frequency domain feature from the voice data, and the Melco frequency domain feature is input into the trained convolutional neural network to extract the short-time acoustic features of the speech data; the text features are extracted from the speech data, and the text features are input into the training long-term memory neural network. The linguistic features of the long-term domain of the speech data are extracted; the emotion type corresponding to the speech data is determined according to the acoustic features and the linguistic features. The acoustic features of the speaker are extracted by CNN, and the linguistic features of the speaker are extracted by LSTM, which realizes the complete extraction and accurate recognition of the speech features, and improves the accuracy and integrity of the driver's emotion recognition.

Description

technical field [0001] The invention belongs to the field of computer application technology, and in particular relates to a driver emotion recognition method, terminal equipment and a computer-readable storage medium. Background technique [0002] There are many reasons for the occurrence of traffic accidents, generally speaking, they are human factors, vehicle factors, road and environmental factors, etc., among which the human factor ranks first. Among the human factors, the driver's factor is the most important. Driver's bad mood is an important cause of traffic accidents. When stimulated, most people express it through their faces, movements, and eyes. In the process of driving a vehicle, when the driver is in a happy and satisfied mood, he can feel comfortable and psychologically comfortable, and has a positive role in promoting the observation and judgment of things. He often shows strong sensibility, diligent observation, quick response, judgment Accurate, quick a...

AI Technical Summary

Problems solved by technology

[0004] In view of this, an embodiment of the present invention provides a driver emotion recognition method, a terminal device, and a computer-readable storage medium to solve the problem in the prior art that the probability of traffic accidents increases due to the driver's emotional instability

Images