Intelligent gender and emotion recognition detection system and method based on vision and voice

Abstract

The invention discloses an intelligent gender and emotion recognition detection system and method based on vision and voice. The system comprises an image-based emotion and gender recognition module, a voice-based emotion and gender recognition module, a fusion module and a personalized intelligent voice interaction system, wherein the image-based emotion and gender recognition module is used for recognizing the emotion of a person in a vehicle according to a face image and recognizing the gender of the person in the vehicle according to the face; the voice-based emotion and gender recognition module is used for recognizing the emotion and the gender of the person in the vehicle according to voice; the fusion module is used for matching the gender recognition results, fusing the emotion recognition result, and sending the results to the personalized intelligent voice interaction system; and the personalized intelligent voice interaction system is used for voice interaction. By adopting the system and the method, the gender / emotion recognition accuracy is improved via fused images and voice recognition results; the driving experience and the driving safety are improved via the personalized intelligent voice interaction system; and the using fun of vehicle-mounted equipment and the accuracy of information service are improved by voice interaction.

Description

technical field [0001] The invention relates to an automobile safety auxiliary system, in particular to an intelligent gender and emotion recognition detection system and method based on vision and voice. Background technique [0002] Head Up Display (HUD) is a flight aid commonly used in aircraft. Heads up means that the pilot does not need to look down to see the important information he needs. Because of the convenience of HUD and the ability to improve flight safety, civil aviation aircraft have also followed up with the installation. HUD uses the principle of optical reflection to project important flight-related information on a piece of glass. This piece of glass is located at the front of the cockpit, and its height is roughly at the level of the pilot's eyes. The projected text and images are adjusted to a distance of infinity in focus. When the pilot looks forward through the HUD, it will not hinder the operation of the eyes. Clear display. [0003] The basic s...

AI Technical Summary

Problems solved by technology

However, the existence of the car's central control screen does make driving safer, but in the actual experience, there are still various disadvantages and inconveniences on the car's central control screen, which will still distract the driver.

[0006] The current in-vehicle voice interaction system uses preset voice and intonation to interact with the driver. The interaction rules are rigid and cannot be customized according to the driver's gender / emotion, and cannot meet the individual needs of users.

Images