Driver abnormal state detection method based on image and voice recognition

Abstract

The invention discloses a driver abnormal state detection method based on image and voice recognition. The method comprises the steps that 1, the state of a driver is monitored in real time through an image module and analyzed; 2, voice interaction with a driver is carried out through an interaction module, the voice state of the driver is collected, a voice system can randomly extract a group of short dialogues from a voice library to interact with the driver, 3, voice information of the driver is analyzed through a voice analysis module, the state of the driver is judged, and 4, warning is carried out through a warning module. According to the method, the driving state of the driver can be monitored in real time, and traffic safety accidents caused by abnormity of the driver can be effectively reduced.

Description

technical field [0001] The invention relates to the research fields of image recognition and voice recognition, in particular to a method for detecting abnormal states of drivers based on image and voice recognition. Background technique [0002] In recent years, due to the driver's subjective reasons, such as drunk driving, drug driving or emotional instability and other abnormal state of the driver, safety accidents have occurred from time to time, resulting in very serious consequences. For the phenomenon of drunk driving and drug driving, the current conventional practice is to set up checkpoints by the traffic police, which requires a lot of manpower input and is less effective; at present, the detection of abnormal driver behavior requires the driver to wear a specific sensor device, which is expensive to use. It cannot be retrofitted; or the inspector needs to carry out the inspection with a hand-held device, which is labor-intensive; the existing intelligent detectio...

AI Technical Summary

Problems solved by technology

[0002] In recent years, due to the driver's subjective reasons, such as drunk driving, drug driving or emotional instability and other abnormal state of the driver, safety accidents have occurred from time to time, resulting in very serious consequences

For the phenomenon of drunk driving and drug driving, the current conventional practice is to set up checkpoints by the traffic police, which requires a lot of manpower input and is less effective; at present, the detection of abnormal driver behavior requires the driver to wear a specific sensor device, which is expensive to use. It cannot be retrofitted; or the inspector needs to carry out the inspection with a hand-held device, which is labor-intensive; the existing intelligent detection method directly intervenes after detection, and lacks confirmation means. If false alarms occur, it will affect the driving experience of the driver and may also lead to safety the occurrence of the accident