The invention discloses a driver fatigue
state recognition method based on a multi-
modal recognition technology, and relates to the technical field of driver fatigue
state recognition, and the method comprises the following steps: setting an initial low-frequency
frame rate, continuously capturing a face image of a driver through a camera, and obtaining continuous image data of the face of the driver; a basis is provided for subsequent
eyelid motion
feature extraction and analysis; an
image processing technology is utilized to extract
eyelid motion features of a driver from a captured facial image, and the extracted
eyelid motion features are deeply analyzed. Fatigue coefficients are generated through eyelid motion feature analysis and
machine learning, the fatigue state of a driver is effectively monitored at a low
frame rate, after potential fatigue is recognized, the
system automatically improves the
frame rate and enhances data precision and detection sensitivity, then
detailed data are comprehensively analyzed, the fatigue state is classified, early warning is given out for continuous fatigue, and the driver fatigue state is effectively monitored. Therefore, the early warning accuracy and the overall traffic safety are improved.