Multi-sensor fusion type fatigue monitoring device system and monitoring method thereof

Abstract

The invention provides a multi-sensor fusion type fatigue monitoring device system and a monitoring method thereof. A camera collects facial features of a monitored driver, and a millimeter-wave radaris used for collecting physiological sign parameters of the monitored driver; a signal processing module judges whether the driver is in a fatigue state through combination of the current physiological sign parameters and facial features of the driver, historical storage data and medical guidance data by virtue of a machine learning algorithm, acquires a judgment result and outputs the judgment result to a warning display module; a data storage module stores identity information of a monitored object, data, collected in the past, of the monitored object and medically accepted universal indexes; and the warning display module displays whether the monitored object is in the fatigue state at present and is capable of giving an alert. The multi-sensor fusion type fatigue monitoring device system can be used for recognizing each monitored object, so that the influence caused by individual sign differences to a detection result is reduced; and by utilizing multi-information fusion detection, the accuracy of the detection result is improved, and false-alarm phenomena are reduced.

Description

technical field [0001] The invention belongs to the application field of digital signal processors, and in particular relates to a multi-sensor fusion fatigue monitoring device system and a monitoring method thereof, which are used for real-time monitoring and early warning of the driver's fatigue state, and real-time monitoring of the driver's fatigue phenomenon during driving. Detect and issue appropriate warnings. Background technique [0002] Fatigue driving is one of the important hidden dangers of today's traffic safety. When the driver is fatigued, his ability to perceive the surrounding environment, the ability to judge the situation and the ability to control the vehicle all decline to varying degrees, so traffic accidents are prone to occur. All over the world, fatigue driving is one of the important factors causing traffic accidents. According to the report of the World Health Organization, the number of deaths in global road traffic accidents is nearly 10,000 e...

AI Technical Summary

Problems solved by technology

[0010] This technology only uses microwave signals to detect the driver's breathing frequency to judge whether it is in a state of fatigue. The detection index used is too monotonous, because the human body's breathing frequency is greatly affected by personal physical fitness, external environment, emotion, and physical state. As a detection indicator, it is easy to form a misjudgment

At the same time, the solution announced in the patent does not specify whether the radio frequency part adopts multi-channel or single-channel working mode. Here, it defaults to single-channel working mode. If single-channel working mode is used, it is easily interfered by the echo signals of other people in the space, and Due to the small chest displacement corresponding to breathing, the single-channel working mode cannot guarantee a high signal-to-noise ratio, and the measurement accuracy is low

Images