Automobile driver fatigue health monitoring system and method thereof
By designing a car driver fatigue health monitoring system that includes perception, decision-making and execution systems, the problem that existing systems cannot achieve multi-data fusion and intelligent control is solved, effectively monitoring and reminding driver fatigue status is achieved, and the risk of traffic accidents is reduced.
Patent Information
- Application Number
- CN202411889890.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-20
- Publication Date
- 2025-03-11
AI Technical Summary
The existing automotive driver fatigue monitoring system cannot achieve multi-data fusion and intelligent control, and cannot effectively protect the driver's safety.
A car driver fatigue health monitoring system including a perception system, a decision-making system and an execution system is designed. The perception system monitors the driver's status through the DMS camera and millimeter wave radar, and the decision system judges the driver's fatigue status through the fatigue judgment module, and performs alarms and fatigue relief measures through the execution system.
Multi-data fusion and intelligent control of driver fatigue status are realized, which can effectively remind drivers to rest and reduce the risk of traffic accidents.
Smart Images

Figure CN119587024A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of automobile technology, and in particular to a vehicle driver fatigue health monitoring system and method thereof. Background Art
[0002] If you continue to drive after being fatigued, you will feel sleepy, weak limbs, inattentive, and have reduced judgment ability, mental confusion, instant memory loss, delayed or premature movements, and pauses in operation, which are unsafe factors that are very likely to cause road accidents. According to a survey by the American Automobile Traffic Safety Foundation, fatigue driving accounts for 21% of traffic accident deaths in the United States, which shows that the proportion of fatigue driving in traffic accidents is very high.
[0003] In response to fatigue driving, a variety of monitoring and warning systems have emerged, which use a variety of sensors and cameras to sense the driver's physiological state. However, the existing systems are unable to achieve multi-data fusion and intelligent control, and cannot effectively protect the driver's safety. Summary of the invention
[0004] In view of the above problems, the purpose of the present invention is to provide a car driver fatigue health monitoring system and method thereof, which are used to monitor the driver's fatigue and distraction state and issue an alarm to overcome the shortcomings of the above-mentioned prior art.
[0005] The present invention provides a vehicle driver fatigue health monitoring system, comprising: a perception system, a decision system, and an execution system;
[0006] The perception system is composed of a DMS camera and a millimeter-wave radar. The DMS camera is installed on the A-pillar or above the rearview mirror or on the steering wheel or instrument panel or the central control position. The millimeter-wave radar is installed on the seat back and is flush with the driver's heart position. The DMS camera is used to obtain the driver's status image to count the eye status and yawn status. The millimeter-wave radar is used to monitor human physiological indicators, including blood pressure, heart rate, breathing and fatigue status.
[0007] The decision-making system includes: a fatigue judgment module, which is used to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued;
[0008] The execution system includes: a display screen control module for linking the infotainment system display screen, a music playing module for linking the execution system sound effects, a seat massage control module for turning on seat massage, and a vibration control module for linking the seat belt vibrator and the steering wheel vibrator;
[0009] When the decision system detects that the driver is in a fatigue state through the perception system, one or more of the following actions are performed through the execution system, including: playing music, seat massage, seat belt vibration, steering wheel vibration, and display screen prompt alarm.
[0010] As a preferred embodiment of the present invention, the fatigue judgment module includes: a fatigue detection module and a fatigue standard judgment module, the fatigue detection module is used to calculate the number of closed eye frames within a period of time (pre-trial time) reaching T1 (TBC), and report moderate fatigue; the number of closed eye frames within a period of time reaches T2 (TBC), and report severe fatigue; the number of yawns within a period of time reaches N (TBC), and report mild fatigue; wherein T1 (TBC) is the moderate fatigue threshold, and T2 (TBC) is the severe fatigue threshold; when the fatigue standard judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and turns on seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to rest;
[0011] As a preferred embodiment of the present invention, the decision system also includes a navigation monitoring module that interacts with the vehicle navigation system. The navigation monitoring module identifies whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the vehicle position and the distance to the destination at this time. When the distance between the vehicle and the destination is greater than or equal to 20km (TBD), and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue signal (including the nearest rest point navigation) for the driver to select the nearest resting place; when the distance between the vehicle and the destination is less than 20km (TBD), and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to send a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue alarm, and pops up the nearest rest point window for the driver to select.
[0012] As a preferred embodiment of the present invention, the decision system further comprises a steering wheel button interaction module that interacts with the vehicle steering wheel buttons, when the nearest rest point window pops up;
[0013] If the driver selects "Yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again during the current driving cycle; and the severe alarm suppression period of 0.5h (TBD) will begin, during which the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the fatigue detection module detects that the driver is in a severe fatigue state again, the severe fatigue alarm is triggered and the nearest rest point window pops up;
[0014] If the driver selects "Wait a moment" through the steering wheel button interaction module, within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm will not be reported during this period. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again;
[0015] If the driver does not make any choice, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met. Within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered; during this period, the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
[0016] As a preferred embodiment of the present invention, when the vehicle is equipped with a support auxiliary judgment system, the decision system also includes a vehicle information acquisition module, which acquires the vehicle's LDW information, steering wheel information, hands-off information, and speed information through the support auxiliary judgment system, wherein the vehicle's LDW information, steering wheel information, hands-off information, and speed information are used as conditions for updating the threshold. When the information counted by the vehicle information acquisition module reaches a preset information threshold, the vehicle information acquisition module updates the fatigue thresholds T1 and T2 of the fatigue judgment module, thereby increasing the number of fatigue alarms.
[0017] As a preferred embodiment of the present invention, the fatigue judgment module also includes a statistical module connected to a mobile phone APP and / or a car central control terminal, and the statistical module is used to continuously count the driver's physical physiological indicators on a daily, weekly and monthly basis, and view the report through the mobile phone APP or the central control terminal.
[0018] Another object of the present invention is to provide a control method for a vehicle driver fatigue health monitoring system, which specifically comprises the following steps:
[0019] Step S1: using the DMS camera of the perception system to obtain the driver's state image to count the eye state and yawn state, and using the millimeter wave radar of the perception system to monitor human physiological indicators, wherein the human physiological indicators include blood pressure, heart rate, breathing and fatigue state;
[0020] Step S2: using the fatigue judgment module of the decision-making system to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued;
[0021] Step S3: When the decision system detects that the driver is in a fatigue state through the perception system, the execution system is used to play music, massage the seat, vibrate the seat belt, vibrate the steering wheel, and display an alarm.
[0022] As a preferred embodiment of the present invention, step S2 also includes the following steps:
[0023] Step S21: using the fatigue detection module of the fatigue judgment module to calculate the number of closed eye frames within a period of time (pre-trial time), when the number of closed eye frames reaches T1 (TBC), reporting moderate fatigue, wherein T1 (TBC) is the moderate fatigue threshold;
[0024] Step S22: using the fatigue detection module of the fatigue judgment module to calculate the number of eye-closing frames within a period of time, and when the number of eye-closing frames reaches T2 (TBC), severe fatigue is reported, wherein T2 (TBC) is a severe fatigue threshold;
[0025] Step S23: using the fatigue detection module of the fatigue judgment module to calculate the number of yawns within a period of time, and when the number of yawns reaches N (TBC), reporting mild fatigue;
[0026] Step S24: When the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and starts seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to rest.
[0027] As a preferred embodiment of the present invention, step S2 also includes the following steps:
[0028] Step 25: The navigation monitoring module of the decision system is used to interact with the vehicle navigation system, and the navigation monitoring module is used to identify whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the current vehicle position and the distance to the destination. When the distance between the vehicle and the destination is greater than or equal to 20 km (TBD), and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue signal (including the nearest rest point navigation) for the driver to select the nearest resting place; when the distance between the vehicle and the destination is less than 20 km (TBD), and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm, and pops up the nearest rest point window for the driver to select.
[0029] As a preferred embodiment of the present invention, step S2 also includes the following steps:
[0030] Step 26: Use the steering wheel button interaction module of the decision system to interact with the vehicle steering wheel buttons. When the nearest rest point window pops up in step S25, if the driver selects "yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again in the current driving cycle, and enter the 0.5h (TBD) severe alarm suppression period, during which the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the fatigue detection module detects that the driver is in a severe fatigue state again, the severe fatigue alarm is triggered and the nearest rest point window pops up. If the driver selects "yes" through the steering wheel button interaction module, the nearest rest point window will pop up. If the module selects "Wait", within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm cannot be reported during this period. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again; if the driver does not make any choice, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met, and within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered; during this period, the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
[0031] The beneficial effects of the present invention are as follows:
[0032] 1. The present invention adds a millimeter-wave radar to monitor human physiological indicators on the basis of DMS camera detection. Compared with contact detection, non-contact millimeter-wave radar has the following advantages: (1) It does not require any electrodes or sensors to contact the human body, thereby realizing non-invasive detection of human vital signs; (2) It avoids applying stimulation to the human body and affecting the accuracy of the detection results; (3) It can detect the human body's breathing and heartbeat signals through a certain medium; (4) It prevents the sensor from falling off the human body and affecting the measurement results.
[0033] 2. The present invention improves the accuracy of fatigue detection and the timeliness of fatigue reminder by setting fatigue judgment standards and updating mechanisms.
[0034] 3. The present invention further improves the accuracy of fatigue reminder by linking with the car's built-in navigation system and steering wheel buttons. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] By referring to the following description in conjunction with the accompanying drawings, and with a more comprehensive understanding of the present invention, other objects and results of the present invention will become more apparent and easy to understand. In the accompanying drawings:
[0036] Figure 1 This is an overall flow chart of the perception system, decision-making system and execution system in this embodiment.
[0037] Figure 2 This is a flow chart of the perception system in this embodiment.
[0038] Figure 3 This is a flowchart of updating the fatigue threshold based on vehicle information in this embodiment.
[0039] Figure 4 This is a flow chart of the linkage between the decision-making system and the execution system in this embodiment. DETAILED DESCRIPTION
[0040] Example 1
[0041] See also Figure 1-4 As shown, a vehicle driver fatigue health monitoring system provided in this embodiment includes: a perception system, a decision system, and an execution system;
[0042] The perception system is composed of a DMS camera and a millimeter-wave radar. The DMS camera is installed on the A-pillar or above the rearview mirror or on the steering wheel or instrument panel or the central control position. The millimeter-wave radar is installed on the seat back and is flush with the driver's heart position. The DMS camera is used to obtain the driver's status image to count the eye status and yawn status. The millimeter-wave radar is used to monitor human physiological indicators, including blood pressure, heart rate, breathing and fatigue status.
[0043] The decision-making system includes: a fatigue judgment module, which is used to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued;
[0044] The execution system includes: a display screen control module for linking the infotainment system display screen, a music playing module for linking the execution system sound effects, a seat massage control module for turning on seat massage, and a vibration control module for linking the seat belt vibrator and the steering wheel vibrator;
[0045] When the decision system detects that the driver is in a fatigue state through the perception system, one or more of the following actions are performed through the execution system, including: playing music, seat massage, seat belt vibration, steering wheel vibration, and display screen prompt alarm.
[0046] Further, the fatigue judgment module in this embodiment includes: a fatigue detection module and a fatigue standard judgment module, the fatigue detection module is used to calculate the number of closed eye frames within a period of time (pre-trial time) reaching T1 (TBC), and report moderate fatigue; the number of closed eye frames within a period of time reaches T2 (TBC), and report severe fatigue; the number of yawns within a period of time reaches N (TBC), and report mild fatigue; wherein T1 (TBC) is the moderate fatigue threshold, and T2 (TBC) is the severe fatigue threshold; when the fatigue standard judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and turns on seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to rest;
[0047] Furthermore, the decision system in this embodiment also includes a navigation monitoring module that interacts with the vehicle navigation system. The navigation monitoring module identifies whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the vehicle position and the distance to the destination at this time. When the distance between the vehicle and the destination is greater than or equal to 20km (TBD), and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue signal (including the nearest rest point navigation) for the driver to select the nearest resting place; when the distance between the vehicle and the destination is less than 20km (TBD), and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm, and pops up the nearest rest point window for the driver to select.
[0048] Furthermore, the decision system in this embodiment further includes a steering wheel button interaction module that interacts with the vehicle steering wheel buttons, when the nearest rest point window pops up;
[0049] If the driver selects "Yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again during the current driving cycle; and the severe alarm suppression period of 0.5h (TBD) will begin, during which the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the fatigue detection module detects that the driver is in a severe fatigue state again, the severe fatigue alarm is triggered and the nearest rest point window pops up;
[0050] If the driver selects "Wait a moment" through the steering wheel button interaction module, within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm will not be reported during this period. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again;
[0051] If the driver does not make any choice, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met. Within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered; during this period, the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
[0052] Furthermore, in this embodiment, when the vehicle is equipped with a support auxiliary judgment system, the decision system also includes a vehicle information acquisition module, and the vehicle information acquisition module acquires the vehicle's LDW information, steering wheel information, hands-off information, and speed information through the support auxiliary judgment system, wherein the vehicle's LDW information, steering wheel information, hands-off information, and speed information are used as conditions for updating the threshold. When the information counted by the vehicle information acquisition module reaches the preset information threshold, the vehicle information acquisition module updates the fatigue thresholds T1 and T2 of the fatigue judgment module, thereby increasing the number of fatigue alarms.
[0053] Furthermore, in this embodiment, the fatigue judgment module also includes a statistical module connected to a mobile phone APP and / or a car central control terminal, and the statistical module is used to continuously count the driver's physical physiological indicators on a daily, weekly, and monthly basis, and view the report through the mobile phone APP or the central control terminal.
[0054] Example 2
[0055] This embodiment provides a control method for a vehicle driver fatigue health monitoring system, which specifically includes the following steps:
[0056] Step S1: using the DMS camera of the perception system to obtain the driver's state image to count the eye state and yawn state, and using the millimeter wave radar of the perception system to monitor human physiological indicators, wherein the human physiological indicators include blood pressure, heart rate, breathing and fatigue state;
[0057] Step S2: using the fatigue judgment module of the decision-making system to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued;
[0058] Step S21: using the fatigue detection module of the fatigue judgment module to calculate the number of closed eye frames within a period of time (pre-trial time), when the number of closed eye frames reaches T1 (TBC), reporting moderate fatigue, wherein T1 (TBC) is the moderate fatigue threshold;
[0059] Step S22: using the fatigue detection module of the fatigue judgment module to calculate the number of eye-closing frames within a period of time, and when the number of eye-closing frames reaches T2 (TBC), severe fatigue is reported, wherein T2 (TBC) is a severe fatigue threshold;
[0060] Step S23: using the fatigue detection module of the fatigue judgment module to calculate the number of yawns within a period of time, and when the number of yawns reaches N (TBC), reporting mild fatigue;
[0061] Step S24: when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and starts seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to take a rest;
[0062] Step 25: The navigation monitoring module of the decision system is used to interact with the vehicle navigation system, and the navigation monitoring module is used to identify whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the current vehicle position and the distance to the destination. When the distance between the vehicle and the destination is greater than or equal to 20 km (TBD), and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue signal (including the nearest rest point navigation) for the driver to select the nearest resting place; when the distance between the vehicle and the destination is less than 20 km (TBD), and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to issue a severe fatigue alarm, and pops up the nearest rest point window for the driver to select.
[0063] Step 26: Use the steering wheel button interaction module of the decision system to interact with the vehicle steering wheel buttons. When the nearest rest point window pops up in step S25, if the driver selects "yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again in the current driving cycle, and enter the 0.5h (TBD) severe alarm suppression period, during which the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the fatigue detection module detects that the driver is in a severe fatigue state again, the severe fatigue alarm is triggered and the nearest rest point window pops up. If the driver selects "yes" through the steering wheel button interaction module, the nearest rest point window will pop up. If the module selects "Wait", within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm cannot be reported during this period. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again; if the driver does not make any choice, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met, and within 0.5h (TBD), the severe fatigue and nearest rest point reminders will not be triggered; during this period, the mild fatigue alarm cannot be reported. After 0.5h (TBD), when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
[0064] Step S3: When the decision system detects that the driver is in a fatigue state through the perception system, the execution system is used to play music, massage the seat, vibrate the seat belt, vibrate the steering wheel, and display an alarm.
[0065] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.
Claims
1. A vehicle driver fatigue health monitoring system, characterized in that: include: Perception system, decision system, and execution system; The perception system is composed of a DMS camera and a millimeter-wave radar. The DMS camera is installed on the A-pillar or above the rearview mirror or on the steering wheel or instrument panel or the central control position. The millimeter-wave radar is installed on the seat back and is flush with the driver's heart position. The DMS camera is used to obtain the driver's status image to count the eye status and yawn status. The millimeter-wave radar is used to monitor human physiological indicators, including blood pressure, heart rate, breathing and fatigue status. The decision-making system includes: a fatigue judgment module, which is used to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued; The execution system includes: a display screen control module for linking the infotainment system display screen, a music playing module for linking the execution system sound effects, a seat massage control module for turning on seat massage, and a vibration control module for linking the seat belt vibrator and the steering wheel vibrator; When the decision system detects that the driver is in a fatigue state through the perception system, one or more of the following actions are performed through the execution system, including: playing music, seat massage, seat belt vibration, steering wheel vibration, and display screen prompt alarm.
2. A vehicle driver fatigue health monitoring system according to claim 1, characterized in that: The fatigue judgment module includes: a fatigue detection module and a fatigue standard judgment module, the fatigue detection module is used to calculate the number of closed eye frames within a period of time to reach T1, and report moderate fatigue; the number of closed eye frames within a period of time reaches T2, and report severe fatigue; the number of yawns within a period of time reaches N, and report mild fatigue; wherein T1 is the moderate fatigue threshold, and T2 is the severe fatigue threshold; when the fatigue standard judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and starts seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to take a rest; 3. The automobile driver fatigue health monitoring system according to claim 1 is characterized in that: The decision system also includes a navigation monitoring module that interacts with the vehicle navigation system. The navigation monitoring module identifies whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the vehicle position and the distance to the destination at this time. When the distance between the vehicle and the destination is greater than or equal to 20km, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue signal for the driver to choose the nearest resting place; when the distance between the vehicle and the destination is less than 20km, and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to send a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue alarm and pops up a nearest rest point window for the driver to choose.
4. A vehicle driver fatigue health monitoring system according to claim 3, characterized in that: The decision system further comprises a steering wheel button interaction module that interacts with the vehicle steering wheel buttons, when a nearest rest point window pops up; If the driver selects "Yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again during the current driving cycle; and the severe alarm suppression period of 0.5 hours will begin, during which the mild fatigue alarm cannot be reported. After 0.5 hours, when the fatigue detection module detects that the driver is in a severe fatigue state again, the severe fatigue alarm will be triggered and the nearest rest point window will pop up; If the driver selects "Wait a moment" through the steering wheel button interaction module, within 0.5 hours, the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm will not be reported during this period. After 0.5 hours, when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again; If the driver does not make any selection, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met. Within 0.5 hours, the severe fatigue and nearest rest point reminders will not be triggered; During this period, the mild fatigue alarm cannot be reported. After 0.5h, when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
5. The automobile driver fatigue health monitoring system according to claim 1 is characterized in that: When the vehicle is equipped with a support auxiliary judgment system, the decision system also includes a vehicle information acquisition module, which acquires the vehicle's LDW information, steering wheel information, hands-off information, and speed information through the support auxiliary judgment system, wherein the vehicle's LDW information, steering wheel information, hands-off information, and speed information are used as conditions for updating the threshold. When the information counted by the vehicle information acquisition module reaches a preset information threshold, the vehicle information acquisition module updates the fatigue thresholds T1 and T2 of the fatigue judgment module, thereby increasing the number of fatigue alarms.
6. The automobile driver fatigue health monitoring system according to claim 2 is characterized in that: The fatigue judgment module also includes a statistical module connected to a mobile phone APP and / or a central control terminal of the car. The statistical module is used to continuously collect statistics on the driver's physical physiological indicators on a daily, weekly, and monthly basis, and view reports through the mobile phone APP or the central control terminal.
7. A control method for a vehicle driver fatigue health monitoring system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step S1: using the DMS camera of the perception system to obtain the driver's state image to count the eye state and yawn state, and using the millimeter wave radar of the perception system to monitor human physiological indicators, wherein the human physiological indicators include blood pressure, heart rate, breathing and fatigue state; Step S2: using the fatigue judgment module of the decision-making system to collect statistics on the driver's eye information and yawn information to determine whether the driver is fatigued; Step S3: When the decision system detects that the driver is in a fatigue state through the perception system, the execution system is used to play music, massage the seat, vibrate the seat belt, vibrate the steering wheel, and display an alarm.
8. The control method of a vehicle driver fatigue health monitoring system according to claim 7, characterized in that: Step S2 also includes the following steps: Step S21: using the fatigue detection module of the fatigue judgment module to calculate the number of eye-closing frames within a period of time, and reporting moderate fatigue when the number of eye-closing frames reaches T1, where T1 is the moderate fatigue threshold; Step S22: using the fatigue detection module of the fatigue judgment module to calculate the number of eye-closing frames within a period of time, and reporting severe fatigue when the number of eye-closing frames reaches T2, where T2 is a severe fatigue threshold; Step S23: using the fatigue detection module of the fatigue judgment module to calculate the number of yawns within a period of time, and when the number of yawns reaches N, reporting mild fatigue; Step S24: When the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is mild fatigue, the control decision system plays music to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is moderate fatigue, the control decision system plays music and starts seat massage to reduce the driver's fatigue level; when the fatigue standard judgment module of the fatigue judgment module detects that the driver's fatigue state is severe fatigue, the control decision system issues a prompt alarm to remind the driver to rest.
9. The control method of a vehicle driver fatigue health monitoring system according to claim 7, characterized in that: Step S2 also includes the following steps: Step 25: The navigation monitoring module of the decision system is used to interact with the vehicle navigation system, and the navigation monitoring module is used to identify whether the vehicle navigation system is turned on. If the driver turns on the navigation after getting on the vehicle, the navigation monitoring module controls the vehicle navigation system to feedback the current vehicle position and the distance to the destination. When the distance between the vehicle and the destination is greater than or equal to 20 km, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue signal for the driver to choose the nearest resting place; when the distance between the vehicle and the destination is less than 20 km, and the fatigue detection module detects that the driver is severely fatigued: the fatigue standard judgment module controls the decision system to send a severe fatigue alarm signal; if the driver does not turn on the navigation after getting on the vehicle, and the fatigue detection module detects that the driver is severely fatigued, the fatigue standard judgment module controls the decision system to send a severe fatigue alarm, and pops up the nearest rest point window for the driver to choose.
10. The control method of a vehicle driver fatigue health monitoring system according to claim 8, characterized in that: Step S2 also includes the following steps: Step 26: Use the steering wheel button interaction module of the decision system to interact with the vehicle steering wheel buttons. When the nearest rest point window pops up in step S25, if the driver selects "yes" through the steering wheel button interaction module, the nearest rest point window will not pop up again in the current driving cycle, and enter a 0.5h severe alarm suppression period, during which no mild fatigue alarm can be reported. After 0.5h, when the fatigue detection module detects that the driver is in a severe fatigue state again, a severe fatigue alarm is triggered and the nearest rest point window pops up. If the driver passes the steering wheel button interaction module, the nearest rest point window will be displayed. Select "Wait" in the dial button interaction module, and within 0.5h, the severe fatigue and nearest rest point reminders will not be triggered, and the mild fatigue alarm cannot be reported during this period. After 0.5h, when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again; if the driver does not make any choice, the nearest rest point navigation window will automatically disappear after the alarm conditions are not met, and within 0.5h, the severe fatigue and nearest rest point reminders will not be triggered; during this period, the mild fatigue alarm cannot be reported. After 0.5h, when the conditions are met, the severe fatigue and nearest rest point reminders will be triggered again.
Citation Information
Cited By
Intelligent feedback regulation and control method for optimizing man-machine interaction experience feeling
CN120469582A
Vehicle-mounted system for improving driving safety and comfort and vehicle
CN120534363A