A vehicle auxiliary system based on condition monitoring and control method thereof

Through self-testing and real-time abnormality judgment of the driver's status monitoring device, combined with vehicle speed control strategy, the misjudgment problem of the driver's status monitoring system is solved, safe and reliable vehicle assisted control is achieved, and driving experience and safety are improved.

CN115320610BActive Publication Date: 2025-08-15ZHENGZHOU YUTONG BUS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110455628.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-26
Publication Date
2025-08-15
Estimated Expiration
2041-04-26

AI Technical Summary

Technical Problem

The existing driver's status monitoring system has misjudgment and leads to false warnings, which affects the driving experience and may lead to vehicle accidents. Vehicle control and driver's status monitoring are independent of them, and there is a lack of a complete safety control strategy.

Method used

By conducting self-testing of the driver's status monitoring device, the driver's early warning status is monitored in real time, the vehicle speed limit is controlled when the abnormality is judged, and the speed limit is lifted when the state returns to normal, the threshold and threshold score are set to judge the abnormality, combined with the vehicle speed adjustment control strategy.

Benefits of technology

Accurately detect the abnormal status of the driver, avoid misjudgment affecting driving experience, improve driving safety, ensure speed limit operation during abnormal times and lift speed limit when normal return to normal, and improve driving experience and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115320610B_ABST
    Figure CN115320610B_ABST
Patent Text Reader

Abstract

The present invention relates to a vehicle auxiliary system based on state monitoring and a control method thereof, and belongs to the field of vehicle safety control technology. The present invention first performs a self-check on the driver state monitoring device to ensure the accuracy of the data related to the driver's warning state outputted by it; then, through the real-time monitoring of the driver's warning reminder state, it is judged whether the driver's state is abnormal. If the number of driver state warnings detected within the set time meets the set conditions, it indicates that the driver's state is abnormal, and the vehicle is controlled to travel according to the set speed limit value. Through the above process, the present invention can accurately detect the abnormal state of the driver, and control the vehicle to run at a limited speed when the driver is in an abnormal state, thereby ensuring the safety of driving, and avoiding the problem of misjudgment of the driver's state affecting the driving experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a vehicle auxiliary system based on state monitoring and a control method thereof, belonging to the technical field of vehicle safety control. Background Art

[0002] Driver status monitoring devices are now widely installed in passenger cars, buses, and commercial vehicles. Most vehicles use a simple warning system based on driver status, prompting drivers to pay attention through sound, to assist with safety. However, a short-term misjudgment by the driver status monitoring system can lead to false warnings, impacting the driving experience. Alternatively, an abnormal driver status may prevent a warning from being effective, potentially leading to a vehicle accident. Currently, there are numerous systems in the industry that monitor driver behavior, but these systems are relatively independent of vehicle control, providing only audible warnings and failing to address false warnings caused by misjudgments. Furthermore, there are no comprehensive and feasible vehicle safety control strategies based on status monitoring. Summary of the Invention

[0003] The purpose of the present invention is to provide a vehicle assistance system based on state monitoring and a control method thereof, so as to solve the problem of false warning caused by misjudgment in vehicle control based on driving behavior.

[0004] In order to solve the above technical problems, the present invention provides a vehicle auxiliary control method based on state monitoring, which includes the following steps:

[0005] 1) Perform self-test on the driver status monitoring device;

[0006] 2) Using the driver status monitoring device to obtain the driver's warning status, determine whether the driver's status is abnormal, and control the vehicle to travel according to the set speed limit if the driver's status is abnormal;

[0007] The abnormal driving state refers to the number of times the driver appears in the warning reminder state within a set period exceeding the first set threshold or exceeding the second set threshold and the score is lower than the set score threshold.

[0008] The present invention first performs a self-check on the driver status monitoring device to ensure the accuracy of its output data related to the driver's warning status. It then uses the real-time monitored driver warning status to determine whether the driver's status is abnormal. If the number of driver status warnings detected within a set time meets the set conditions, it indicates that the driver's status is abnormal, and the vehicle is controlled to travel at the set speed limit. Through this process, the present invention can accurately detect abnormal driver status and control the vehicle to operate at a limited speed when the driver is in an abnormal state, ensuring driving safety while avoiding the problem of misjudgment of driver status affecting the driving experience.

[0009] Furthermore, in order to promptly release the speed limit state and improve the driving experience, the method also includes controlling the vehicle to return from the speed limit state to the normal speed state when the driver's state returns to normal from abnormality.

[0010] Furthermore, in order to improve the safety of vehicle control, if the duration of the abnormal driver state exceeds a set value, the vehicle is controlled to stop.

[0011] Furthermore, in order to improve the accuracy of driver status judgment, the first set threshold, the second set threshold and the set score threshold are all related to the vehicle speed.

[0012] Furthermore, in order to comprehensively detect the driver's warning reminder status, the warning reminder status includes the driver looking around, smoking, making a phone call, yawning, fatigue, closing eyes, and looking down at the phone. If the duration of any warning reminder status exceeds the set time, a status warning will be issued and the corresponding score value will be deducted.

[0013] The present invention also provides a vehicle assistance system based on state monitoring, which includes a driver state monitoring device and a control strategy calculation unit device;

[0014] The state monitoring device is used to obtain the driver's warning status and send the result to the control strategy calculation unit device. The driver state monitoring device needs to perform a self-check before use;

[0015] The control strategy calculation unit device is used to determine whether the driver's state is abnormal based on the received driver's warning reminder state, and when the driver's state is abnormal, control the vehicle to travel according to the set speed limit; the abnormal driving state refers to the number of times the driver's warning reminder state appears within a set period exceeding the first set threshold or exceeding the second set threshold and the score is lower than the set score threshold.

[0016] The present invention first performs a self-check on the driver status monitoring device to ensure the accuracy of its output data related to the driver's warning status. It then uses the real-time monitored driver warning status to determine whether the driver's status is abnormal. If the number of driver status warnings detected within a set time meets the set conditions, it indicates that the driver's status is abnormal, and the vehicle is controlled to travel at the set speed limit. Through this process, the present invention can accurately detect abnormal driver status and control the vehicle to operate at a limited speed when the driver is in an abnormal state, ensuring driving safety while avoiding the problem of misjudgment of driver status affecting the driving experience.

[0017] Furthermore, in order to release the speed limit state in time and improve the driving experience, the control strategy calculation unit device is also used to control the vehicle to return from the speed limit state to the normal speed state when the driver's state returns to normal from abnormal.

[0018] Furthermore, in order to improve the safety of vehicle control, when the control strategy calculation unit device determines that the duration of the abnormal driver state exceeds a set value, the vehicle is controlled to stop.

[0019] Furthermore, in order to promptly alert the driver, the system also includes a reminder device for reminding when the driver status monitoring device detects the driver's early warning status and / or the control strategy calculation unit device determines that the driver's status is abnormal.

[0020] Furthermore, in order to comprehensively detect the driver's warning reminder status, the warning reminder status includes the driver looking around, smoking, making a phone call, yawning, fatigue, closing eyes, and looking down at the phone. If the duration of any warning reminder status exceeds the set time, a status warning will be issued and the corresponding score value will be deducted. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a flow chart of a vehicle auxiliary control method based on condition monitoring of the present invention;

[0022] Figure 2 It is an architectural block diagram of the vehicle assistance system based on condition monitoring of the present invention. DETAILED DESCRIPTION

[0023] The specific embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0024] System Example

[0025] The vehicle auxiliary system based on condition monitoring of the present invention is as follows Figure 2As shown, it includes a driver status monitoring device, a control strategy calculation unit device, a sound reminder device, and a display reminder device. Each device communicates with each other through a bus, and the bus here can be a CAN bus. The driver status monitoring device can be a DMS device, a face recognition device, an image recognition processing device, etc., which is used to obtain the driver's warning reminder status, including looking around, smoking, making a phone call, yawning, fatigue, closing eyes, looking down at the phone, etc.; the control strategy calculation unit device can be a microprocessor MCU, a programmable logic device FPGA, etc., which is used to perform statistical analysis on the driver's warning reminder status, determine whether the driver's status is abnormal, and control the vehicle to limit the speed when abnormal; the sound reminder device can be a voice central control, a voice announcer or other speakers, etc., which is used to play the problems that cause the driver's status to be abnormal; the display reminder device can be a full LCD instrument, an integrated central control screen or other display devices, etc., which is used to display the problems that cause the driver's status to be abnormal. The specific workflow of the system is as follows Figure 2 As shown, the specific working steps will be described in detail in the method embodiment.

[0026] Method Example

[0027] The vehicle auxiliary control method based on state monitoring of the present invention monitors the driver's warning state in real time. If the number of driver status warnings detected reaches a set value within a set time, the vehicle is controlled to travel according to the set speed limit value and an abnormal driving behavior reminder is issued; and after the driver's state is restored, the corresponding speed limit is lifted and the vehicle speed is restored to the state set before the speed limit. The specific process of this method is as follows Figure 1 As shown, the specific process is as follows.

[0028] 1. Perform a self-check on the driver status monitoring device.

[0029] The driver status monitoring device of the present invention is used to monitor the driver's status and issue an early warning reminder when an abnormal state occurs, wherein the early warning reminder states of the driver status monitoring device include looking around, smoking, making a phone call, yawning, fatigue, closing eyes, looking down at the phone, etc. Before using the data of the driver monitoring device, it is necessary to perform a self-inspection on the driver monitoring device itself to determine whether it can work normally. If the configured driver monitoring device is abnormal, the sound reminder device will prompt: Safety assistance system is limited (only remind once); the display reminder device will text prompt: Driver status monitoring device is abnormal, please repair.

[0030] 2. Use the driver status monitoring device to obtain the driver's warning status, determine whether the driver's status is abnormal, and control the vehicle speed limit when the driver's status is abnormal.

[0031] The warning and reminder states that can be obtained by the driver status monitoring device of the present invention include looking around, smoking, making phone calls, yawning, fatigue, closing eyes, looking down at the phone, etc. The monitoring trigger condition duration T0 = 5s, and the single point deduction value can be 0.5, 1, 2, etc. according to the severity. The timing period is determined according to the actual situation. For example, the timing period can be T = 1min, T1 = 10min, T2 = 3min. The types of driver status monitoring behaviors and evaluation methods are shown in Table 1.

[0032] Table 1

[0033]

[0034] Continuously output the types of driver status monitoring behaviors, and count whether there are status warnings F continuously within the T0 time. If they are continuous, the warning factors will be broadcast through the sound reminder device. The number of status warnings and the corresponding scores within the statistical period are counted. If the corresponding threshold is exceeded, it indicates that the driver's status is abnormal. In order to achieve more accurate vehicle control, the influence of vehicle speed is considered when judging the abnormal driver status. Different vehicle speeds have different corresponding thresholds. For example, in this embodiment, if V1Km / h≤vehicle speed≤V2Km / h, the number of status warnings within the T1 cycle timing is set to C1, C2 and the corresponding score value is Num1; when the vehicle speed is greater than V2Km / h, the number of status warnings within the T2 cycle timing is set to C3, C4 and the corresponding score value is Num2. As another embodiment, the present invention divides the vehicle speed into multiple segments. If V1 km / h ≤ vehicle speed ≤ V2 km / h, and the number of status warnings within T1 exceeds C1 or exceeds C2 and the score is lower than Num1, it indicates that the driver's state is abnormal. In this case, the speed is limited and the vehicle is controlled to travel at the set speed limit V_limit km / h. If the vehicle speed is greater than V2 km / h, and the number of status warnings within T2 exceeds C3 or exceeds C4 and the score is lower than Num2, it indicates that the driver's state is abnormal. In this case, the speed is limited and the vehicle is controlled to travel at the set speed limit V_limit km / h. When the actual speed is ≤ V_limit km / h, the vehicle will travel at the actual speed regardless of whether the driver's state is abnormal. Among them, C1=K1 / V_max, C2=K2 / V_max, C3=K3 / V_max, C4=K4 / V_max, V_max is the maximum operating speed, K1, K2, K3, K4 are proportional coefficients, and the value range is (0, 1200), and K1>K2>K3>K4; the value range of Num1 and Num2 is 50-70 minutes.

[0035] 3. When it is determined that the driver's condition has recovered, the vehicle speed limit is lifted.

[0036] In order to promptly lift the vehicle speed limit when the driver's condition returns to normal, the present invention re-times the T cycle and counts whether there are continuous status warnings within the T time. If the driver's condition is restored, the corresponding speed limit is lifted, and the vehicle speed is restored to the state set before the speed limit. A voice reminder device is used to prompt: the driving behavior is good, and the vehicle speed limit is lifted (only announced once); a text reminder is used to display the reason for lifting the speed limit: the driving behavior is restored, and the vehicle speed limit is lifted.

[0037] To further ensure driving safety, if there is a status warning (abnormal driver status) within two consecutive timing periods T, the vehicle will be controlled to stop safely, and a voice reminder will be given through the device: abnormal driving behavior, the vehicle will stop safely (only announced once); a text reminder will be displayed on the reminder device indicating the reason for lifting the speed limit: abnormal driving behavior, the vehicle will stop safely.

Claims

1. A vehicle auxiliary control method based on state monitoring, characterized in that: The control method comprises the following steps: 1) Perform self-test on the driver status monitoring device; 2) Utilize the driver status monitoring device to obtain the driver's warning status, count the number of warning statuses and the corresponding scores within a set period, and determine whether the driver's status is abnormal. When the number of warning statuses that occur within the set period exceeds a first set threshold or exceeds a second set threshold and the score is lower than a set score threshold, the driver's status is determined to be abnormal, and the vehicle is controlled to travel at a set speed limit, where the first set threshold is greater than the second set threshold. The single point deduction value for each warning status is set according to the severity.

2. The vehicle auxiliary control method based on condition monitoring according to claim 1, characterized in that: The method also includes controlling the vehicle to return from a speed-limited state to a normal speed state when the driver's state returns to normal.

3. The vehicle auxiliary control method based on condition monitoring according to claim 1, characterized in that: If the duration of the driver's abnormal state exceeds the set value, the vehicle will be controlled to stop.

4. The vehicle auxiliary control method based on condition monitoring according to claim 1, characterized in that: The first set threshold, the second set threshold and the set score threshold are all related to the vehicle speed.

5. The vehicle auxiliary control method based on condition monitoring according to any one of claims 1 to 4, characterized in that: The warning reminder status includes the driver looking around, smoking, talking on the phone, yawning, fatigue, closing eyes, and looking down at the phone. If any warning reminder status lasts for more than the set time, a status warning will be issued and the corresponding score will be deducted.

6. A vehicle assistance system based on condition monitoring, characterized in that: The auxiliary system includes a driver status monitoring device and a control strategy calculation unit device; The state monitoring device is used to obtain the driver's warning status and send the result to the control strategy calculation unit device. The driver state monitoring device needs to perform a self-check before use; The control strategy calculation unit device is used to count the number of warning reminder states and the corresponding scores within a set period based on the received driver's warning reminder status, and judge whether the driver's status is abnormal. When the number of warning reminder states of the driver within the set period exceeds the first set threshold or exceeds the second set threshold and the score is lower than the set score threshold, the driver's status is judged to be abnormal, and the vehicle is controlled to travel at the set speed limit, wherein the first set threshold is greater than the second set threshold, and the single point deduction value for each warning reminder status is set according to the severity.

7. The vehicle assistance system based on condition monitoring according to claim 6, characterized in that: The control strategy calculation unit device is also used to control the vehicle to return from the speed limit state to the normal speed state when the driver's state returns to normal from abnormal.

8. The vehicle assistance system based on condition monitoring according to claim 6, characterized in that: When the control strategy calculation unit device determines that the duration of the abnormal driver state exceeds the set value, the vehicle is controlled to stop.

9. The vehicle assistance system based on condition monitoring according to claim 6, characterized in that: The system also includes a reminder device for reminding when the driver status monitoring device detects the driver's early warning reminder state and / or the control strategy calculation unit device determines that the driver's state is abnormal.

10. The vehicle assistance system based on condition monitoring according to any one of claims 6 to 9, characterized in that: The warning reminder status includes the driver looking around, smoking, talking on the phone, yawning, fatigue, closing eyes, and looking down at the phone. If any warning reminder status lasts for more than the set time, a status warning will be issued and the corresponding score will be deducted.

Citation Information

Patent Citations

  • Driver fatigue driving judgment method, storage medium and electronic device

    CN109191788A

  • Driver state detection system based on millimeter-wave radar and camera fusion and vehicle

    CN112220480A