Safety warning method, storage medium and system based on driver's physiological information

Through the comprehensive judgment and response system of the smart bracelet and the vehicle center console, the problem of insufficient early warning and singularity of fatigue detection in the existing technology is solved, and the consideration of individual driver differences and environmental impacts is achieved, and driver safety is improved. and emergency treatment in unexpected situations.

CN116013032BActive Publication Date: 2024-11-26CATARC AUTOMOTIVE TEST CENT (KUNMING) CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202211501672.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-28
Publication Date
2024-11-26
Estimated Expiration
2042-11-28

AI Technical Summary

Technical Problem

The prior art has insufficient early warning in fatigue driving detection, single detection methods, ignoring individual differences, focusing only on the driver's driving status without considering environmental impact, and failing to effectively prevent drunk driving and driver accidents.

Method used

Through the smart bracelet, the driver's personalized physiological information and physical movement records are collected, combined with the logical judgment of the on-board center console, the judgment and response of four situations: drunk driving, sleepiness, fatigue and accidents are realized, including voice reminders and bracelets. Multi-level reminder methods such as vibration and vehicle speed limit, and emergency parking is carried out when necessary.

Benefits of technology

The consideration of individual driver differences is achieved, early warning of fatigue and drunk driving, combined with vehicle control, improve driver safety, consider the impact of the environment on the driver, and emergency treatment is carried out in unexpected situations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116013032B_ABST
    Figure CN116013032B_ABST
Patent Text Reader

Abstract

The present invention discloses a safety warning method, storage medium and system based on the physiological information of the driver. The method collects the driver's personal physiological information through a smart bracelet, uses the vehicle-mounted central console to perform corresponding logical judgments, and finally performs corresponding judgments and response processing on the driver according to drunk driving, drowsiness, fatigue and unexpected situations. The present invention uses a 4-hour cumulative heart rate fatigue judgment method, a method for judging drunk driving without exercise but with a high heart rate and logical judgment questions, and an emergency stop warning light that analyzes fatigue and an unexpected heart rate of zero by considering the driver's state before driving. It can limit the vehicle speed when fatigued, and judge whether the driver is driving by the distance difference after getting on the car after drinking, so as to achieve scientific and reasonable road driving safety warning.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of road driving safety, and in particular to a safety warning method, storage medium and system based on driver's physiological information. Background Art

[0002] By the end of March 2022, the number of motor vehicles in China reached 402 million, and traffic accidents were also on the rise. Fatigue driving has become the main hidden danger of traffic accidents. According to a survey of heavy truck drivers, the proportion of traffic accidents caused by fatigue driving is as high as 73%. Therefore, the early warning system for fatigue driving is of great significance for preventing traffic accidents. From a physiological point of view, due to the influence of human body rhythm, it is easy to fall asleep while driving in the early morning, at night and in the afternoon. Even if the continuous driving time is within the legally prescribed 4 hours, the driver will feel sleepy due to the influence of physiological rhythm.

[0003] In the prior art, fatigue driving detection is mainly based on the driver's physiological indicators such as facial features, heart rate and eye signals, and the detection methods are mainly divided into contact and non-contact.

[0004] Non-contact fatigue detection uses facial features, eye signals and head movements to judge the driver's fatigue status. First, this method is easily affected by light and weather. Second, the driver cannot wear masks, glasses and other obstructions. Third, the cost is relatively high.

[0005] The contact type uses physiological information such as electroencephalogram, electrocardiogram, breathing, and skin electricity to judge fatigue indicators. This directly obtained physiological signal is more accurate and reliable; but it can only be detected after the driver is tired and cannot provide early warning, which poses a safety hazard. In addition, when people are tired, they have an inaccurate sense of their own physiological state, so the driver needs to be reminded when he is on the edge of fatigue.

[0006] Drunk driving causes many safety accidents. The only way to check for drunk driving is by setting up traffic police checkpoints. However, this is already on the verge of danger, and this method is time-consuming and requires a lot of manpower and material resources. Judgment should be made before driving.

[0007] There are currently few relevant technologies to protect passengers from the impact of driver death due to personal illnesses, such as cerebral infarction, heart disease, etc., or external accidents such as flying rocks.

[0008] In summary, the defects and shortcomings of the prior art mainly include:

[0009] (1) All fatigue detection methods can detect fatigue only after the driver is fatigued. At this point, there is already a safety hazard. It is necessary to start reminding the driver when the driver is about to reach the critical point of fatigue;

[0010] (2) The detection method is relatively simple and ignores the individual differences of drivers;

[0011] (3) Only fatigue detection is considered, and the reminder methods after fatigue are few and simple;

[0012] (4) It only considers the driver's state while driving, but does not fully consider the driver's state before driving;

[0013] (5) For operating vehicles, the Ministry of Transport requires a mandatory rest period of more than 20 minutes after every four hours of driving. However, this does not take into account the impact of the environment on drivers. For example, in the southwestern plateau and mountainous areas, the altitude is high and the oxygen content is low. The complex mountain roads make it easier to get tired when driving. There is a difference between driving for four hours in the plateau and mountainous areas and in the plains. Summary of the invention

[0014] The purpose of the present invention is to overcome the above-mentioned shortcomings and provide a safety warning method, storage medium and system based on the driver's physiological information. The method requires the driver to wear a smart bracelet, which collects the driver's personal physiological information, body movement records and current heart rate, and uses the vehicle-mounted central console to perform corresponding logical judgments. Finally, the driver is judged and responded to according to four situations of drunk driving, drowsiness, fatigue and accidents, specifically including:

[0015] (1) Collect the driver's personalized resting heart rate, light sleep heart rate, deep sleep heart rate and blood oxygen saturation through the smart bracelet to generate the driver's personal physiological information;

[0016] (2) Judgment and response to drunk driving

[0017] The smart bracelet collects the driver's physical activity records and current heart rate to distinguish whether the driver's heart rate rises due to exercise or drinking. If the driver is sitting still and the physical activity records do not show that he is exercising, but his current heart rate exceeds his resting heart rate, and his current heart rate continues to be higher than the normal resting heart rate for a long time, he may be drinking. At this time, the vehicle's central console automatically calls the family number set by the driver to judge the driver's condition through his family.

[0018] (3) Identification and response to drowsiness

[0019] (a) less than 6 hours of sleep in 24 hours;

[0020] (b) The heart rate is close to the sleeping heart rate half an hour before getting in the car, and the car console issues a voice reminder of drowsiness when getting in the car and then goes to (c); or: The heart rate is close to the sleeping heart rate while driving, and the car console issues a voice reminder of drowsiness and then goes to (c);

[0021] (c) When the heart rate approaches the sleeping heart rate for the first time, the bracelet will vibrate to remind you, and the driver needs to press the stop button;

[0022] (d) As the heart rate approaches the sleeping heart rate, the vehicle starts to be limited to 70 km / h, and the wristband vibrates until the vehicle stops.

[0023] (4) Determination and response to fatigue

[0024] (a) The heart rate is normal and the patient has slept for at least 6 hours in 24 hours before driving;

[0025] (b) When the cumulative heart rate during driving reaches 90% of the resting heart rate for 4 hours, it is judged as fatigue;

[0026] (c) Voice and vibration reminders will start, and music will automatically play. If the vehicle continues to drive and the accumulated heart rate reaches the 4-hour resting heart rate, the vehicle will start to be limited to 70 km / h until it stops;

[0027] (5) Judgment and response to unexpected situations

[0028] When the bracelet detects that the driver's heart rate is zero and the blood oxygen level drops rapidly, it determines that an accident has occurred. The car is stopped immediately and the vehicle's center console automatically calls the set alarm number.

[0029] Furthermore, the (2) determination and response of drunk driving also includes:

[0030] (a) The patient has an abnormal heart rate before driving and has slept for at least 6 hours within 24 hours;

[0031] (b) no exercise in the hours before boarding;

[0032] (c) If the heart rate is between 1.2 and 1.4 times the individual's resting heart rate, the vehicle console will ask three logic questions for judgment. If the answer is correct, the process will be terminated. Otherwise, the family members will be called;

[0033] (d) If the heart rate is greater than 1.4 times the individual's resting heart rate, call the family.

[0034] Furthermore, in the (3) drowsiness judgment and response, the (c) first time the heart rate approaches the sleeping heart rate, the vibration interval of the bracelet vibration reminder is 2 minutes, for a total of three times.

[0035] Furthermore, in the (3) drowsiness judgment and response, the (d) adopts the following method: within the next 20 minutes, the vehicle continues to approach the sleeping heart rate, the vehicle starts to be limited to 70km / h, and the wristband vibrates until the vehicle stops.

[0036] Furthermore, the (5) judgment and response to unexpected situations also includes:

[0037] The heart rate is zero and the blood oxygen level drops rapidly. The bracelet vibrates for 3s and twice to determine whether it has been stopped. If so, the accident is cancelled. Otherwise, the bracelet connects to the car's central console to start voice prompts for 3s and turn on the vehicle's double flashes to further determine whether it has been stopped. If so, the accident is cancelled and the car is stopped immediately. The car's central console automatically calls the set alarm number.

[0038] According to a second aspect of the present invention, the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the steps of the safety warning method based on driver physiological information of the present invention.

[0039] According to the third aspect of the present invention, the present invention also provides a safety warning system based on the driver's physiological information, the system comprising a smart bracelet worn on the driver's wrist, a vehicle-mounted central console and a vehicle-mounted smart phone, the smart bracelet, the vehicle-mounted smart phone and the vehicle-mounted central console communicate via Bluetooth, and the vehicle-mounted central console has a built-in computer-readable storage medium that implements the safety warning method based on the driver's physiological information of the present invention.

[0040] Beneficial effects of the present invention:

[0041] (1) This method takes full account of the individual conditions of the driver and formulates a personalized fatigue limit value;

[0042] (2) This method uses a hierarchical approach to remind drivers, and has settings for both people and vehicles. First, sound and vibration are used to remind the driver, and then combined with vehicle control, if the driver does not rest after the reminder, the speed of the vehicle will be limited to 70 km / h. For judgment and reminder of drunk driving, a family number is called to let the family judge whether the driver is drunk and remind the driver;

[0043] (3) This method comprehensively considers the driver's status before and during driving to better provide fatigue warning. This method also considers the situation where the driver suddenly encounters an accident during driving, in which case the vehicle can make an emergency stop. This method uses the driver's 4-hour resting heart rate as the fatigue warning value, which can more comprehensively consider the impact of the environment on the driver. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 : Overall flow chart of the method of the present invention.

[0045] Figure 2 : Schematic diagram of the judgment and response processing of drunk driving of the present invention.

[0046] Figure 3 : Schematic diagram of the judgment and response processing of drowsiness of the present invention.

[0047] Figure 4: Schematic diagram of fatigue judgment and response processing of the present invention.

[0048] Figure 5 : Schematic diagram of the judgment and response processing of unexpected situations of the present invention. DETAILED DESCRIPTION

[0049] The present invention is described in detail below with reference to the accompanying drawings.

[0050] like Figure 1-5 As shown, a road driving safety warning system based on driver's physiological information includes:

[0051] 1. Collect the driver's personalized resting heart rate, light sleep heart rate, deep sleep heart rate and blood oxygen saturation through the smart bracelet to generate the driver's personal physiological information.

[0052] 2. Judgment and response to drunk driving

[0053] The physiological effects of drunkenness include decreased vision, narrowed field of vision, dulling and imbalance of various senses, and unstable movements. Drinking has a greater impact on the psychological and mental aspects, paralyzing rationality, distracting attention, reducing information processing capabilities, and reducing the accuracy of judgment, which will seriously affect driving safety. After drinking, most of the alcohol is absorbed in the stomach. The stimulation of alcohol can cause the heart rate to speed up. Generally speaking, the heart rate after drinking is around 100 beats / minute. Based on this principle, the actigraphy recorder and heart rate monitor in the smart bracelet can be used to distinguish whether the driver's heart rate increases due to exercise or drinking. If the driver is in a sitting state, the actigraphy recorder does not judge his movement, but his heart rate exceeds his resting heart rate, and his heart rate is higher than the normal resting heart rate for a long time, so he is considered to be drinking.

[0054] When getting in the car, the bracelet transmits the sleep status within 20 hours and the heart rate information within the past 3 hours to the vehicle center console via Bluetooth. The Bluetooth distance between the driver's bracelet and the center console is used to determine whether the driver is drunk (drunk people are prohibited from sitting in the front row for driving safety). After getting in the car, the program will be triggered if the distance between the driver's bracelet and the vehicle center console is within 1 meter. If the center console finds that the driver's heart rate is within 1.2-1.4 times the resting heart rate (normal heart rate is 55-70 beats / minute, 1.2-1.4 times is 77-98 beats / minute), the vehicle center console will display 3 simple logic questions to determine the driver's status. If there is an error in the judgment within the specified time, the family number set by the driver will be called to determine the driver's status through family members, and the system will not intervene; if it is greater than 1.4 times the resting heart rate, the family number set by the driver will be directly called.

[0055] The system only makes a preliminary judgment, judging the usual drinking behavior and corresponding physiological characteristics, and cannot include all drinking characteristics of drivers. After the preliminary physiological information is judged, a simple logical judgment is made on the driver. The logical judgment is a test of the driver's reaction, and the driver may also guess and miss the alarm. Finally, the final judgment is made by a close person. This method can judge most common drinking methods, but there are still some errors.

[0056] 3. Judgment and response to fatigue and drowsiness

[0057] After a healthy person drives for two hours continuously, the result of continuously processing traffic information is that the brain oxygen decreases, the central nervous system fatigues, the senses become dull, the perception weakens, and the function of regulating muscle contraction declines. If the car continues to drive, the nerve center will automatically block the "sensory stimulation" to protect itself. As a result, the driver's attention becomes scattered, and he is unwilling to do troublesome actions and omit regular operation. This process is not produced consciously, and the better the health of the driver, the more this situation will occur, even to the point that the driver takes a nap while driving. There are many traffic accidents caused by fatigue. The Ministry of Transportation requires that after driving for 4 hours, a mandatory rest of more than 20 minutes is required, but the degree of fatigue is different when driving on the plains and in the plateau mountains for 4 hours. From a physiological point of view, hypoxia has many effects on the human body. In addition to the nervous system, after entering the plateau from the plains, the heart rate will increase, blood pressure will fluctuate, and the blood oxygen saturation will decrease. When the blood oxygen saturation is below 92%, the body will show obvious hypoxia reaction. The decrease in blood oxygen saturation will cause reflex reactions such as increased respiratory rate and increased maximum expiratory volume to weaken the trend of decreased blood oxygen saturation. Arterial oxygen saturation and heart rate are objective evaluation indicators of human labor capacity in plateaus. Blood oxygen saturation reflects the body's oxygen supply, and heart rate is significantly positively correlated with oxygen consumption.

[0058] Here we propose a 4-hour resting heart rate method to measure the impact of the environment on the driver's fatigue. This method takes into account the impact of the external environment on the driver's fatigue, which is more comprehensive and scientific than simply forcing the driver to stop and rest after 4 hours of driving. At the same time, the driver's state before driving is also taken into account, and the driver's sleep time within 24 hours will be synchronized to prevent fatigue before driving. The specific logic is that if the driver sleeps less than 6 hours in 24 hours, and the heart rate is close to the sleeping heart rate half an hour before driving, (to avoid the driver just moving the car) only voice reminders are made; when driving, the bracelet vibrates for the first time when it is close to the sleeping heart rate, and vibrates once every 2 minutes, a total of three times. The driver needs to press stop, and music will play automatically; in the next 20 minutes, if it continues to approach the sleeping heart rate, the vehicle will start to limit the speed to 70km / h, and the bracelet will vibrate until it stops. If the driver sleeps for more than 6 hours within 24 hours and the driver's heart rate is normal, it means that the driver is in good condition before driving and directly enters the fatigue logic judgment. When the cumulative heart rate during driving reaches 90% of the 4-hour resting heart rate, the system starts voice, the bracelet vibrates twice and automatically plays music. If the driver continues to drive, the cumulative heart rate reaches the 4-hour resting heart rate, and the vehicle starts to limit the speed to 70km / h until it stops.

[0059] 3. Judgment and response to unexpected situations

[0060] The driver's death due to himself or an accident will affect the safety of passengers and traffic. When the wristband detects that the driver's heart rate is zero and the blood oxygen level drops rapidly, the system determines that an accident has occurred. At this time, the wristband vibrates twice for 3 seconds. If the driver presses the stop button, the program is canceled. If the driver does not respond, the voice prompt starts for 3 seconds when connected to the vehicle's central control. The vehicle turns on the double flash. If the driver presses the stop button, the program is canceled, otherwise the vehicle stops.

Claims

1. A safety warning method based on driver's physiological information, characterized in that: The method requires the driver to wear a smart bracelet, which collects the driver's personal physiological information, body movement records and current heart rate, and uses the vehicle-mounted central console to make corresponding logical judgments. Finally, the driver is judged and responded to according to four situations: drunk driving, drowsiness, fatigue and accidents. Specifically, it includes: (1) Collect the driver’s personalized resting heart rate, light sleep heart rate, deep sleep heart rate and blood oxygen saturation through the smart bracelet to generate the driver’s personal physiological information; (2) Judgment and response to drunk driving The smart bracelet collects the driver's physical activity records and current heart rate to distinguish whether the driver's heart rate rises due to exercise or drinking. If the driver is sitting still and the physical activity records do not show that he is exercising, but his current heart rate exceeds his resting heart rate, and his current heart rate continues to be higher than the normal resting heart rate for a long time, he may be drinking. At this time, the vehicle's central console automatically calls the family number set by the driver to judge the driver's status through his family. This includes: (a) The patient has an abnormal heart rate before driving and has slept for at least 6 hours within 24 hours; (b) no exercise in the hours before boarding; (c) If the heart rate is between 1.2 and 1.4 times the individual's resting heart rate, the vehicle's central console will ask three logic questions for judgment. If the answer is correct, the process will be terminated. Otherwise, a call will be made to the family members; (d) If the heart rate is greater than 1.4 times the individual's resting heart rate, a family member will be called; (3) Determining and responding to drowsiness (a) less than 6 hours of sleep in 24 hours; (b) The heart rate is close to the sleeping heart rate half an hour before getting in the car, and the car console issues a voice reminder of drowsiness when getting in the car, and then the car switches to (c); or: The heart rate is close to the sleeping heart rate while driving, and the car console issues a voice reminder of drowsiness, and then the car switches to (c); (c) The wristband will vibrate to remind you when your heart rate approaches the sleeping heart rate for the first time, and the driver needs to press the stop button; the wristband will vibrate to remind you when your heart rate approaches the sleeping heart rate for the first time, with an interval of 2 minutes, for a total of three times; (d) If the heart rate continues to approach the sleeping heart rate, the vehicle will start to be limited to 70 km / h, and the wristband will vibrate until the vehicle stops. In the next 20 minutes, if the heart rate continues to approach the sleeping heart rate, the vehicle will start to be limited to 70 km / h, and the wristband will vibrate until the vehicle stops. (4) Judgment and response to fatigue (a) The heart rate is normal and the driver has slept for at least 6 hours in the past 24 hours before driving; (b) When the cumulative heart rate during driving reaches 90% of the resting heart rate for 4 hours, it is judged as fatigue; (c) Voice and vibration reminders will start, and music will automatically play. If the vehicle continues to drive and the accumulated heart rate reaches the 4-hour resting heart rate, the vehicle will start to be limited to 70 km / h until it stops; (5) Judgment and response to unexpected situations When the wristband detects that the driver's heart rate is zero and the blood oxygen level drops rapidly, it is determined that an accident has occurred. At this time, the vehicle stops immediately and the vehicle's central console automatically dials the set alarm number; including: The heart rate is zero and the blood oxygen level drops rapidly. The bracelet vibrates for 3s and twice to determine whether it has been stopped. If so, the accident is cancelled. Otherwise, the bracelet connects to the car's central console to start voice prompts for 3s and turn on the vehicle's double flashes to further determine whether it has been stopped. If so, the accident is cancelled and the car is stopped immediately. The car's central console automatically calls the set alarm number.

2. A computer-readable storage medium having a computer program stored thereon, characterized in that: The computer program can be executed by a processor to implement the steps of the safety warning method based on driver physiological information as claimed in claim 1.

3. A safety warning system based on driver's physiological information, characterized in that: The system includes a smart bracelet worn on the driver's wrist, a vehicle-mounted central console and a vehicle-mounted smart phone. The smart bracelet, vehicle-mounted smart phone and vehicle-mounted central console communicate via Bluetooth, and the vehicle-mounted central console is built-in with the computer-readable storage medium as described in claim 2.

Citation Information

Patent Citations

  • Driver physiological status monitoring and responding system and method

    CN104966382A

  • Fatigue driving and drunk driving monitoring and warning system

    CN106600894A

  • Driving fatigue reminding bracelet with intelligent physiological fatigue detection function

    CN109044296A

  • Fatigue driving early warning system and method based on physiological information analysis

    CN110930641A

  • Vehicle-mounted drunk driving comprehensive detection system for unit vehicle based on multi-source information fusion

    CN113370786A