Methods, devices, vehicles, and storage media for vehicle safety alerts

Abstract

This application discloses a method, device, vehicle, and storage medium for vehicle safety alerts. The method includes: detecting whether the vehicle is in a preset safety alert condition; if the vehicle is detected to be in the preset safety alert condition, acquiring the vehicle's current speed and identifying the driver's line-of-sight pitch angle and eye opening; determining the driver's target distraction level based on the current speed and line-of-sight pitch angle, and determining the driver's target driving fatigue level using the current speed and eye opening; and issuing a safety alert to the driver using a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driving fatigue level. This solves the problem in related technologies where indirectly detecting driver status through vehicle information has low accuracy and a high false alarm rate, reducing the precision of driver status detection and lowering driving safety, thus failing to meet users' driving needs.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a method, device, vehicle, and storage medium for vehicle safety alerts. Background Technology

[0002] With the deepening development of vehicle intelligence and the continuous improvement of people's living standards, high-level intelligent driving functions of L2+ and above are being rapidly implemented in vehicles, and cars are gradually entering millions of households. In the "human-machine co-driving" stage, the number of traffic accidents is also increasing year by year, with subjective factors such as fatigued driving, distracted driving, and aggressive driving becoming the main causes of road accidents. According to statistics, DMS (Driver Monitoring System) can alert drivers to fatigue, distraction, and phone calls, effectively reducing the probability of accidents. It has become an important component of intelligent connected vehicles. Furthermore, the integration of DMS with systems such as AR-HUD (Augmented Reality Head-Up Display), FCW (Forward Collision Warning) / LDW (Lane Departure Warning) is increasing, and DMS will gradually become a standard component, playing an increasingly important role.

[0003] In related technologies, the driver's state can be indirectly monitored by monitoring vehicle information, that is, by collecting driving data such as driving time, steering wheel angle changes, lane departure and other vehicle system parameters to infer the driver's fatigue state. Alternatively, the driver's physiological characteristics can be directly monitored by configuring sensors, which requires the deployment of many biosensors such as EEG sensors and pulse sensors.

[0004] However, the relevant technologies that indirectly detect driver status through vehicle information have low accuracy and high false alarm rate, which reduces the accuracy of driver status detection. In addition, detecting driver status by configuring sensors to obtain driver physiological indicators is costly and may affect driver safety, failing to meet users' driving needs and urgently requiring solutions. Summary of the Invention

[0005] This application provides a method, device, vehicle, and storage medium for vehicle safety alerts to address the problems in related technologies where indirect detection of driver status via vehicle information has low accuracy and a high false alarm rate, reducing the precision of driver status detection. Furthermore, detecting driver status by acquiring physiological indicators from sensors results in high costs and may affect driver safety, failing to meet user needs.

[0006] The first aspect of this application provides a method for vehicle safety alerts, comprising the following steps: detecting whether the vehicle is in a preset safety alert condition; when the vehicle is detected to be in the preset safety alert condition, acquiring the current speed of the vehicle and identifying the driver's line-of-sight pitch angle and eye opening; determining the driver's target distraction level based on the current speed and the line-of-sight pitch angle, and determining the driver's target driving fatigue level using the current speed and the eye opening; and providing a safety alert to the driver using a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driving fatigue level.

[0007] Optionally, in one embodiment of this application, determining the driver's target distraction level based on the current vehicle speed and the line-of-sight pitch angle includes: determining the driver's target distraction level as Level 1 distraction when the current vehicle speed is greater than a first preset speed, the line-of-sight pitch angle is greater than a preset pitch angle, and the duration is greater than a first preset duration; determining the driver's target distraction level as Level 1 distraction when the current vehicle speed is greater than or equal to a second preset speed and less than or equal to a first preset speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the duration is greater than a second preset duration; determining the driver's target distraction level as Level 2 distraction when the current vehicle speed is greater than or equal to a second preset speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the cumulative duration within the target duration range is greater than a third preset duration; wherein, the third preset speed is less than the second preset speed, the first preset speed is greater than the second preset speed, the first preset duration is less than the second preset duration, and the second preset duration is less than the third preset duration.

[0008] Optionally, in one embodiment of this application, the cumulative duration within the target duration range includes: within the target duration range, determining whether the line-of-sight pitch angle is less than or equal to the preset pitch angle, and whether the duration is greater than or equal to a fourth preset duration; if the line-of-sight pitch angle is less than or equal to the preset pitch angle, and the duration is greater than or equal to the fourth preset duration, then the cumulative duration within the target duration range is recalculated; otherwise, the cumulative duration within the target duration range is not recalculated, wherein the fourth preset duration is less than the first preset duration.

[0009] Optionally, in one embodiment of this application, determining the driver's target driving fatigue level using the current vehicle speed and the eye opening degree includes: when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a first preset opening degree, the driver's target driving fatigue level is determined to be Level 1 fatigue; when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a second preset opening degree, the driver's target driving fatigue level is determined to be Level 2 fatigue; when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a third preset opening degree, the driver's target driving fatigue level is determined to be Level 3 fatigue, wherein the first preset opening degree is greater than the second preset opening degree, and the second preset opening degree is greater than the third preset opening degree.

[0010] Optionally, in one embodiment of this application, the step of providing a safety reminder to the driver using a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driver fatigue level includes: when the target distraction level is level one, providing a safety reminder to the driver using a first voice reminder method and a first pop-up reminder method; when the target distraction level is level two, providing a safety reminder to the driver using a second voice reminder method and a second pop-up reminder method; when the target driver fatigue level is level one, providing a safety reminder to the driver using a third voice reminder method and a third pop-up reminder method; when the target driver fatigue level is level two, providing a safety reminder to the driver using a fourth voice reminder method and a fourth pop-up reminder method; and when the target driver fatigue level is level three, providing a safety reminder to the driver using a fifth voice reminder method and a fifth pop-up reminder method.

[0011] Optionally, in one embodiment of this application, after providing a safety reminder to the driver, the method further includes: receiving an alarm stop command from the driver; responding to the alarm stop command; and controlling the vehicle to stop providing the safety reminder to the driver according to the alarm stop command.

[0012] A second aspect of this application provides a vehicle safety reminder device, comprising: a detection module for detecting whether a vehicle is in a preset safety reminder condition; a processing module for acquiring the current speed of the vehicle and identifying the driver's line-of-sight pitch angle and eye opening degree when the vehicle is detected to be in the preset safety reminder condition; and a reminder module for determining the driver's target distraction level based on the current speed and the line-of-sight pitch angle, and determining the driver's target driving fatigue level using the current speed and the eye opening degree, so as to provide a safety reminder to the driver using a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driving fatigue level.

[0013] Optionally, in one embodiment of this application, the reminder module includes: a first determination unit, configured to determine that the driver's target distraction level is Level 1 distraction when the current vehicle speed is greater than a first preset vehicle speed, the line-of-sight pitch angle is greater than a preset pitch angle, and the duration is greater than a first preset duration; a second determination unit, configured to determine that the driver's target distraction level is Level 1 distraction when the current vehicle speed is greater than or equal to a second preset vehicle speed and less than or equal to a first preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the duration is greater than a second preset duration; and a third determination unit, configured to determine that the driver's target distraction level is Level 2 distraction when the current vehicle speed is greater than or equal to a second preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the cumulative duration within the target duration range is greater than a third preset duration, wherein the third preset vehicle speed is less than the second preset vehicle speed, the first preset vehicle speed is greater than the second preset vehicle speed, the first preset duration is less than the second preset duration, and the second preset duration is less than the third preset duration.

[0014] Optionally, in one embodiment of this application, the third determination unit includes: a determination subunit, configured to determine whether the line-of-sight pitch angle is less than or equal to the preset pitch angle and whether the duration is greater than or equal to a fourth preset duration within the target duration range; and a processing subunit, configured to recalculate the cumulative duration within the target duration range if the line-of-sight pitch angle is less than or equal to the preset pitch angle and the duration is greater than or equal to the fourth preset duration, otherwise not to recalculate the cumulative duration within the target duration range, wherein the fourth preset duration is less than the first preset duration.

[0015] Optionally, in one embodiment of this application, the reminder module includes: a fourth determination unit, configured to determine that the driver's target driving fatigue level is Level 1 fatigue when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a first preset opening degree; a fifth determination unit, configured to determine that the driver's target driving fatigue level is Level 2 fatigue when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a second preset opening degree; and a sixth determination unit, configured to determine that the driver's target driving fatigue level is Level 3 fatigue when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a third preset opening degree, wherein the first preset opening degree is greater than the second preset opening degree, and the second preset opening degree is greater than the third preset opening degree.

[0016] Optionally, in one embodiment of this application, the reminder module includes: a first reminder unit, configured to provide a safety reminder to the driver using a first voice reminder and a first pop-up reminder when the target distraction level is Level 1; a second reminder unit, configured to provide a safety reminder to the driver using a second voice reminder and a second pop-up reminder when the target distraction level is Level 2; a third reminder unit, configured to provide a safety reminder to the driver using a third voice reminder and a third pop-up reminder when the target driver fatigue level is Level 1; a fourth reminder unit, configured to provide a safety reminder to the driver using a fourth voice reminder and a fourth pop-up reminder when the target driver fatigue level is Level 2; and a fifth reminder unit, configured to provide a safety reminder to the driver using a fifth voice reminder and a fifth pop-up reminder when the target driver fatigue level is Level 3.

[0017] Optionally, in one embodiment of this application, the apparatus further includes: a receiving module for receiving an alarm stop command from the driver; and a control module for responding to the alarm stop command and controlling the vehicle to stop providing safety reminders to the driver according to the alarm stop command.

[0018] A third aspect of this application provides a vehicle, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle safety alert method as described in the above embodiments.

[0019] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described method for vehicle safety reminders.

[0020] A fifth aspect of this application provides a computer program, which, when executed, is used to implement the above-described method for vehicle safety reminders.

[0021] This application embodiment can determine the driver's target distraction level based on the vehicle's current speed and the driver's eye level when the vehicle is detected to be in a safety alert condition. It also determines the driver's target fatigue level using the vehicle's current speed and the driver's eye opening / closing angle. The driver is then alerted using either a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target fatigue level. This effectively improves the accuracy of driver status detection and meets the user's driving needs. Therefore, it solves the problems of related technologies that indirectly detect driver status through vehicle information, resulting in low accuracy and a high false alarm rate, thus reducing the accuracy of driver status detection. Furthermore, it addresses the issues of high cost and potential safety risks associated with using sensors to acquire driver physiological characteristics for status detection, ultimately failing to meet the user's driving needs.

[0022] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0023] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0024] Figure 1 This is an architecture diagram of a vehicle safety reminder system provided according to an embodiment of this application;

[0025] Figure 2 This is a flowchart illustrating a vehicle safety alert method according to an embodiment of this application;

[0026] Figure 3 This is a logic diagram for a driver state monitoring long distraction alarm according to a specific embodiment of this application;

[0027] Figure 4 This is a logic diagram for a short distraction alarm for driver status monitoring according to a specific embodiment of this application;

[0028] Figure 5 This is a logic diagram for driver state monitoring fatigue alarm according to a specific embodiment of this application;

[0029] Figure 6 This is a logic diagram for a driver status monitoring no-response alarm according to a specific embodiment of this application;

[0030] Figure 7This is a logic diagram for a camera obstruction alarm according to a specific embodiment of this application;

[0031] Figure 8 This is a performance degradation alarm logic diagram of a specific embodiment of this application;

[0032] Figure 9 This is a schematic diagram of a vehicle safety reminder device according to an embodiment of this application;

[0033] Figure 10 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0034] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0035] The following description, with reference to the accompanying drawings, outlines a method, apparatus, vehicle, and storage medium for vehicle safety alerts according to embodiments of this application. Addressing the issues raised in the background section regarding the indirect detection of driver status via vehicle information, which suffers from low accuracy and high false alarm rates, thus reducing the precision of driver status detection, and the high cost and potential impact on driver safety due to the use of sensors to acquire physiological indicators for driver status detection, this application provides a method for vehicle safety alerts. This method, when the vehicle is detected to be in a safety alert state, determines the driver's target distraction level based on the vehicle's current speed and the driver's eye level, and determines the driver's target fatigue level using the vehicle's current speed and the driver's eye opening / closing angle. A safety alert is then issued to the driver using either a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target fatigue level, effectively improving the accuracy of driver status detection and meeting the user's driving needs. This solves the problems of low accuracy and high false alarm rate in related technologies that indirectly detect driver status through vehicle information, thus reducing the accuracy of driver status detection. In addition, detecting driver status by configuring sensors to obtain driver physiological indicators is costly and may affect driver safety, failing to meet users' driving needs.

[0036] Currently, EU regulations have relatively strict requirements for monitoring abnormal driver behavior. The European New Car Assessment Programme (Euro NCAP) uses a unified star rating system to evaluate each model, with a maximum of 5 stars. The E-NCAP standard defines the key points that the Driver Monitoring System (DMS) should monitor: driver status detection, including fatigue, prolonged distraction, short-term distraction, mobile phone use, driver unresponsiveness, and reduced obstruction performance. However, there are no unified rules or schemes for the alarm logic and methods of monitoring content, and each OEM defines them according to its own requirements.

[0037] Therefore, this application proposes an alarm based on an infrared camera to monitor the driver's status in accordance with E-NCAP requirements. The alarm is triggered at different vehicle speeds, when the driver is fatigued, distracted, or unresponsive. At the same time, it avoids frequent alarms from affecting normal driving and ensures driving safety.

[0038] like Figure 1 The system shown in this embodiment of the application comprises a DMS controller, a camera, and two IR (infrared) supplementary lights. The DMS controller receives image input from the camera, executes the algorithm, and sends the recognition result to the vehicle's CAN (Controller Area Network) for other controller units (such as FCW, LDW, seatbelt system, etc.) to perform corresponding actions. The DMS controller also supplies power to the camera and IR supplementary lights. The camera is primarily responsible for image acquisition, while the IR supplementary lights are mainly used to supplement lighting in different environments to meet the algorithm's image acquisition requirements. The following will provide a detailed description of this system.

[0039] The vehicle safety alert system monitors the driver's gaze positions according to Euro NCAP requirements, including the instrument panel, center console, rearview mirror, driver's legs, passenger's legs, driver's side mirror, driver's side window, passenger's side mirror, passenger's side window, passenger's face, armrest box, and second row. To avoid false alarms, alarms are disabled for the driver's windshield, passenger's windshield, driver's sun visor, and passenger's sun visor areas. When the driver is distracted (including using a mobile phone), fatigued, unresponsive, the camera is obstructed, or the performance is degraded, an alarm sound and a pop-up window on the instrument panel will be displayed.

[0040] Specifically, Figure 2 This is a flowchart illustrating a vehicle safety alert method provided in an embodiment of this application.

[0041] like Figure 2 As shown, the method for providing vehicle safety reminders includes the following steps:

[0042] In step S201, it is detected whether the vehicle is in a preset safety warning condition.

[0043] In this embodiment of the application, the preset safety reminder condition is a condition in which the vehicle can provide safety reminders based on the driver's driving status.

[0044] It is understood that the embodiments of this application can detect whether the vehicle is in a safety reminder mode. For example, the driver can preset the vehicle to automatically enter the safety reminder mode after the speed exceeds a certain speed. Alternatively, after the vehicle is powered on, the driver can also control the vehicle to enter the safety reminder mode through a physical button. After the vehicle enters the safety reminder mode, safety reminders can be given according to the driver's driving status, which effectively improves the executability of vehicle safety reminders.

[0045] In step S202, when the vehicle is detected to be in a preset safety warning condition, the current vehicle speed is obtained, and the driver's line of sight pitch angle and eye opening degree are identified.

[0046] It is understood that, in the embodiments of this application, when the vehicle is detected to be in a safety alert condition, the current speed of the vehicle can be obtained, and the driver's line of sight pitch angle and eye opening degree can be identified. For example, in the embodiments of this application, an infrared camera installed on the dashboard can be used to identify the driver's line of sight pitch angle and eye opening degree. The line of sight pitch angle can determine whether the user is looking straight ahead or turning their head left or right, and the eye opening degree can determine whether the user's eyes are open or closed, effectively improving the accuracy of obtaining the driver's status.

[0047] In step S203, the driver's target distraction level is determined based on the current vehicle speed and the line of sight pitch angle, and the driver's target driving fatigue level is determined based on the current vehicle speed and the degree of eye opening and closing. The driver is then given a safety reminder using either the first target alarm method corresponding to the target distraction level or the second target alarm method corresponding to the target driving fatigue level.

[0048] It is understood that the embodiments of this application can determine the driver's target distraction level based on the current vehicle speed and line-of-sight pitch angle in the following steps, so as to determine the driver's distraction while driving, such as making a phone call, turning the head left or right, etc., and determine the driver's target driving fatigue level based on the current vehicle speed and eye opening degree in the following steps, so as to determine the driver's fatigue while driving, such as yawning, closing the eyes, etc., so as to provide safety reminders to the driver using the first target alarm method corresponding to the target distraction level or the second target alarm method corresponding to the target driving fatigue level in the following steps, effectively improving the accuracy of driver status detection and improving the safety of user driving.

[0049] Optionally, in one embodiment of this application, determining the driver's target distraction level based on the current vehicle speed and line-of-sight pitch angle includes: determining the driver's target distraction level as Level 1 distraction when the current vehicle speed is greater than a first preset speed, the line-of-sight pitch angle is greater than a preset pitch angle, and the duration is greater than a first preset duration; determining the driver's target distraction level as Level 1 distraction when the current vehicle speed is greater than or equal to a second preset speed and less than or equal to a first preset speed, the line-of-sight pitch angle is greater than a preset pitch angle, and the duration is greater than a second preset duration; determining the driver's target distraction level as Level 2 distraction when the current vehicle speed is greater than or equal to a second preset speed, the line-of-sight pitch angle is greater than a preset pitch angle, and the cumulative duration within the target duration range is greater than a third preset duration; wherein, the first preset speed is greater than the second preset speed, the first preset duration is less than the second preset duration, and the second preset duration is less than the third preset duration.

[0050] For example, such as Figure 3 As shown, when the current vehicle speed is greater than 65 km / h and the driver's eye level is greater than ±15°, indicating that the driver's gaze has left the road for 3 seconds, the driver's distraction level is determined to be Level 1 distraction, i.e., long distraction. When the current vehicle speed is greater than or equal to 20 km / h and less than or equal to 65 km / h, the eye level is greater than ±15°, and the driver's gaze has left the road for more than 4 seconds, the driver's distraction level is determined to be Level 1 distraction, i.e., long distraction. In addition, when the vehicle is in normal driving conditions and the driver is not in the camera's field of vision, such as when the body is tilted, the driver is determined to be long distracted, which effectively improves the accuracy of detecting the driver's distraction level.

[0051] For example, such as Figure 4 As shown, when the current vehicle speed is greater than or equal to 20 km / h, the line-of-sight pitch angle is greater than ±15°, and the cumulative time the driver's line of sight has been away from the road within 30 seconds is greater than 10 seconds, the driver's target distraction level is determined to be level two distraction, i.e. short distraction, which effectively improves the comprehensiveness of driver distraction detection.

[0052] In addition, to prevent false alarms about driver distraction caused by the driver looking in the left and right rearview mirrors while turning, the system determines that the driver is not distracted when the driver's line of sight is within ±15°, the steering wheel angle is greater than 6 degrees to the left or right, or the vehicle's left and right turn signals are activated.

[0053] Optionally, in one embodiment of this application, the cumulative duration within the target duration range includes: within the target duration range, determining whether the line-of-sight pitch angle is less than or equal to a preset pitch angle, and whether the duration is greater than or equal to a fourth preset duration; if the line-of-sight pitch angle is less than or equal to the preset pitch angle, and the duration is greater than or equal to the fourth preset duration, then the cumulative duration within the target duration range is recalculated; otherwise, the cumulative duration within the target duration range is not recalculated, wherein the fourth preset duration is less than the first preset duration.

[0054] For example, such as Figure 4 As shown, when the current vehicle speed is greater than or equal to 20 km / h, the line-of-sight pitch angle is greater than ±15°, and the cumulative duration within 30 seconds is greater than 10 seconds, the driver's target distraction level is determined to be level two distraction, i.e., short distraction. Specifically, if the driver's line of sight to the road is greater than or equal to 2 seconds within 30 seconds, the cumulative duration is reset to zero and the cumulative duration within 30 seconds is recalculated, which effectively improves the accuracy of detecting the driver's distraction level.

[0055] Optionally, in one embodiment of this application, determining the driver's target driving fatigue level using the current vehicle speed and eye opening / closing degree includes: when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening / closing degree is less than a first preset opening / closing degree, the driver's target driving fatigue level is determined to be Level 1 fatigue; when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening / closing degree is less than a second preset opening / closing degree, the driver's target driving fatigue level is determined to be Level 2 fatigue; when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening / closing degree is less than a third preset opening / closing degree, the driver's target driving fatigue level is determined to be Level 3 fatigue, wherein the third preset vehicle speed is less than the second preset vehicle speed, the first preset opening / closing degree is greater than the second preset opening / closing degree, and the second preset opening / closing degree is greater than the third preset opening / closing degree.

[0056] For example, such as Figure 5 As shown, when the current vehicle speed is greater than or equal to 10 km / h and the eye opening is less than the first preset opening, for example, if the driver blinks for three consecutive minutes and the eye opening is less than 30%, the driver's target driving fatigue level is determined to be Level 1 fatigue, i.e., drowsiness, mild fatigue; when the current vehicle speed is greater than or equal to 10 km / h and the eye opening is less than 15%, for example, if the driver closes their eyes for more than or equal to 2 seconds, the driver's target driving fatigue level is determined to be Level 2 fatigue, i.e., microsleep, moderate fatigue; when the current vehicle speed is greater than or equal to 10 km / h and the eye opening is less than 5%, for example, if the driver closes their eyes for more than or equal to 3 seconds, the driver's target driving fatigue level is determined to be Level 3 fatigue, i.e., sleep, severe fatigue. This effectively improves the accuracy of detecting driver fatigue levels.

[0057] In this embodiment, the driver's fatigue level can be determined by the driver's KSS (karolinskasleepinessscale). The level is greater than or equal to 7. The KSS level is mainly determined by the degree of eye opening and closing. After the system is started, it takes 2-5 minutes to collect the driver's maximum eye opening and closing. During this period, please try to keep your eyes open normally. The basis for accumulating drowsiness score is to collect less than 30% of the maximum eye opening and closing. The drowsiness score statistical method is based on the KSS level and will collect head posture data, less than 30% eye opening and closing and the frequency of drowsy squinting.

[0058] Optionally, in one embodiment of this application, a safety reminder is given to the driver using a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driver fatigue level, including: when the target distraction level is Level 1 distraction, a safety reminder is given to the driver using a first voice reminder method and a first pop-up screen reminder method; when the target distraction level is Level 2 distraction, a safety reminder is given to the driver using a second voice reminder method and a second pop-up screen reminder method; when the target driver fatigue level is Level 1 fatigue, a safety reminder is given to the driver using a third voice reminder method and a third pop-up screen reminder method; when the target driver fatigue level is Level 2 fatigue, a safety reminder is given to the driver using a fourth voice reminder method and a fourth pop-up screen reminder method; and when the target driver fatigue level is Level 3 fatigue, a safety reminder is given to the driver using a fifth voice reminder method and a fifth pop-up screen reminder method.

[0059] For example, such as Figure 3 As shown, when the target distraction level is Level 1 distraction, i.e., prolonged distraction, the system uses a voice reminder of "You are very distracted, please pay attention to driving safety" once and displays the text "You are very distracted" on the dashboard pop-up screen for 5 seconds to remind the driver of safety, effectively improving the accuracy of safety reminders.

[0060] For example, such as Figure 4 As shown, when the target distraction level is level two distraction, i.e. short distraction, the system will use a voice reminder of "You have been distracted, please pay attention to driving safety" once and display the text "You have been distracted" on the instrument panel pop-up screen for 5 seconds to remind the driver of safety. In addition, when a short distraction reminder is issued, the accumulation of long distraction time is canceled, which effectively improves the accuracy of safety reminders.

[0061] For example, such as Figure 5As shown, when the target driver fatigue level is Level 1, a voice reminder of "Please consider taking a rest, you are driving while fatigued" is given once, and the instrument panel pop-up displays the same message for 5 seconds to remind the driver. When the target driver fatigue level is Level 2, a voice reminder of "It is recommended to take a rest, you are driving while fatigued" is given once, and the instrument panel pop-up displays the same message for 5 seconds to remind the driver. When the driver opens their eyes again, the fatigue signal stops alarming, and the instrument panel alarm is immediately deactivated. When the target driver fatigue level is Level 3, a voice reminder of "Please stop and rest, you are driving while severely fatigued" is given continuously, and the instrument panel pop-up displays the same message to remind the driver. This continues until the driver's condition returns to normal, i.e., when they open their eyes, the safety reminder is immediately deactivated, and the timing cycle is reset, effectively improving the comprehensiveness of the safety reminders.

[0062] The mild fatigue alarm will be interrupted if the camera is obstructed or the steering wheel is turned. It will be triggered again if the obstruction is removed or the steering wheel is straightened. It will also be triggered again if the vehicle speed is below 10 km / h and then above 10 km / h, causing continuous alarms on the instrument panel. The timing cycle will be reset after the alarm is interrupted.

[0063] It should be noted that in this embodiment, the priorities are ordered from low to high as follows: Level 1 fatigue < Level 2 fatigue < Level 3 fatigue. After a low-priority fatigue state is triggered, a higher-priority fatigue state can still be reported. For example, if the eyes are closed for 2 seconds, a Level 2 fatigue alarm will be broadcast. If the eyes are closed for another second, the alarm will switch to Level 3 fatigue. After a high-priority fatigue state ends, a low-priority fatigue state alert cannot be triggered. For example, after Level 3 fatigue ends, Level 1 fatigue will not be triggered immediately unless the alarm is cleared and the timer is reset.

[0064] For example, such as Figure 6 As shown, when the current vehicle speed is greater than or equal to 20 km / h, and the driver's eyes are off the road for a continuous period of 6 seconds or more, or the driver's eyes are closed for more than 6 seconds, the driver is determined to be in an unresponsive state. In this case, the voice reminder "Please concentrate on driving and pay attention to driving safety" will be continuously played in the car, and the text "Please concentrate on driving" will be displayed on the instrument panel until the driver opens his eyes or looks at the road continuously for 2 seconds, at which point the safety alarm will be deactivated, effectively improving the safety of the user.

[0065] Optionally, in one embodiment of this application, after providing a safety reminder to the driver, the method further includes: receiving an alarm stop command from the driver; responding to the alarm stop command; and controlling the vehicle to stop providing the safety reminder to the driver according to the alarm stop command.

[0066] In some embodiments, the driver can turn off the safety alert according to their own needs. This application embodiment can receive and respond to the driver's alarm stop command, thereby controlling the vehicle to stop the safety alert to the driver according to the alarm stop command, effectively improving the vehicle's intelligence level.

[0067] For example, such as Figure 7 As shown, when the vehicle's camera is obstructed, and the vehicle speed is greater than or equal to 10 km / h, the steering wheel angle on both sides is less than or equal to 20°, and this situation persists for 8 seconds, a camera obstruction alarm will be triggered. In addition, since a large steering wheel angle is normal turning and could lead to false alarms, the steering wheel angle on both sides is set to less than or equal to 20°. The obstruction alarm is triggered once every time the vehicle is powered on, that is, when starting from sleep mode or power off, the obstruction alarm is only sent to the instrument panel once per trip, and the instrument panel displays the text reminder "Camera obstructed", which effectively improves the user's driving experience.

[0068] For example, such as Figure 8 As shown in the embodiment of this application, there is a performance degradation. For example, if the vehicle speed is greater than or equal to 20km / h, the detected driver's eyes are invalid, but the head posture, head pitch angle and yaw angle are valid. If the preconditions are met and the performance degradation is maintained for 8 seconds, a degradation alarm is triggered. It is triggered once per power-on. It is triggered when starting from sleep state or power-off. That is, each trip, the degradation alarm is only sent to the instrument panel once. The degradation state lasts for 8 seconds and a trigger alarm signal is issued. It is guaranteed to be reported within 10 seconds. The instrument panel displays the text reminder "Performance degradation, please check in time", which effectively improves the user's driving experience.

[0069] The vehicle safety alert method proposed in this application can determine the driver's target distraction level based on the vehicle's current speed and the driver's eye level when the vehicle is detected to be in a safety alert condition. It also determines the driver's target driving fatigue level using the vehicle's current speed and the driver's eye opening / closing angle. A first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driving fatigue level is then used to provide a safety alert to the driver. This effectively improves the accuracy of driver status detection and meets the user's driving needs. Therefore, it solves the problems of related technologies that indirectly detect driver status through vehicle information, resulting in low accuracy and a high false alarm rate, thus reducing the accuracy of driver status detection. Furthermore, it addresses the issues of high cost and potential impact on driving safety caused by using sensors to acquire driver physiological characteristics for status detection, ultimately failing to meet the user's driving needs.

[0070] Next, the vehicle safety reminder device according to the embodiments of this application is described with reference to the accompanying drawings.

[0071] Figure 9 This is a block diagram of a vehicle safety reminder device according to an embodiment of this application.

[0072] like Figure 9 As shown, the vehicle safety reminder device 10 includes: a detection module 100, a processing module 200, and a reminder module 300.

[0073] Specifically, the detection module 100 is used to detect whether the vehicle is in a preset safety warning condition.

[0074] The processing module 200 is used to obtain the vehicle's current speed and identify the driver's line of sight pitch angle and eye opening degree when the vehicle is detected to be in a preset safety warning condition.

[0075] The reminder module 300 is used to determine the driver's target distraction level based on the current vehicle speed and the eye tilt angle, and to determine the driver's target driving fatigue level based on the current vehicle speed and the degree of eye opening and closing, so as to provide safety reminders to the driver using the first target alarm method corresponding to the target distraction level or the second target alarm method corresponding to the target driving fatigue level.

[0076] Optionally, in one embodiment of this application, the reminder module 300 includes: a first determination unit, a second determination unit, and a third determination unit.

[0077] The first determination unit is used to determine that the driver's target distraction level is level one when the current vehicle speed is greater than the first preset vehicle speed, the line of sight pitch angle is greater than the preset pitch angle, and the duration is greater than the first preset duration.

[0078] The second determination unit is used to determine the driver's target distraction level as Level 1 distraction when the current vehicle speed is greater than or equal to the second preset vehicle speed and less than or equal to the first preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the duration is greater than the second preset duration.

[0079] The third determination unit is used to determine the driver's target distraction level as level two distraction when the current vehicle speed is greater than or equal to the second preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the cumulative duration within the target duration range is greater than the third preset duration. The third preset vehicle speed is less than the second preset vehicle speed, the first preset vehicle speed is greater than the second preset vehicle speed, the first preset duration is less than the second preset duration, and the second preset duration is less than the third preset duration.

[0080] Optionally, in one embodiment of this application, the third determination unit includes: a determination subunit and a processing subunit.

[0081] The judgment subunit is used to determine whether the line-of-sight pitch angle is less than or equal to the preset pitch angle and whether the duration is greater than or equal to the fourth preset duration within the target duration range.

[0082] The processing subunit is used to recalculate the cumulative duration within the target duration range if the line-of-sight pitch angle is less than or equal to a preset pitch angle and the duration is greater than or equal to a fourth preset duration; otherwise, it does not recalculate the cumulative duration within the target duration range, wherein the fourth preset duration is less than the first preset duration.

[0083] Optionally, in one embodiment of this application, the reminder module 300 includes: a fourth determination unit, a fifth determination unit, and a sixth determination unit.

[0084] The fourth determination unit is used to determine the driver's target driving fatigue level as Level 1 fatigue when the current vehicle speed is greater than or equal to the third preset vehicle speed and the eye opening degree is less than the first preset opening degree.

[0085] The fifth determination unit is used to determine the driver's target driving fatigue level as Level 2 fatigue when the current vehicle speed is greater than or equal to the third preset vehicle speed and the eye opening degree is less than the second preset opening degree.

[0086] The sixth determination unit is used to determine that the driver's target driving fatigue level is level three fatigue when the current vehicle speed is greater than or equal to the third preset vehicle speed and the eye opening degree is less than the third preset opening degree. The first preset opening degree is greater than the second preset opening degree, and the second preset opening degree is greater than the third preset opening degree.

[0087] Optionally, in one embodiment of this application, the reminder module includes: a first reminder unit, a second reminder unit, a third reminder unit, a fourth reminder unit, and a fifth reminder unit.

[0088] The first reminder unit is used to provide safety reminders to the driver using a first voice reminder method and a first pop-up screen reminder method when the target distraction level is level one.

[0089] The second reminder unit is used to provide safety reminders to the driver using a second voice reminder method and a second pop-up screen reminder method when the target distraction level is level two.

[0090] The third reminder unit is used to provide safety reminders to the driver using a third voice reminder method and a third pop-up screen reminder method when the target driver's fatigue level is Level 1 fatigue.

[0091] The fourth reminder unit is used to provide safety reminders to the driver using a fourth voice reminder method and a fourth pop-up screen reminder method when the target driver's fatigue level is level two.

[0092] The fifth reminder unit is used to provide safety reminders to the driver using both voice reminders and pop-up screen reminders when the target driver's fatigue level is level three.

[0093] Optionally, in one embodiment of this application, the apparatus 10 of this embodiment further includes a receiving module and a control module.

[0094] The receiving module is used to receive the driver's alarm stop command.

[0095] The control module is used to respond to alarm stop commands and, based on these commands, control the vehicle to stop providing safety reminders to the driver.

[0096] It should be noted that the foregoing explanation of the method embodiment for vehicle safety reminders also applies to the vehicle safety reminder device of this embodiment, and will not be repeated here.

[0097] The vehicle safety reminder device proposed in this application can determine the driver's target distraction level based on the vehicle's current speed and the driver's eye level when the vehicle is detected to be in a safety reminder condition. It also determines the driver's target driving fatigue level using the vehicle's current speed and the driver's eye opening / closing angle. The device then provides a safety reminder to the driver using either a first target alarm method corresponding to the target distraction level or a second target alarm method corresponding to the target driving fatigue level. This effectively improves the accuracy of driver state detection and meets the user's driving needs. Therefore, it solves the problems of related technologies that indirectly detect driver state through vehicle information, resulting in low accuracy and a high false alarm rate, thus reducing the accuracy of driver state detection. Furthermore, it addresses the issues of high cost and potential impact on driving safety caused by using sensors to acquire driver physiological characteristics for state detection, ultimately failing to meet the user's driving needs.

[0098] Figure 10 A schematic diagram of the structure of a vehicle provided in an embodiment of this application. The vehicle may include:

[0099] The memory 1001, the processor 1002, and the computer program stored on the memory 1001 and capable of running on the processor 1002.

[0100] When the processor 1002 executes the program, it implements the vehicle safety reminder method provided in the above embodiments.

[0101] Furthermore, the vehicle also includes:

[0102] Communication interface 1003 is used for communication between memory 1001 and processor 1002.

[0103] The memory 1001 is used to store computer programs that can run on the processor 1002.

[0104] The memory 1001 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0105] If the memory 1001, processor 1002, and communication interface 1003 are implemented independently, then the communication interface 1003, memory 1001, and processor 1002 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 10 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0106] Optionally, in a specific implementation, if the memory 1001, processor 1002, and communication interface 1003 are integrated on a single chip, then the memory 1001, processor 1002, and communication interface 1003 can communicate with each other through an internal interface.

[0107] The processor 1002 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0108] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described method for vehicle safety reminders.

[0109] This embodiment also provides a computer program, which, when executed, is used to implement the above-described method for vehicle safety reminders.

[0110] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0111] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0112] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0113] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0114] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0115] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0116] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0117] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A method of vehicle safety alerting, characterized by, The method comprises the following steps: detecting whether the vehicle is in a preset safety reminding working condition; acquiring a current vehicle speed of the vehicle and identifying a line-of-sight pitch angle and an eye opening degree of a driver when it is detected that the vehicle is in the preset safety reminding working condition; determining a target distraction level of the driver according to the current vehicle speed and the line-of-sight pitch angle, and determining a target driving fatigue level of the driver according to the current vehicle speed and the eye opening degree, so as to remind the driver of safety by using a first target alarm mode corresponding to the target distraction level or a second target alarm mode corresponding to the target driving fatigue level; the determination of the target distraction level of the driver according to the current vehicle speed and the line-of-sight pitch angle comprises: when the current vehicle speed is greater than a first preset vehicle speed, the line-of-sight pitch angle is greater than a preset pitch angle, and a duration is greater than a first preset duration, it is determined that the target distraction level of the driver is a first-level distraction; when the current vehicle speed is greater than or equal to a second preset vehicle speed and less than or equal to the first preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and the duration is greater than a second preset duration, it is determined that the target distraction level of the driver is the first-level distraction; when the current vehicle speed is greater than or equal to the second preset vehicle speed, the line-of-sight pitch angle is greater than the preset pitch angle, and an accumulated duration in a target duration range is greater than a third preset duration, it is determined that the target distraction level of the driver is a second-level distraction; wherein the first preset vehicle speed is greater than the second preset vehicle speed, the first preset duration is less than the second preset duration, and the second preset duration is less than the third preset duration.

2. The method of claim 1, wherein, the accumulated duration in the target duration range comprises: in the target duration range, it is determined whether the line-of-sight pitch angle is less than or equal to the preset pitch angle and whether a duration is greater than or equal to a fourth preset duration; if the line-of-sight pitch angle is less than or equal to the preset pitch angle and the duration is greater than or equal to the fourth preset duration, the accumulated duration in the target duration range is recalculated, otherwise, the accumulated duration in the target duration range is not recalculated, wherein the fourth preset duration is less than the first preset duration.

3. The method of claim 1, wherein, the determination of the target driving fatigue level of the driver according to the current vehicle speed and the eye opening degree comprises: when the current vehicle speed is greater than or equal to a third preset vehicle speed and the eye opening degree is less than a first preset opening degree, it is determined that the target driving fatigue level of the driver is a first-level fatigue; when the current vehicle speed is greater than or equal to the third preset vehicle speed and the eye opening degree is less than a second preset opening degree, it is determined that the target driving fatigue level of the driver is a second-level fatigue; when the current vehicle speed is greater than or equal to the third preset vehicle speed and the eye opening degree is less than a third preset opening degree, it is determined that the target driving fatigue level of the driver is a third-level fatigue, wherein the third preset vehicle speed is less than the second preset vehicle speed, the first preset opening degree is greater than the second preset opening degree, and the second preset opening degree is greater than the third preset opening degree.

4. The method according to claim 1 or 3, characterized in that, The safety reminding of the driver comprises: When the target distraction level is a first-level distraction, the driver is reminded by a first voice reminding mode and a first pop-up reminding mode; When the target distraction level is a second-level distraction, the driver is reminded by a second voice reminding mode and a second pop-up reminding mode; When the target driving fatigue level is a first-level fatigue, the driver is reminded by a third voice reminding mode and a third pop-up reminding mode; When the target driving fatigue level is a second-level fatigue, the driver is reminded by a fourth voice reminding mode and a fourth pop-up reminding mode; When the target driving fatigue level is a third-level fatigue, the driver is reminded by a fifth voice reminding mode and a fifth pop-up reminding mode.

5. The method of claim 1, wherein, After the safety reminding of the driver, the method further comprises: receiving a stop reminding instruction of the driver; in response to the stop reminding instruction, the safety reminding of the driver is stopped according to the stop reminding instruction.

6. An apparatus for vehicle safety alerting, characterized by The method comprises: detecting whether the vehicle is in a preset safety reminding working condition; when it is detected that the vehicle is in the preset safety reminding working condition, acquiring a current speed of the vehicle, and identifying a line-of-sight pitch angle and an eye opening degree of the driver; determining a target distraction level of the driver according to the current speed and the line-of-sight pitch angle, and determining a target driving fatigue level of the driver according to the current speed and the eye opening degree, so as to remind the driver by a first target reminding mode corresponding to the target distraction level or a second target reminding mode corresponding to the target driving fatigue level; the reminding module comprises: a first determining unit configured to determine that the target distraction level of the driver is a first-level distraction when the current speed is greater than a first preset speed, the line-of-sight pitch angle is greater than a preset pitch angle, and a continuous time length is greater than a first preset time length; a second determining unit configured to determine that the target distraction level of the driver is a first-level distraction when the current speed is greater than or equal to a second preset speed and less than or equal to the first preset speed, the line-of-sight pitch angle is greater than the preset pitch angle, and a continuous time length is greater than a second preset time length; a third determining unit configured to determine that the target distraction level of the driver is a second-level distraction when the current speed is greater than or equal to the second preset speed, the line-of-sight pitch angle is greater than the preset pitch angle, and an accumulated time length within a target time length range is greater than a third preset time length, wherein the first preset speed is greater than the second preset speed, the first preset time length is less than the second preset time length, and the second preset time length is less than the third preset time length.

7. A vehicle characterized by comprising: The method comprises: - a memory, a processor, and a computer program stored on the memory and runable on the processor, the processor executing the program to implement the method of vehicle safety alert according to any one of claims 1-5.

8. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor for implementing the method of vehicle safety alert according to any one of claims 1-5.

Images