Driving prompting methods, devices, electronic equipment and storage media

Abstract

This invention provides a driving alert method. During vehicle operation, if a preset traffic event is detected, the method acquires the driver's physical monitoring information and the driver's attention information. Based on the driver's physical monitoring information and the driver's attention information, it determines whether the driver's driving state is dangerous. If the driver's driving state is dangerous, the method provides an alert to the driver. By analyzing the driver's physical monitoring information and the driver's attention information, it is possible to determine whether the driver's driving state is dangerous, thereby promptly alerting the driver to pay attention to driving safety.

Description

Technical Field

[0001] This invention relates to the field of intelligent driving, and more particularly to a driving prompt method, device, electronic device, and storage medium. Background Technology

[0002] Vehicle electronic systems are becoming increasingly advanced, including in-vehicle navigation, radar, and automatic parking systems to assist drivers. However, with the rapid increase in the number of vehicles in my country, traffic accidents caused by vehicles are also increasing. Most of these accidents are caused by poor driving habits. The existing in-vehicle electronic systems can only assist drivers and cannot accurately determine whether a user has poor driving habits or the degree of danger of those habits. Furthermore, they cannot accurately detect or provide timely warnings for dangerous driving behaviors caused by external factors. Summary of the Invention

[0003] This invention provides a driving alert method. During vehicle operation, if a preset traffic event is detected, the method acquires the driver's physical monitoring information and the driver's attention information. Based on the driver's physical monitoring information and the driver's attention information, it determines whether the driver's driving state is dangerous. If the driver's driving state is dangerous, the method alerts the driver, which can promptly remind the current driver to pay attention to driving safety.

[0004] In a first aspect, embodiments of the present invention provide a driving prompting method, the method comprising:

[0005] If a preset traffic event is detected during vehicle operation, the driver's physical monitoring information and driver's attention information will be obtained.

[0006] Based on the driver's physical monitoring information and the driver's attention information, determine whether the driver's driving state is dangerous driving;

[0007] If the driver is driving dangerously, the driver will be given a warning.

[0008] Optionally, before acquiring the driver's physical monitoring information and driver's attention information if a preset traffic event is detected during vehicle operation, the method further includes:

[0009] During driving, acquire vehicle driving environment data;

[0010] Traffic event detection is performed on the driving environment data to determine whether a preset traffic event has been detected.

[0011] Optionally, obtaining the driver's physical monitoring information includes:

[0012] When a preset traffic event is detected, the corresponding monitoring time is matched according to the attributes of the traffic event;

[0013] During the monitoring period, the driver's physical data is collected through wearable devices to obtain the driver's physical monitoring information.

[0014] Optionally, obtaining the driver's attention information includes:

[0015] When a preset traffic event is detected, the driver's facial image is captured;

[0016] Based on the driver's facial image, determine the driver's attention information.

[0017] Optionally, based on the driver's facial image, determine the driver's attention information, including:

[0018] The eye gaze features of the driver are obtained by extracting eye gaze features from the facial image.

[0019] Based on the driver's eye gaze characteristics, the driver's attention information is determined.

[0020] Optionally, determining whether the driver's driving state is dangerous based on the driver's physical monitoring information and the driver's attention information includes:

[0021] The driver's physical condition is determined based on the driver's physical monitoring information;

[0022] Based on the driver's attention information, determine the driver's attention state in relation to the traffic event;

[0023] Based on the driver's physical condition and the driver's level of attention to the traffic event, it is determined whether the driver's driving state is dangerous.

[0024] Optionally, the driver's physical state includes abnormal and normal states, and the driver's attention state to the traffic event includes attentive and inattentive states. Determining whether the driver's driving state is dangerous based on the driver's physical state and attention state to the traffic event includes:

[0025] The degree of dangerous driving by the driver is calculated based on the duration of the abnormal state and the duration of the attention state.

[0026] The driver's driving state is determined as dangerous driving based on the degree of dangerous driving by the driver.

[0027] Secondly, embodiments of the present invention provide a driving prompting device, the device comprising:

[0028] The first acquisition module is used to acquire the driver's physical monitoring information and the driver's attention information if a preset traffic event is detected during vehicle operation.

[0029] The determination module is used to determine whether the driver's driving state is dangerous driving based on the driver's physical monitoring information and the driver's attention information;

[0030] The prompting module is used to prompt the driver if the driver's driving state is dangerous.

[0031] Thirdly, embodiments of the present invention provide an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps in the driving prompt method provided in embodiments of the present invention.

[0032] Fourthly, embodiments of the present invention provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the driving prompting method provided in the embodiments of the invention.

[0033] In this embodiment of the invention, if a preset traffic event is detected during vehicle operation, the driver's physical monitoring information and driver's attention information are acquired. Based on the driver's physical monitoring information and driver's attention information, it is determined whether the driver's driving state is dangerous. If the driver's driving state is dangerous, the driver is alerted. By analyzing the driver's physical monitoring information and driver's attention information, it is possible to determine whether the driver's driving state is dangerous, thereby prompting the current driver to pay attention to driving safety. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0035] Figure 1 This is a flowchart of a driving prompting method provided in an embodiment of the present invention;

[0036] Figure 2 This is a schematic diagram of the structure of a driving reminder device provided in an embodiment of the present invention;

[0037] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0038] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0039] Please see Figure 1 , Figure 1 This is a flowchart of a driving prompting method provided in an embodiment of the present invention, such as... Figure 1 As shown, this driving prompt method includes the following steps:

[0040] 101. If a preset traffic event is detected during vehicle operation, the driver's physical monitoring information and driver's attention information will be obtained.

[0041] In this embodiment of the invention, during vehicle operation, the device used to acquire event information can be an external information acquisition device, such as a sound acquisition device and an image acquisition device. The sound acquisition device can be a sound sensor, which can be used to acquire vehicle horn sounds. The image acquisition device can be a camera, such as a computer camera, computer eye, or electronic eye, which is a video acquisition device widely used in real-time monitoring and other applications. The camera can acquire images of the vehicle. The device used to acquire driver's physical monitoring information can be a wearable device, such as a smartwatch, smart bracelet, or smart clothing. The smart bracelet or smart clothing can acquire human body monitoring information such as heart rate, body temperature, and respiratory rate. The device used to acquire driver's attention information can be an image acquisition device installed inside the vehicle, such as a camera installed inside the vehicle, which can be used to capture facial images of the driver. An external camera can be used to capture images of the exterior of the vehicle. An external sound acquisition device can be used to acquire vehicle horn sounds.

[0042] Pre-set traffic events can be detected by observing external images or sounds from vehicle horns. These events can include overtaking, honking, and high-beam collisions. Specifically, an overtaking event occurs when a vehicle moves to the side of another vehicle, passing it from behind to overtake another vehicle traveling in the same direction. The overtaking lane is usually the inner lane, closer to the center of the road and further from the shoulder. In areas where traffic drives on the right, the overtaking lane is the left lane; in areas where traffic drives on the left, the overtaking lane is the right lane. Honking events can occur when narrow roads, heavy traffic, or electric vehicles cutting in, causing prolonged traffic jams, prompting drivers to honk. High-beam collisions occur when oncoming trains or cars pass each other at the same location, including on narrow roads or at night. At night, visibility changes, and if the oncoming vehicle's high beams are not off, it can impair the driver's vision; therefore, drivers should exercise caution.

[0043] In this embodiment of the invention, if a preset traffic event is detected, human body monitoring information of the driver can be collected through a smart bracelet or smart clothing. The human body monitoring information may include monitoring information such as human heart rate, body temperature, and respiratory rate.

[0044] In this embodiment of the invention, the driver's attention information can be determined based on the driver's facial orientation or eye direction. The eye direction can be understood as the direction the eyes are looking in, and the driver's facial orientation or eye direction can be used as the driver's attention direction. The attention direction can be left, right, up, forward, etc.

[0045] 102. Based on the driver's physical monitoring information and the driver's attention information, determine whether the driver's driving state is dangerous.

[0046] In this embodiment of the invention, the aforementioned physical monitoring information of the driver may include monitoring information such as the driver's heart rate, body temperature, and respiratory rate. The monitoring information such as the driver's heart rate, body temperature, and respiratory rate can be used to determine whether the driver is in an emotionally agitated state. For example, for a driver with a tendency to road rage, when being overtaken and honked at, he will become emotionally agitated, specifically manifested as an increased heart rate and increased respiratory rate.

[0047] In some possible embodiments, the aforementioned driver's body monitoring information may also include monitoring information such as the driver's body movements and facial expressions. These body movements and facial expressions can be obtained through behavior detection of images captured by image acquisition devices inside the vehicle. The aforementioned body movements may include scratching the head, clenching fists, and rubbing or poking the eyes. The aforementioned changes in the driver's facial expressions can express the driver's mindset and emotions. Facial expressions, like human thought, are highly active and their changes are obvious and easily detected; various emotional facial expressions can reveal a person's inner state and true emotional expression. The aforementioned facial expressions may include calm facial expressions, happy facial expressions, surprised facial expressions, angry facial expressions, and disgusted facial expressions. A calm facial expression refers to a relaxed state of facial muscles, with a stable and even distribution, without significant changes. This is the most common facial expression, representing a stable state without significant emotional changes, indicating that the person is not disturbed by the external environment. The aforementioned happy facial expression is an unconscious smile that occurs when a person experiences joy. A smile is a symbol of expressing happiness, but not all smiles are expressions of inner joy. In many situations, influenced by the environment and other factors, a fake smile may appear. A genuine happy expression is characterized by upturned corners of the mouth and narrowed eyes, with the corners of the eyes also turning upwards. If only the corners of the mouth turn upwards without any change in the muscles around the eyes, this is a fake smile. The aforementioned surprised facial expression occurs when people suddenly receive information and haven't yet processed it. This is a sudden situation, and people quickly gather their thoughts to react, so the expression lasts less than a second. A surprised expression is characterized by wide eyes, dilated pupils, raised upper eyelids and eyebrows, and an open mouth. The angry facial expressions described above are those shown when a person is angry. Anger arises when people encounter setbacks, fail to achieve their goals, or when their inner needs are not met. Angry facial expressions include wide eyes, constricted pupils, downturned eyebrows, involuntary flaring of the nostrils accompanied by heavy breathing, and clenched fists. The disgust facial expressions described above involve downturned eyebrows, narrowed eyes, and in mild cases, a slightly open mouth revealing some teeth. In cases of extreme disgust, the eyes and mouth will be tightly closed. This usually stems from a deep-seated aversion, manifesting when encountering people, behaviors, or things that disgust the person.

[0048] If the driver's heart rate, body temperature, and respiratory rate are all normal, the driver's physical condition can be determined to be normal. If at least one of these monitoring parameters is abnormal, the driver's physical condition can be determined to be abnormal. In one possible embodiment, the driver's physical condition can be determined by combining the monitoring information of the driver's heart rate, body temperature, and respiratory rate with monitoring information of the driver's body movements and facial expressions. If the driver's heart rate, body temperature, respiratory rate, body movements, and facial expressions are all normal, the driver's physical condition is determined to be normal. If at least one of these parameters is abnormal, the driver's physical condition is determined to be abnormal.

[0049] The aforementioned driver attention information can refer to the direction of the driver's attention, which could be the direction the driver's face is turned or the direction of their gaze. The direction of gaze can be understood as the direction the driver's eyes are fixed on. Attention information could include looking left, right, up, forward, etc. Based on the driver's attention direction, it can be determined whether the driver is paying attention to the traffic event. If the driver is paying attention to the traffic event, it indicates that their driving attention is distracted.

[0050] Whether a driver's driving is dangerous can be determined by whether the driver's physical condition is abnormal and whether the driver is paying attention to traffic events.

[0051] In this embodiment of the invention, the aforementioned dangerous driving can be understood as whether the driver's attention is distracted by a traffic event. For example, a driver in a state of road rage may unconsciously enter a state of dangerous driving because someone is overtaking him, which may lead to dangerous driving behaviors such as chasing and racing or speeding on the road.

[0052] 103. If the driver is driving dangerously, the driver should be given a warning.

[0053] In this embodiment of the invention, when it is determined that the driver's driving state is dangerous driving, a prompting device installed in the vehicle can be used to prompt the driver to be in a dangerous driving state and to prompt the driver to increase driving attention.

[0054] Specifically, if a driver's physical condition is abnormal and the driver is paying attention to a traffic event, then the driver's driving behavior can be determined as dangerous driving. If the driver's physical condition is normal and the driver is not paying attention to a traffic event, then the driver's driving behavior can also be determined as dangerous driving. Other situations can be determined by calculating the degree of dangerous driving, including situations where the driver's physical condition is normal and the driver is paying attention to a traffic event, and situations where the driver's physical condition is abnormal and the driver is not paying attention to a traffic event.

[0055] In this embodiment of the invention, if a preset traffic event is detected during vehicle operation, the driver's physical monitoring information and driver's attention information are acquired. Based on the driver's physical monitoring information and driver's attention information, it is determined whether the driver's driving state is dangerous. If the driver's driving state is dangerous, a warning is issued to the driver. By analyzing the driver's physical monitoring information and driver's attention information, it is possible to determine whether the driver's driving state is dangerous, thereby prompting the current driver to pay attention to driving safety.

[0056] Optionally, before the steps described above, where a preset traffic event is detected during vehicle operation, and the driver's physical monitoring information and driver's attention information are obtained, the vehicle's driving environment data can be obtained during operation; traffic event detection can be performed on the aforementioned driving environment data to determine whether a preset traffic event has been detected.

[0057] In this embodiment of the invention, the driving environment may include the road environment and the vehicle environment. The road environment may be a dry road surface in sunny weather, a wet and slippery road surface in rainy weather, a narrow road surface, or a wide road surface for two or three vehicles. The vehicle environment may include the number of vehicles traveling on the road, their speed, and lights. During the driver's driving process, the vehicle's driving environment is acquired, traffic event detection is performed on the driving environment, and it is determined whether a preset traffic event has been detected.

[0058] Specifically, the aforementioned traffic incidents can include overtaking incidents, honking incidents, and high-beam incidents when meeting oncoming traffic. Overtaking occurs when a vehicle moves to the side of another vehicle, passing it from behind to overtake another vehicle traveling in the same direction. The lane used for overtaking is usually the inner lane, closer to the center of the road and farther from the shoulder. In areas where traffic drives on the right, the overtaking lane is the left lane; in areas where traffic drives on the left, the overtaking lane is the right lane. Honking incidents can occur due to narrow roads, too many vehicles, or electric vehicles cutting in, causing traffic jams and drivers honking to signal their presence. High-beam incidents when meeting oncoming traffic occur when trains or cars traveling in opposite directions pass each other at a certain location, including on narrow roads and at night. At night, visibility changes, and if the oncoming vehicle's high beams are not off, it can impair the driver's vision; therefore, drivers should drive cautiously.

[0059] Furthermore, the aforementioned driving environment can be acquired using information acquisition devices installed outside the vehicle. These devices can be sound acquisition devices and image acquisition devices. The sound acquisition device acquires sound information from outside the vehicle, thereby identifying whether a horn-honking event exists. If so, the image acquisition device can acquire and track the location of the horn-honking event. Similarly, the image acquisition device acquires image information from outside the vehicle, thereby identifying whether overtaking events, oncoming high beam events, etc., exist. If so, the image acquisition device can track the location of these events.

[0060] Optionally, in the step of obtaining the driver's physical monitoring information, when a preset traffic event is detected, the corresponding monitoring time can be matched according to the attributes of the traffic event; during the monitoring time, the driver's physical data is collected through a wearable device to obtain the driver's physical monitoring information.

[0061] In this embodiment of the invention, each traffic event has a corresponding attribute category, and different attribute categories of traffic events correspond to different monitoring times. For example, overtaking and meeting oncoming traffic correspond to different attribute categories. Overtaking mainly considers the acceleration of the following vehicle, while meeting oncoming traffic mainly considers the deceleration of both vehicles. Therefore, different monitoring times can be set according to the attribute category of a traffic event. Specifically, the monitoring time can be determined according to the proportion of the number of accidents of each attribute category of traffic events to the total number of traffic accidents. The larger the proportion of the number of accidents of a traffic event to the total number of traffic accidents, the longer the monitoring time of the corresponding attribute category of traffic event should be set.

[0062] Specifically, the wearable devices mentioned above are smart devices such as smartwatches, smart bracelets, and smart clothing that can detect drivers' heart rate, body temperature, respiratory rate, and other bodily information. When a preset traffic event is detected, the attribute category of the traffic event can be determined first. Based on the attribute category of the traffic event, the corresponding monitoring time can be determined. After the monitoring time is determined, the driver's physical data during the monitoring time can be collected through smartwatches, smart bracelets, and smart clothing, thereby obtaining the driver's physical monitoring information during the monitoring time.

[0063] Optionally, in the step of acquiring driver attention information, when a preset traffic event is detected, the driver's facial image can be captured; based on the driver's facial image, the driver's attention information can be determined. When a preset traffic event is detected, the attribute category of the traffic event can be determined first, and the corresponding monitoring time can be determined based on the attribute category. After determining the monitoring time, the driver's facial image during the monitoring time can be captured using an image acquisition device inside the vehicle, thereby determining the driver's attention information during the monitoring time based on the facial image captured during the monitoring time.

[0064] In this embodiment of the invention, the driver's facial image can be acquired by an image acquisition device inside the vehicle. The facial orientation or eye direction can be identified using image recognition methods as driver attention information. Specifically, the facial angle, including yaw angle, pitch angle, and roll angle, can be identified using image recognition methods. The facial orientation is determined based on these angles. Eye direction can be determined by identifying the pupil orientation using image recognition methods, specifically by identifying the pupil's yaw angle, pitch angle, and roll angle. The eye direction is determined based on these angles. In one possible embodiment, the image recognition method can be a convolutional neural network-based image recognition model. This model can be trained on a convolutional neural network using facial images labeled with attention direction tags. The trained model can then process the driver's facial image and output the driver's attention direction as driver attention information.

[0065] Optionally, in the step of determining the driver's attention information based on the driver's facial image, eye features can be extracted from the facial image to obtain the driver's eye features; and the driver's attention information can be determined based on the driver's eye features.

[0066] In this embodiment of the invention, the driver's gaze characteristics can be the angular characteristics of the pupil, which include yaw angle, pitch angle and roll angle. The gaze direction is determined based on the yaw angle, pitch angle and roll angle of the driver's pupil.

[0067] A driver's eye gaze features can be extracted using a feature extraction network. This network can be based on a convolutional neural network. The driver's facial image is input into the network, which then extracts the yaw, pitch, and roll angles of the driver's pupils. These angles can be used to determine the driver's gaze direction, which can be left, right, up, or forward. Based on this gaze direction, the driver's attention information can be determined.

[0068] Optionally, in the step of determining whether a driver's driving state is dangerous driving based on the driver's physical monitoring information and the driver's attention information, the driver's physical state can be determined based on the driver's physical monitoring information; the driver's attention state in response to the traffic event can be determined based on the driver's attention information; and the driver's driving state can be determined as dangerous driving based on the driver's physical state and the driver's attention state in response to the traffic event.

[0069] In this embodiment of the invention, the aforementioned body monitoring information may include monitoring information such as the driver's heart rate, body temperature, and respiratory rate. The monitoring information of the driver's heart rate, body temperature, and respiratory rate can be compared with the normal range corresponding to the heart rate, body temperature, and respiratory rate of a normal person. If the monitoring information of the driver's heart rate, body temperature, and respiratory rate are all within the normal range of the heart rate, body temperature, and respiratory rate of a normal person, then the driver's physical condition can be determined to be normal. If the monitoring information of the driver's heart rate, body temperature, and respiratory rate are all outside the normal range of the heart rate, body temperature, and respiratory rate of a normal person, then the driver's physical condition can be determined to be abnormal.

[0070] The aforementioned attention information can be the driver's attention direction, which can be the direction the driver's face is facing or the direction of their gaze. The gaze direction can be understood as the direction the driver's eyes are staring at. The driver's attention state regarding the traffic event can be determined based on the attention method and the location of the traffic event. For example, if the driver's attention direction is the location of the traffic event, the driver's attention state can be determined to be an attentive state. If the driver's attention direction is not the location of the traffic event, the driver's attention state can be determined to be an inattentive state.

[0071] Optionally, in the step of determining whether a driver's driving state is dangerous based on the driver's physical condition and the driver's attention state to the traffic event, the degree of dangerous driving can be calculated based on the duration of the abnormal state and the duration of the attention state; and the degree of dangerous driving can be used to determine whether the driver's driving state is dangerous.

[0072] In this embodiment of the invention, the aforementioned physical states can generally be considered as manifestations of psychological changes. For example, anger and agitation can manifest as an accelerated heartbeat, rapid breathing, and elevated body temperature. The aforementioned normal state indicates that the driver's psychological changes due to the traffic event are relatively small, while the aforementioned abnormal state indicates that the driver's psychological changes due to the traffic event are relatively large. The aforementioned attentive state indicates that the driver is paying attention to the traffic event, while the aforementioned inattentive state indicates that the driver is not paying attention to the traffic event. If the driver is paying attention to the traffic event, their driving attention will be significantly diverted, leading to dangerous driving. The longer the aforementioned abnormal state lasts, the greater and more persistent the psychological changes caused by the traffic event, and the greater the degree of dangerous driving. Similarly, the longer the aforementioned attentive state lasts, the longer the driver is paying attention to the traffic event, the longer their driving attention is diverted, and the greater the degree of dangerous driving.

[0073] Specifically, the degree of dangerous driving mentioned above can be determined using the following formula:

[0074]

[0075] Among them, the above α i t represents the outlier corresponding to the i-th physical indicator. i t represents the duration of the abnormal state of the i-th physical indicator, β represents the attention value, and t k The duration of attention is indicated by I, where I represents the total number of physical indicators. The outlier α can be obtained by normalizing all indicators in the physical monitoring information, and the attention value β can be determined based on the proportion of traffic incidents to the total number of traffic accidents.

[0076] After obtaining the level of dangerous driving, if the level of dangerous driving is greater than or equal to a preset threshold, the driver's driving status can be determined to be dangerous driving; if the level of dangerous driving is less than the preset threshold, the driver's driving status can be determined to be normal driving.

[0077] It should be noted that the driving prompt method provided in this embodiment of the invention can be applied to devices such as smart cameras, smartphones, computers, and servers that can perform driving prompt methods.

[0078] Optional, please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a driving reminder device provided in an embodiment of the present invention, as shown below. Figure 2 As shown, the device includes:

[0079] The first acquisition module 201 is used to acquire the driver's physical monitoring information and the driver's attention information if a preset traffic event is detected during vehicle operation.

[0080] The determining module 202 is used to determine whether the driver's driving state is dangerous driving based on the driver's physical monitoring information and the driver's attention information;

[0081] The prompting module 203 is used to prompt the driver if the driver's driving state is dangerous driving.

[0082] Optionally, the device further includes:

[0083] The second acquisition module is used to acquire vehicle driving environment data during driving.

[0084] The judgment module is used to perform traffic event detection on the driving environment data and determine whether a preset traffic event has been detected.

[0085] Optionally, the first acquisition module 201 includes:

[0086] The monitoring submodule is used to match the corresponding monitoring time according to the attributes of the traffic event when a preset traffic event is detected.

[0087] The first data acquisition submodule is used to collect the driver's physical data through a wearable device during the monitoring period to obtain the driver's physical monitoring information.

[0088] Optionally, the first acquisition module 201 includes:

[0089] The second acquisition submodule is used to acquire the driver's facial image when a preset traffic event is detected;

[0090] The first determining submodule is used to determine the driver's attention information based on the driver's facial image.

[0091] Optionally, firstly, determine the sub-modules, including:

[0092] An extraction unit is used to extract eye features from the face image to obtain the eye features of the driver;

[0093] The determining unit is used to determine the driver's attention information based on the driver's eye gaze characteristics.

[0094] Optionally, the determining module 202 includes:

[0095] The second determining submodule is used to determine the driver's physical condition based on the driver's physical monitoring information;

[0096] The third determining submodule is used to determine the driver's attention state in relation to the traffic event based on the driver's attention information;

[0097] The fourth determination submodule is used to determine whether the driver's driving state is dangerous driving based on the driver's physical state and the driver's attention state to the traffic event.

[0098] Optionally, the determining module 202 includes:

[0099] The calculation submodule is used to calculate the degree of dangerous driving by the driver based on the duration of the abnormal state and the duration of the attention state.

[0100] The fifth determining submodule is used to determine whether the driver's driving state is dangerous based on the degree of dangerous driving by the driver.

[0101] It should be noted that the driving prompt device provided in this embodiment of the invention can be applied to devices such as smart cameras, smartphones, computers, and servers that can perform driving prompt methods.

[0102] The driving prompting device provided in this embodiment of the invention can implement all the processes of the driving prompting method in the above-described method embodiments, and can achieve the same beneficial effects. To avoid repetition, further details are omitted here.

[0103] See Figure 3 , Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention, such as... Figure 3 As shown, it includes: a memory 302, a processor 301, and a computer program for a driving prompting method stored in the memory 302 and executable on the processor 301, wherein:

[0104] The processor 301 is used to call the computer program stored in the memory 302 and perform the following steps:

[0105] If a preset traffic event is detected during vehicle operation, the driver's physical monitoring information and driver's attention information will be obtained.

[0106] Based on the driver's physical monitoring information and the driver's attention information, determine whether the driver's driving state is dangerous driving;

[0107] If the driver is driving dangerously, the driver will be given a warning.

[0108] Optionally, before acquiring the driver's physical monitoring information and driver's attention information if a preset traffic event is detected during vehicle operation, the method executed by processor 301 further includes:

[0109] During driving, acquire vehicle driving environment data;

[0110] Traffic event detection is performed on the driving environment data to determine whether a preset traffic event has been detected.

[0111] Optionally, the acquisition of the driver's physical monitoring information performed by the processor 301 includes:

[0112] When a preset traffic event is detected, the corresponding monitoring time is matched according to the attributes of the traffic event;

[0113] During the monitoring period, the driver's physical data is collected through wearable devices to obtain the driver's physical monitoring information.

[0114] Optionally, the acquisition of driver attention information performed by processor 301 includes:

[0115] When a preset traffic event is detected, the driver's facial image is captured;

[0116] Based on the driver's facial image, determine the driver's attention information.

[0117] Optionally, the processor 301 performs the process of determining the driver's attention information based on the driver's facial image, including:

[0118] The eye gaze features of the driver are obtained by extracting eye gaze features from the facial image.

[0119] Based on the driver's eye gaze characteristics, the driver's attention information is determined.

[0120] Optionally, the step of determining whether the driver's driving state is dangerous driving based on the driver's physical monitoring information and the driver's attention information, executed by the processor 301, includes:

[0121] The driver's physical condition is determined based on the driver's physical monitoring information;

[0122] Based on the driver's attention information, determine the driver's attention state in relation to the traffic event;

[0123] Based on the driver's physical condition and the driver's level of attention to the traffic event, it is determined whether the driver's driving state is dangerous.

[0124] Optionally, the driver's physical state includes abnormal and normal states, and the driver's attention state to the traffic event includes attentive and inattentive states. The process 301, based on the driver's physical state and attention state to the traffic event, determines whether the driver's driving state is dangerous, including:

[0125] The degree of dangerous driving by the driver is calculated based on the duration of the abnormal state and the duration of the attention state.

[0126] The driver's driving state is determined as dangerous driving based on the degree of dangerous driving by the driver.

[0127] The electronic device provided in this embodiment of the invention can implement all the processes of the driving prompt method in the above-described method embodiments, and can achieve the same beneficial effects. To avoid repetition, it will not be described again here.

[0128] This invention also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the driving prompt method provided in this invention and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0129] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (RON), or random access memory (RAN), etc.

[0130] The above description discloses only preferred embodiments of the present invention and should not be construed as limiting the scope of the present invention. Therefore, equivalent variations made in accordance with the claims of the present invention are still within the scope of the present invention.

Claims

1. A driving prompting method characterized by comprising: The method comprises the following steps: In the process of driving the vehicle, if a preset traffic event is detected, obtaining body monitoring information of a driver and attention information of the driver; According to the body monitoring information of the driver and the attention information of the driver, determining whether the driving state of the driver is dangerous driving; If the driving state of the driver is dangerous driving, prompting the driver; The obtaining of the body monitoring information of the driver comprises: When a preset traffic event is detected, matching a corresponding monitoring time according to the attribute of the traffic event; each traffic event has a corresponding attribute category, and different attribute categories of traffic events correspond to different monitoring times; the monitoring time is determined according to the proportion of the accident occurrence amount of each attribute category of traffic events in the total traffic accident occurrence amount; the greater the proportion of the accident occurrence amount of traffic events in the total traffic accident occurrence amount, the longer the monitoring time of the corresponding attribute category of traffic events is set; In the monitoring time, the body data of the driver is collected through a wearable device to obtain the body monitoring information of the driver; The obtaining of the attention information of the driver comprises: When a preset traffic event is detected, the face image of the driver within the monitoring time is collected through an image collection device inside the vehicle; According to the face image of the driver, the attention information of the driver is determined.

2. The driving prompting method according to claim 1, characterized by, Before the step of, in the process of driving the vehicle, if a preset traffic event is detected, obtaining body monitoring information of a driver and attention information of the driver, the method further comprises: In the process of driving, obtaining driving environment data of the vehicle; Performing traffic event detection on the driving environment data to determine whether a preset traffic event is detected.

3. The driving prompting method according to claim 2, characterized by, According to the face image of the driver, the attention information of the driver is determined, which comprises: Extracting the eye feature of the face image to obtain the eye feature of the driver; Based on the eye feature of the driver, the attention information of the driver is determined.

4. The driving advice method according to claim 3, characterized by, According to the body monitoring information of the driver and the attention information of the driver, determining whether the driving state of the driver is dangerous driving, comprises: According to the body monitoring information of the driver, determining the body state of the driver; According to the attention information of the driver, determining the attention state of the driver to the traffic event; Based on the body state of the driver and the attention state of the driver to the traffic event, determining whether the driving state of the driver is dangerous driving.

5. The driving advice method according to claim 4, characterized by, The body state of the driver comprises an abnormal state and a normal state, and the attention state of the driver to the traffic event comprises an attention state and a non-attention state; based on the body state of the driver and the attention state of the driver to the traffic event, determining whether the driving state of the driver is dangerous driving, comprises: calculate a dangerous driving degree of the driver according to the duration of the abnormal state and the duration of the attention state; determine whether the driving state of the driver is dangerous driving according to the dangerous driving degree of the driver.

6. A driving prompting device characterized by comprising: The device comprises: The first acquisition module is configured to acquire the body monitoring information of the driver and the attention information of the driver if a preset traffic event is detected during driving of the vehicle; the body monitoring information of the driver is acquired by matching a corresponding monitoring time according to an attribute of the traffic event when the preset traffic event is detected; each traffic event has a corresponding attribute category, and different attribute categories of traffic events correspond to different monitoring times; the monitoring time is determined according to a proportion of an accident occurrence amount of each attribute category of traffic events in a total traffic accident occurrence amount; the greater the proportion of the accident occurrence amount of the traffic events in the total traffic accident occurrence amount, the longer the monitoring time of the traffic events of the corresponding attribute category; the body data of the driver is collected by a wearable device within the monitoring time to obtain the body monitoring information of the driver; the attention information of the driver is acquired by collecting a face image of the driver within the monitoring time by an image collection device inside the vehicle according to the face image of the driver when the preset traffic event is detected; The determination module is configured to determine whether the driving state of the driver is dangerous driving according to the body monitoring information of the driver and the attention information of the driver; The prompting module is configured to prompt the driver if the driving state of the driver is dangerous driving.

7. An electronic device, comprising: comprise: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps in the driving prompting method according to any one of claims 1 to 5 when executing the computer program.

8. A computer-readable storage medium, characterized in that, The computer program is stored on the computer readable storage medium, and the computer program is executable on the processor to implement the steps in the driving prompting method according to any one of claims 1 to 5.

Images