Safe driving monitoring method and device, electronic equipment and storage medium

Abstract

The invention provides a safe driving monitoring method and device, electronic equipment and a storage medium. The method comprises the following steps: firstly, acquiring behavior information of a target driver and state information of a target vehicle; then, whether the behavior information of the target driver and / or the state information of the target vehicle meet the safe driving condition or not is judged, and when the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving condition, the target vehicle is controlled to output safe driving prompt information. According to the technical scheme, whether the target driver meets the safe driving condition or not can be judged according to the limb movement and the facial expression of the driver and / or the state information of the target vehicle, whether potential safety hazards exist when the driver drives the vehicle or not can be judged more accurately, the safety of the vehicle is improved to a certain degree, and the occurrence rate of vehicle accidents is reduced to a certain degree.

Description

Technical Field

[0001] The present application relates to the technical field, and specifically to a monitoring method, device, electronic device and storage medium for safe driving. Background Art

[0002] With the continuous popularization of vehicles, traffic safety is also increasingly valued. Usually, traffic accidents are mostly caused by drivers' irregular driving (such as fatigue driving, etc.).

[0003] In the prior art, in order to ensure that the driver is not in a fatigued driving state, the vehicle will automatically record a safe driving time (usually 4 hours). Specifically, when the driver's continuous driving time exceeds the safe driving time, the vehicle outputs a safe driving prompt message to ensure that the user drives safely.

[0004] However, whether a driver drives safely is related to many other factors besides driving time. Therefore, judging whether a driver drives safely based solely on driving time cannot fully guarantee the driver's safety status, which in turn leads to a high accident rate for vehicles.

[0005] It should be pointed out that the information disclosed in the background technology section of this application is only intended to deepen the understanding of the general background technology of this application, and should not be regarded as an admission or suggestion in any form that the information constitutes prior art already known to those skilled in the art. Summary of the invention

[0006] In view of this, the present application provides a safe driving monitoring method, device, electronic device and storage medium, so as to solve the problem in the prior art that only driving time is relied upon to judge whether the driver is driving safely, which cannot fully guarantee the driver's safety status, thereby resulting in a high accident rate of the vehicle.

[0007] In a first aspect, an embodiment of the present application provides a safe driving monitoring method, which is applied to a target vehicle, and the method includes:

[0008] Acquiring behavior information of a target driver and state information of the target vehicle, wherein the behavior information is used to characterize body movements and facial movements of the target driver when driving the target vehicle;

[0009] Determining whether the behavior information of the target driver and / or the state information of the target vehicle meets safe driving conditions;

[0010] When the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving condition, the target vehicle is controlled to output safe driving prompt information.

[0011] In the embodiment of the present application, the behavior information of the target driver and the state information of the target vehicle are first obtained; then, it is determined whether the behavior information of the target driver and / or the state information of the target vehicle meet the safe driving conditions. When the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving conditions, the target vehicle is controlled to output safe driving prompt information. It can be understood that judging whether the target driver meets the safe driving conditions based on the driver's body movements and facial expressions, and / or the state information of the target vehicle, can more accurately judge whether there are safety hazards when the driver drives the vehicle, which improves the safety of the vehicle to a certain extent and reduces the incidence of vehicle accidents.

[0012] In a possible implementation, when the behavior information of the target driver does not meet the safe driving condition, controlling the target vehicle to output safe driving prompt information includes:

[0013] When the behavior information of the target driver does not meet the safe driving condition, determining the fatigue state of the target driver according to the body movements and facial movements of the target driver when driving the target vehicle, the fatigue state including: mild fatigue, moderate fatigue and severe fatigue;

[0014] According to the fatigue state of the target driver, safe driving prompt information corresponding to the fatigue state of the target driver is output.

[0015] In the embodiment of the present application, when the behavior information of the target driver does not meet the safe driving conditions, the fatigue state of the target driver is first determined based on the body movements and facial movements of the target driver when driving the target vehicle; then, based on the fatigue state of the target driver, safe driving prompt information corresponding to the fatigue state of the target driver is output. It can be understood that according to the different fatigue states of the target driver, the vehicle performs different safe driving prompt operations, which, to a certain extent, further improves the safety of the vehicle, reduces the incidence of vehicle accidents, and improves the comfort of vehicle driving.

[0016] In a possible implementation, the target vehicle includes: an on-board instrument cluster, an on-board buzzer, and an on-board air conditioner;

[0017] The step of outputting safe driving prompt information corresponding to the fatigue state of the target driver according to the fatigue state of the target driver includes:

[0018] When the fatigue state of the target driver is the mild fatigue, controlling the combined instrument of the target vehicle to display safe driving prompt information;

[0019] When the fatigue state of the target driver is the moderate fatigue, controlling the vehicle-mounted buzzer of the target vehicle to broadcast safe driving prompt information;

[0020] When the fatigue state of the target driver is the severe fatigue, the onboard buzzer of the target vehicle is controlled to broadcast safe driving prompt information, and the onboard air conditioner in the target vehicle is controlled to be turned on so that the onboard air conditioner performs a cold air blowing operation.

[0021] In the embodiment of the present application, when the fatigue state of the target driver is mild fatigue, the combined instrument of the target vehicle is controlled to display safe driving prompt information; when the fatigue state of the target driver is moderate fatigue, the vehicle-mounted buzzer of the target vehicle is controlled to broadcast safe driving prompt information; when the fatigue state of the target driver is severe fatigue, the vehicle-mounted buzzer of the target vehicle is controlled to broadcast safe driving prompt information, and the vehicle-mounted air conditioner in the target vehicle is controlled to be turned on, so that the vehicle-mounted air conditioner performs a cold wind blowing operation. It can be understood that according to the fatigue state of the target driver, the safe driving prompt operation of the vehicle is gradually strengthened, which, to a certain extent, further improves the safety of the vehicle, reduces the incidence of vehicle accidents, and improves the comfort of vehicle driving.

[0022] In a possible implementation, the state information of the target vehicle includes the continuous driving time of the target vehicle;

[0023] The determining whether the state information of the target vehicle meets the safe driving condition includes: determining whether the continuous driving time of the target vehicle is less than or equal to a preset safe driving time;

[0024] When the continuous driving time of the target vehicle is less than or equal to the preset safe driving time, the state information representing the target vehicle does not meet the safe driving condition.

[0025] In the embodiment of the present application, by judging whether the continuous driving time of the target vehicle is less than or equal to the preset safe driving time; when the continuous driving time of the target vehicle is less than or equal to the preset safe driving time, the state information representing the target vehicle does not meet the safe driving condition. It can be understood that on the basis of judging the behavior information of the target driver, further adding a comparative judgment of the continuous driving time of the target vehicle further improves the safety of the vehicle and reduces the incidence of vehicle accidents.

[0026] In a possible implementation, the state information of the target vehicle includes: the driving speed of the target vehicle;

[0027] The determining whether the behavior information of the target driver and the state information of the target vehicle meet the safe driving condition includes: when the driving speed of the target vehicle is greater than or equal to a first preset speed, determining whether the driving behavior of the target driver has a safety risk according to the behavior information of the target driver;

[0028] When there is a safety risk in the driving behavior of the target driver, the behavior information characterizing the target driver and the state information of the target vehicle do not meet the safe driving condition.

[0029] In the embodiment of the present application, when the target vehicle's driving speed is greater than or equal to the first preset speed, the target driver's driving behavior is judged to be a safety risk based on the target driver's behavior information; when the target driver is a safety risk, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving conditions. It can be understood that when the target vehicle's driving speed is greater than or equal to the first preset speed, a safety warning will be issued for some of the target driver's behaviors, further improving the safety of the vehicle and reducing the incidence of vehicle accidents.

[0030] In a possible implementation, the state information of the target vehicle further includes: a steering wheel angle;

[0031] The determining whether the behavior information of the target driver and the state information of the target vehicle meet the safe driving condition includes: when the driving speed of the target vehicle is greater than or equal to a second preset speed, and the steering wheel angle is less than a preset angle, determining whether the target driver is distracted driving the target vehicle according to the behavior information of the target driver;

[0032] When the target driver is distracted while driving the target vehicle, the behavior information representing the target driver and the state information of the target vehicle do not satisfy the safe driving condition.

[0033] In the embodiment of the present application, when the driving speed of the target vehicle is greater than or equal to the second preset speed, and the steering wheel angle is less than the preset angle, it is determined whether the target driver is distracted driving the target vehicle based on the target driver's behavior information; when the target driver is distracted driving the target vehicle, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving conditions. In the embodiment of the present application, by adding the determination of whether the target driver is distracted driving the vehicle, the safety of the vehicle is further improved and the incidence of vehicle accidents is reduced.

[0034] In a possible implementation, the target vehicle includes: a vehicle-mounted camera, a vehicle control system, and an electronic power steering system;

[0035] The obtaining of the behavior information of the target driver and the state information of the target vehicle includes:

[0036] Controlling the vehicle-mounted camera to collect video and audio information of the target driver, and determining the behavior information of the target driver based on the collected video and audio information of the target driver;

[0037] The state information of the target vehicle is obtained from the vehicle control system and the electronic power steering system.

[0038] In the embodiment of the present application, the behavior information of the target driver and the status information of the target vehicle are obtained through the existing on-board cameras, vehicle control systems and electronic power steering systems on the vehicle, making the application of the safe driving monitoring method more universal, reducing the demand for the hardware of the target vehicle, generally improving the safety of the vehicle, and reducing the incidence of vehicle accidents.

[0039] In a possible implementation manner, after controlling the target vehicle to output safe driving prompt information, the method further includes:

[0040] In response to a safe driving reminder closing operation triggered by the target driver, the target vehicle is controlled to close a function of outputting safe driving reminder information.

[0041] In an embodiment of the present application, in response to a user-triggered safety driving reminder closing operation, the function of outputting safety driving reminder information is controlled to close the target vehicle, thereby effectively preventing the vehicle's safety reminders from affecting the driver's safe driving, further improving the safety of the vehicle and reducing the incidence of vehicle accidents.

[0042] In a second aspect, an embodiment of the present application provides a safe driving monitoring device, comprising:

[0043] An information acquisition module, used to acquire behavior information of a target driver and state information of the target vehicle, wherein the behavior information is used to characterize body movements and facial movements of the target driver when driving the target vehicle;

[0044] A judgment module, used to judge whether the behavior information of the target driver and / or the state information of the target vehicle meets the safe driving conditions;

[0045] A control module is used to control the target vehicle to output safe driving prompt information when the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving conditions.

[0046] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0047] processor;

[0048] Memory;

[0049] And a computer program, wherein the computer program is stored in the memory, and the computer program includes instructions, and when the instructions are executed by the processor, the electronic device executes any one of the methods described in the first aspect.

[0050] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, characterized in that the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the methods described in the first aspect.

[0051] It is understandable that the safe driving monitoring device provided in the second aspect, the electronic device provided in the third aspect, and the computer-readable storage medium provided in the fourth aspect are all used to execute the method provided in the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0053] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the present application.

[0054] Figure 2 A flowchart of a safe driving monitoring method provided in an embodiment of the present application.

[0055] Figure 3 A schematic diagram of the structure of a safe driving monitoring device provided in an embodiment of the present application.

[0056] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0058] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0059] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0060] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0061] As vehicles become more and more popular, traffic safety is becoming more and more important. Usually, most traffic accidents are caused by drivers' irregular driving (such as fatigue driving, etc.). For ease of understanding, the following first illustrates a specific application scenario.

[0062] See also Figure 1 , is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 As shown, the application scenario includes: road 101, self-vehicle 102 and other vehicles 103-107. As shown in the figure, road 101 is a one-way three-lane road; there are self-vehicle 102 and other vehicles 105 and 106 in the middle lane; there is other vehicle 103 in the left lane; there are other vehicles 104 and 107 in the right lane. In this article, "self-vehicle" and "target vehicle" have the same meaning.

[0063] Specifically, in the related art, after the driver drives the vehicle 102, in order to ensure that the driver is not in a fatigued driving state, the vehicle automatically records a safe driving time. Specifically, when the driver continuously drives the vehicle for a time exceeding the safe driving time, the vehicle outputs a safe driving prompt message to ensure that the user drives safely. For example, the safe driving time is four hours. When the driver continuously drives the vehicle for 5 hours, the driver continuously drives the vehicle for a time greater than the safe driving time. At this time, the vehicle outputs a safe driving prompt message to ensure that the user drives safely.

[0064] It should be pointed out that Figure 1The road 101 shown in the figure is only an exemplary description. According to actual needs, the road 101 can be either a one-way lane or a two-way lane. The road 101 can include either one lane or multiple lanes. This application does not impose any specific limitation on this. Figure 1 The types of the self-vehicle 102 and other vehicles 103-107 described are only exemplary descriptions. According to actual needs, the types of the self-vehicle and other vehicles can be cars, vans, pickup trucks, and vans, etc. This application does not make specific restrictions on this.

[0065] However, whether a driver drives safely is related to many other factors besides driving time. Therefore, judging whether a driver drives safely based solely on driving time cannot fully guarantee the driver's safety status, which in turn leads to a high accident rate for vehicles.

[0066] In view of the above problems, in an embodiment of the present application, the behavior information of the target driver and the status information of the target vehicle are first obtained; then, it is determined whether the behavior information of the target driver and / or the status information of the target vehicle meet the safe driving conditions. When the behavior information of the target driver and / or the status information of the target vehicle do not meet the safe driving conditions, the target vehicle is controlled to output safe driving prompt information. It can be understood that judging whether the target driver meets the safe driving conditions based on the driver's body movements and facial expressions, and / or the status information of the target vehicle can more accurately judge whether there are safety hazards when the driver drives the vehicle, which, to a certain extent, improves the safety of the vehicle and reduces the incidence of vehicle accidents. Specifically, it is described in detail below in conjunction with specific embodiments.

[0067] See also Figure 2 , is a flow chart of a safe driving monitoring method provided in an embodiment of the present application. The method can be applied to Figure 1 In the application scenario shown, Figure 2 As shown, it mainly includes the following steps.

[0068] Step S201: Obtaining behavior information of a target driver and status information of a target vehicle.

[0069] In the embodiment of the present application, first, the Driver Fatigue Monitor System (DMS) obtains the behavior information of the target driver and the state information of the target vehicle. It should be noted that the behavior information is used to characterize the body movements and facial movements of the target driver when driving the target vehicle. The state information of the target vehicle characterizes the state of the target vehicle, which usually includes vehicle speed, acceleration, and steering wheel angle.

[0070] It can be understood that the facial movements of the target driver usually refer to eye occlusion, etc., and the body movements mainly include hand movements of the target driver, etc. Technical personnel in this field can freely set them according to actual needs, and this application does not make specific restrictions on this.

[0071] In actual application, before obtaining the behavior information of the target driver and the status information of the target vehicle, the fatigue warning system is first tested. Specifically, when the power of the vehicle is started, the fatigue driving warning system is tested. When an error is detected in the fatigue driving warning system, the corresponding error prompt information is output on the control panel of the vehicle.

[0072] Generally, fatigue driving warning systems obtain the behavior information of the target driver and the status information of the target vehicle through the in-vehicle infotainment system. However, in actual applications, many vehicles are not equipped with in-vehicle infotainment systems. Therefore, in the prior art, many vehicles cannot apply the related safe driving monitoring methods. In view of this problem, in a possible implementation method, the safety monitoring of the target driver's driving can be achieved through the relevant modules commonly present in the vehicle.

[0073] Specifically, the target vehicle includes: an on-board camera, a vehicle control system, and an electronic power steering system. First, the on-board camera collects the audio and video information of the target driver; then, based on the collected audio and video information of the target driver, the behavior information of the target driver is determined; at the same time, the state information of the target vehicle is obtained from the vehicle control system and the electronic power steering system.

[0074] In actual applications, when a vehicle-mounted camera is used to obtain audio and video information of a target driver, the vehicle-mounted camera may be blocked. In order to solve this problem, in a possible implementation, it is possible to first detect whether the vehicle-mounted camera can record normally. When it is detected that the vehicle-mounted camera cannot record normally, a buzzer or a related indicator light can be used to remind the user that the vehicle-mounted camera cannot record normally.

[0075] Furthermore, when the on-board camera can work normally, but detects that the driver's face is blocked for more than a certain threshold, a corresponding prompt message can be triggered. For example, when it is detected that the driver's mouth is blocked by wearing a mask or hand for more than 6 seconds, the mouth blocking prompt message is triggered; similarly, when it is detected that the driver's eyes are blocked by hands or sunglasses are worn for more than 6 seconds, the eye blocking prompt message is triggered.

[0076] It should be pointed out that in order to finally obtain the behavior information of the target driver and the status information of the target vehicle, other modules on the vehicle must also be used. For the sake of brevity, this application does not give a specific description of this.

[0077] In the embodiment of the present application, the behavior information of the target driver and the status information of the target vehicle are obtained through the existing on-board cameras, vehicle control systems and electronic power steering systems on the vehicle, making the application of the safe driving monitoring method more universal, reducing the demand for the hardware of the target vehicle, generally improving the safety of the vehicle, and reducing the incidence of vehicle accidents.

[0078] Step S202: Determine whether the behavior information of the target driver and / or the state information of the target vehicle meets the safe driving conditions.

[0079] In an embodiment of the present application, after obtaining the behavior information of the target driver and the status information of the target vehicle, it is determined whether the behavior information of the target driver and / or the status information of the target vehicle meet the safe driving conditions.

[0080] It is understandable that in a possible implementation, whether the target user is driving safely can be determined only by judging the behavior information of the target driver. For example, by detecting the fatigue state of the target driver, it is determined whether the safe driving condition is met.

[0081] Of course, in a possible implementation, it is possible to more accurately determine whether the target driver meets the safe driving conditions by combining the target driver's behavior information and the target vehicle's status information.

[0082] Specifically, the state information of the target vehicle includes: the driving speed of the target vehicle. When the driving speed of the target vehicle is greater than or equal to the first preset speed, it is determined whether the driving behavior of the target driver poses a safety risk based on the behavior information of the target driver. When the driving behavior of the target driver poses a safety risk, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving condition.

[0083] It should be noted that some driving behaviors with safety risks can be pre-stored. Exemplary driving behaviors with safety risks include: making phone calls and smoking. Those skilled in the art can set them according to actual needs, and this application does not make specific restrictions on this.

[0084] For example, the first preset speed is 20 km / h. When the target vehicle is traveling at a speed of 30 km / h, and the target vehicle is traveling at a speed greater than or equal to the first preset speed, the target driver's driving behavior is determined to be making a phone call based on the target driver's behavior information. Then, the target driver may be determined to be at full risk.

[0085] In the embodiment of the present application, when the target vehicle's driving speed is greater than or equal to the first preset speed, the target driver's driving behavior is judged to be a safety risk based on the target driver's behavior information; when the target driver is a safety risk, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving conditions. It can be understood that when the target vehicle's driving speed is greater than or equal to the first preset speed, a safety warning will be issued for some of the target driver's behaviors, further improving the safety of the vehicle and reducing the incidence of vehicle accidents.

[0086] Furthermore, the state information of the target vehicle also includes: a steering wheel angle. In a possible implementation, when the driving speed of the target vehicle is greater than or equal to a second preset speed, and the steering wheel angle is less than a preset angle, it is determined whether the target driver is distracted from driving the target vehicle based on the target driver's behavior information. When the target driver is distracted from driving the target vehicle, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving conditions.

[0087] It can be understood that when a small steering wheel angle is detected and the turn signal is not turned on, the target driver's behavior information (including facial expressions and pupil focus position, etc.) is used to determine whether the target driver is distracted from driving the target vehicle.

[0088] In the embodiment of the present application, when the driving speed of the target vehicle is greater than or equal to the second preset speed, and the steering wheel angle is less than the preset angle, it is determined whether the target driver is distracted driving the target vehicle based on the target driver's behavior information; when the target driver is distracted driving the target vehicle, the behavior information representing the target driver and the state information of the target vehicle do not meet the safe driving conditions. In the embodiment of the present application, by adding the determination of whether the target driver is distracted driving the vehicle, the safety of the vehicle is further improved and the incidence of vehicle accidents is reduced.

[0089] Step S203: When the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving conditions, the target vehicle is controlled to output safe driving prompt information.

[0090] In an embodiment of the present application, when the behavior information of the target driver and / or the status information of the target vehicle do not meet the safe driving conditions, the target vehicle is controlled to output safe driving prompt information.

[0091] In one possible implementation, when the target driver's behavior information does not meet the safe driving conditions, the target driver's fatigue state is determined based on the target driver's body movements and facial movements when driving the target vehicle; based on the target driver's fatigue state, safe driving prompt information corresponding to the target driver's fatigue state is output.

[0092] Among them, fatigue states include: mild fatigue, moderate fatigue and severe fatigue.

[0093] In the embodiment of the present application, when the behavior information of the target driver does not meet the safe driving conditions, the fatigue state of the target driver is first determined based on the body movements and facial movements of the target driver when driving the target vehicle; then, based on the fatigue state of the target driver, safe driving prompt information corresponding to the fatigue state of the target driver is output. It can be understood that according to the different fatigue states of the target driver, the vehicle performs different safe driving prompt operations, which, to a certain extent, further improves the safety of the vehicle, reduces the incidence of vehicle accidents, and improves the comfort of vehicle driving.

[0094] In actual applications, safety reminders are usually given to users through the large screen of the in-vehicle infotainment system. Of course, in vehicles without a large screen of the in-vehicle infotainment system, safety reminders to users can also be achieved through common modules on the vehicle. Specifically, in one possible implementation, when the target driver's fatigue state is mild fatigue, the target vehicle's instrument cluster is controlled to display safe driving reminder information; when the target driver's fatigue state is moderate fatigue, the target vehicle's onboard buzzer is controlled to broadcast safe driving reminder information; when the target driver's fatigue state is severe fatigue, the target vehicle's onboard buzzer is controlled to broadcast safe driving reminder information, and the onboard air conditioner in the target vehicle is turned on, so that the onboard air conditioner performs a cold air blowing operation.

[0095] It can be understood that the cold air blowing on the face operation refers to controlling the air conditioner to blow cold air on the face of the target driver.

[0096] Specifically, when the in-car camera detects that the driver is slightly fatigued, the DMS sends safe driving reminder information corresponding to mild fatigue to the controller, and the on-board instrument cluster displays icons and text pop-up prompts; when the in-car camera detects that the driver is moderately fatigued, the instrument cluster displays icons and text pop-up prompts, and triggers the instrument cluster buzzer prompt sound (2Hz, 3s); when the in-car camera detects that the driver is severely fatigued, the instrument cluster displays icons and text pop-up prompts, and triggers the instrument cluster buzzer prompt sound (2Hz, continuous). At the same time, the DMS sends a request signal to the relevant controller to turn on the air conditioner's maximum cooling, maximum air volume, and adjust the air outlet mode to blowing on the face, so as to ensure that the driver is reminded to pay attention to driving safety to the greatest extent.

[0097] In the embodiment of the present application, when the fatigue state of the target driver is mild fatigue, the combined instrument of the target vehicle is controlled to display safe driving prompt information; when the fatigue state of the target driver is moderate fatigue, the vehicle-mounted buzzer of the target vehicle is controlled to broadcast safe driving prompt information; when the fatigue state of the target driver is severe fatigue, the vehicle-mounted buzzer of the target vehicle is controlled to broadcast safe driving prompt information, and the vehicle-mounted air conditioner in the target vehicle is controlled to be turned on, so that the vehicle-mounted air conditioner performs a cold wind blowing operation. It can be understood that according to the fatigue state of the target driver, the safe driving prompt operation of the vehicle is gradually strengthened, which, to a certain extent, further improves the safety of the vehicle, reduces the incidence of vehicle accidents, and improves the comfort of vehicle driving.

[0098] In a possible implementation, the state information of the target vehicle also includes: the continuous driving time of the target vehicle. First, it is determined whether the continuous driving time of the target vehicle is less than or equal to the preset safe driving time; when the continuous driving time of the target vehicle is less than or equal to the preset safe driving time, the state information indicating that the target vehicle does not meet the safe driving condition.

[0099] In the embodiment of the present application, by judging whether the continuous driving time of the target vehicle is less than or equal to the preset safe driving time; when the continuous driving time of the target vehicle is less than or equal to the preset safe driving time, the state information representing the target vehicle does not meet the safe driving condition. It can be understood that on the basis of judging the behavior information of the target driver, further adding a comparative judgment of the continuous driving time of the target vehicle further improves the safety of the vehicle and reduces the incidence of vehicle accidents.

[0100] Typically, after the target vehicle is controlled to output the safe driving prompt information, the target driver will control to turn off the reminder. Specifically, in a possible implementation, in response to a safe driving prompt turning off operation triggered by a user, the target vehicle is controlled to turn off the function of outputting the safe driving prompt information.

[0101] Specifically, when the instrument panel displays a safe driving reminder, the target driver can interrupt the reminder by short pressing the preset button, that is, the instrument pop-up window and the reminder sound are cancelled. Of course, you can also long press the preset button, the instrument text pop-up window reminder DMS function is turned off, the DMS function reminder will no longer be made during the vehicle power-on cycle, and no pop-up window and sound prompt will be made. By long pressing the preset button again for 5s, the instrument text pop-up window reminder DMS function is turned on, the vehicle power-on cycle will be reminded normally, and the instrument will normally pop up window and sound prompt.

[0102] In an embodiment of the present application, in response to a user-triggered safety driving reminder closing operation, the function of outputting safety driving reminder information is controlled to close the target vehicle, thereby effectively preventing the vehicle's safety reminders from affecting the driver's safe driving, further improving the safety of the vehicle and reducing the incidence of vehicle accidents.

[0103] Corresponding to the above embodiments, the present application also provides a monitoring device for safe driving.

[0104] See also Figure 3 , is a safe driving monitoring device provided in an embodiment of the present application. Specifically, see Figure 3 , is a schematic diagram of the structure of a safe driving monitoring device provided in an embodiment of the present application. Figure 3 As shown, the figure shows a safe driving monitoring device 300. Among them, the safe driving monitoring device 300 includes: an information acquisition module 301, a judgment module 302 and a control module 303. Specifically, it should be pointed out that the specific content involved in the embodiment of the image forming device can be found in the description of the above-mentioned method embodiment. For the sake of brevity, it will not be repeated here. The information acquisition module is used to obtain the behavior information of the target driver and the status information of the target vehicle; the judgment module is used to judge whether the behavior information of the target driver and / or the status information of the target vehicle meet the safe driving conditions; the control module is used to control the target vehicle to output safe driving prompt information when the behavior information of the target driver and / or the status information of the target vehicle do not meet the safe driving conditions.

[0105] Corresponding to the above embodiments, the present application also provides an electronic device.

[0106] See also Figure 4 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 4 As shown, the electronic device 400 may include: a processor 401, a memory 402 and a communication unit 403. These components communicate via one or more buses. Those skilled in the art will appreciate that the structure of the electronic device shown in the figure does not limit the embodiments of the present application, and it may be a bus structure or a star structure, and may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently.

[0107] The communication unit 403 is used to establish a communication channel so that the electronic device can communicate with other devices, receive user data sent by other devices or send user data to other devices.

[0108] The processor 401 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It runs or executes software programs, instructions, and / or modules stored in the memory 402, and calls data stored in the memory to perform various functions of the electronic device and / or process data. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs with the same or different functions. For example, the processor 401 can only include a central processing unit (CPU). In the embodiment of the present application, the CPU can be a single computing core or multiple computing cores.

[0109] The memory 402 is used to store the execution instructions of the processor 401. The memory 402 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0110] When the execution instruction in the memory 402 is executed by the processor 401, the electronic device 400 can execute Figure 1 Some or all of the steps in the illustrated embodiments.

[0111] In a specific implementation, the embodiment of the present application further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the simulation scene generation method provided in the embodiment of the present application. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0112] In a specific implementation, an embodiment of the present application also provides a computer program product, wherein the computer program product includes executable instructions, and when the executable instructions are executed on a computer, the computer executes part or all of the steps in each embodiment of the simulation scene generation method provided in the embodiment of the present application.

[0113] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0114] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0115] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0116] In several embodiments provided in the present application, any function can be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as an independent product. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., and other media that can store program codes.

[0117] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the device embodiment and the terminal embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

Claims

1. A method for monitoring safe driving, characterized in that: Applied to a target vehicle, the method comprises: Acquiring behavior information of a target driver and state information of the target vehicle, wherein the behavior information is used to characterize body movements and facial movements of the target driver when driving the target vehicle; Determining whether the behavior information of the target driver and / or the state information of the target vehicle meets safe driving conditions; When the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving condition, the target vehicle is controlled to output safe driving prompt information.

2. The safe driving monitoring method according to claim 1, characterized in that: When the behavior information of the target driver does not meet the safe driving condition, controlling the target vehicle to output safe driving prompt information includes: When the behavior information of the target driver does not meet the safe driving condition, determining the fatigue state of the target driver according to the body movements and facial movements of the target driver when driving the target vehicle, the fatigue state including: mild fatigue, moderate fatigue and severe fatigue; According to the fatigue state of the target driver, safe driving prompt information corresponding to the fatigue state of the target driver is output.

3. The safe driving monitoring method according to claim 2, characterized in that: The target vehicle includes: an on-board instrument cluster, an on-board buzzer, and an on-board air conditioner; The step of outputting safe driving prompt information corresponding to the fatigue state of the target driver according to the fatigue state of the target driver includes: When the fatigue state of the target driver is the mild fatigue, controlling the combined instrument of the target vehicle to display safe driving prompt information; When the fatigue state of the target driver is the moderate fatigue, controlling the vehicle-mounted buzzer of the target vehicle to broadcast safe driving prompt information; When the fatigue state of the target driver is the severe fatigue, the onboard buzzer of the target vehicle is controlled to broadcast safe driving prompt information, and the onboard air conditioner in the target vehicle is controlled to be turned on so that the onboard air conditioner performs a cold air blowing operation.

4. The safe driving monitoring method according to claim 2, characterized in that: The state information of the target vehicle includes the continuous driving time of the target vehicle; The determining whether the state information of the target vehicle meets the safe driving condition includes: determining whether the continuous driving time of the target vehicle is less than or equal to a preset safe driving time; When the continuous driving time of the target vehicle is less than or equal to the preset safe driving time, the state information representing the target vehicle does not meet the safe driving condition.

5. The safe driving monitoring method according to claim 1, characterized in that: The state information of the target vehicle includes: the travel speed of the target vehicle; The determining whether the behavior information of the target driver and the state information of the target vehicle meet the safe driving condition includes: when the driving speed of the target vehicle is greater than or equal to a first preset speed, determining whether the driving behavior of the target driver has a safety risk according to the behavior information of the target driver; When there is a safety risk in the driving behavior of the target driver, the behavior information characterizing the target driver and the state information of the target vehicle do not meet the safe driving condition.

6. The safe driving monitoring method according to claim 5, characterized in that: The state information of the target vehicle also includes: steering wheel angle; The determining whether the behavior information of the target driver and the state information of the target vehicle meet the safe driving condition includes: when the driving speed of the target vehicle is greater than or equal to a second preset speed, and the steering wheel angle is less than a preset angle, determining whether the target driver is distracted driving the target vehicle according to the behavior information of the target driver; When the target driver is distracted while driving the target vehicle, the behavior information representing the target driver and the state information of the target vehicle do not satisfy the safe driving condition.

7. The safe driving monitoring method according to claim 1, characterized in that: The target vehicle includes: a vehicle-mounted camera, a vehicle control system and an electronic power steering system; The obtaining of the behavior information of the target driver and the state information of the target vehicle includes: Controlling the vehicle-mounted camera to collect video and audio information of the target driver, and determining the behavior information of the target driver based on the collected video and audio information of the target driver; The state information of the target vehicle is obtained from the vehicle control system and the electronic power steering system.

8. The safe driving monitoring method according to claim 1, characterized in that: After controlling the target vehicle to output safe driving prompt information, the method further includes: In response to a safe driving reminder closing operation triggered by the target driver, the target vehicle is controlled to close a function of outputting safe driving reminder information.

9. A safe driving monitoring device, characterized in that: include: An information acquisition module, used to acquire behavior information of a target driver and state information of the target vehicle, wherein the behavior information is used to characterize body movements and facial movements of the target driver when driving the target vehicle; A judgment module, used to judge whether the behavior information of the target driver and / or the state information of the target vehicle meets the safe driving conditions; A control module is used to control the target vehicle to output safe driving prompt information when the behavior information of the target driver and / or the state information of the target vehicle do not meet the safe driving conditions.

10. An electronic device, characterized in that: include: processor; Memory; And a computer program, wherein the computer program is stored in the memory, and the computer program includes instructions, and when the instructions are executed by the processor, the electronic device executes the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 8.

Images