An intelligent driver behavior monitoring and safety reminding system and a control method thereof

Abstract

The application provides a kind of intelligent driver behavior monitoring and safety reminding system and its control method, including driver monitoring camera, which is used to obtain the image information of driver in real time;Vehicle control module, which is used to obtain the state information of vehicle in real time, and control vehicle state;Driver detection system, connected with the driver monitoring camera and vehicle information detection module, the driver detection system analyzes the driver image information obtained by driver monitoring camera and the vehicle state information obtained by the vehicle information detection module;Driver interaction system, connected with driver detection system, the driver interaction system receives the feedback instruction.The application makes the driver detection system further analyze whether abnormal action occurs to driver by vehicle state signal and driver image, and further reminds and guides driver to return to normal driving behavior through the adjustment of vehicle state.

Description

TECHNICAL FIELD

[0001] The present application mainly relates to the technical field of new energy vehicle safety, and particularly relates to an intelligent driver behavior monitoring and safety reminding system and a control method thereof. BACKGROUND

[0002] With the gradual and steady improvement of the automation level of vehicles, the driver is likely to be distracted due to fatigue, lack of concentration or dangerous actions in the actual driving process. In order to ensure the safe driving of the driver, an operation behavior monitoring system is currently applied to the car.

[0003] The existing driver monitoring system usually has the characteristic of single function, and it is difficult to effectively monitor and timely and accurately remind various different driving behaviors. SUMMARY

[0004] The present application mainly provides an intelligent driver behavior monitoring and safety reminding system to solve the technical problems in the background art.

[0005] The technical solution adopted by the present application to solve the above technical problems is:

[0006] An intelligent driver behavior monitoring and safety reminding system, comprising:

[0007] A driver monitoring camera for acquiring image information of the driver in real time;

[0008] A vehicle control module for acquiring state information of the vehicle in real time and controlling the state of the vehicle;

[0009] A driver detection system connected with the driver monitoring camera and the vehicle information detection module, the driver detection system analyzes the driver image information acquired by the driver monitoring camera and the vehicle state information acquired by the vehicle information detection module to obtain a driver abnormal action result, generates a feedback instruction and a motion instruction according to the driver abnormal action result, and the vehicle control module adjusts the state of the vehicle according to the motion instruction;

[0010] A driver interaction system connected with the driver detection system, the driver interaction system receives the feedback instruction and reminds the driver according to the feedback instruction.

[0011] Further, the vehicle state information acquired by the vehicle control module includes wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left side window information, right side window information and air conditioning information, and the vehicle control module comprises:

[0012] A brake-by-wire system for sending wheel speed information to the driver detection system;

[0013] combination switch module for sending gear information to the driver detection system;

[0014] rear motor control unit for sending rear motor wheel speed to the driver detection system;

[0015] front motor control unit for sending front motor wheel speed to the driver detection system;

[0016] left side window controller for sending left side window information to the driver detection system.

[0017] Further, the vehicle control module comprises:

[0018] right side window controller for sending right side window information to the driver detection system;

[0019] electric air outlet module for sending air conditioning information to the driver detection system.

[0020] Further, the driver abnormal action result obtained by the driver detection system comprises fatigue driving behavior, distraction driving behavior and dangerous action driving behavior, and the driver detection system comprises:

[0021] right domain controller connected with the right side window controller and the electric air outlet module, the right domain controller being configured to receive vehicle state information and simplify electronic circuits of the right side window controller and the electric air outlet module; the right domain controller being configured to analyze the vehicle state information to obtain right side window lifting height and vehicle interior air conditioning information, and generate negative ion opening state feedback signal, air conditioning air speed feedback signal and air conditioning internal and external circulation mode switching feedback signal according to the right side window lifting height and the vehicle interior air conditioning information.

[0022] left domain controller connected with the brake-by-wire system, the combination switch module, the rear motor control unit, the front motor control unit and the left side window controller, the left domain controller being configured to receive vehicle state information and simplify electronic circuits of the brake-by-wire system, the combination switch module, the rear motor control unit, the front motor control unit and the left side window controller; the left domain controller being connected with the right domain controller, and the left domain controller being configured to receive the negative ion opening state feedback signal, the air conditioning air speed feedback signal and the air conditioning internal and external circulation mode switching feedback signal sent by the right domain controller.

[0023] Further, the feedback instruction generated by the driver detection system comprises text reminder signal, distraction driving warning sound signal, camera blocked or failure feedback signal, voice reminder signal and volume adjustment signal, the motion instruction generated by the driver detection system comprises negative ion opening request signal, air conditioning air speed reduction request signal, vehicle window opening angle request signal and air conditioning internal and external circulation mode switching request signal, and the driver detection system further comprises:

[0024] The digital cockpit is connected with the driver monitoring camera, and is used for receiving and analyzing image information of the driver sent by the driver monitoring camera. The digital cockpit is also connected with the left domain controller, and receives vehicle state information sent by the left domain controller. The digital cockpit generates feedback instructions according to the driver image information sent by the driver monitoring camera, and the negative ion opening state feedback signal, the air conditioner wind speed feedback signal, the air conditioner internal and external circulation mode switching feedback signal, the steering wheel angle signal, the actual gear signal and the vehicle speed signal sent by the left domain controller. The left domain controller receives the feedback instructions and sends the feedback instructions to the right domain controller. The right domain controller generates a window control signal and a wind speed adjustment signal according to the above signals. The right window controller receives the window control signal, and the electric air outlet module receives the wind speed adjustment signal.

[0025] Further, the driver interaction system comprises:

[0026] The combination instrument is connected with the digital cockpit, and receives the text reminder signal, the distracted driving warning sound signal and the camera shielding or failure feedback signal. The combination instrument performs text prompting according to the text reminder signal, the distracted driving warning sound signal and the camera shielding or failure feedback signal.

[0027] The audio power amplifier module is connected with the digital cockpit, and receives the voice reminder signal and the volume adjustment signal. The audio power amplifier module generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal.

[0028] The loudspeaker is connected with the audio power amplifier module, and receives the voice reminder instruction and the volume adjustment instruction. The loudspeaker plays voice reminders and adjusts the volume according to the voice reminder instruction and the volume adjustment instruction.

[0029] According to the technical scheme of the intelligent driver behavior monitoring and safety reminding system, an intelligent driver behavior monitoring and safety reminding system control method is also provided, which comprises the following steps:

[0030] Step one, obtaining the vehicle state information through the vehicle control module, and obtaining the image information of the driver through the driver monitoring camera;

[0031] Step two, the driver detection system receives the vehicle condition information sent by the vehicle control module and the driver image information obtained by the driver monitoring camera. The driver detection system determines whether to perform driver behavior monitoring and safety reminding according to the vehicle condition information. If the driver behavior monitoring and safety reminding is performed, the driver detection system determines whether the driver abnormal action occurs according to the vehicle condition information and the driver image information.

[0032] Step three, if the driver abnormal action occurs, the driver detection system opens the intelligent care mode through the driver abnormal action, and generates different feedback instructions and motion instructions according to different intelligent care modes;

[0033] Step four, the driver interaction system carries out voice reminding and graphic text reminding according to the different feedback instructions obtained in step three, and the vehicle control module adjusts the vehicle state according to the different motion instructions obtained in step three, so as to remind the driver to return to normal driving behavior by adjusting the vehicle state.

[0034] Further, the driver abnormal action obtained in step two includes fatigue driving behavior, distraction driving behavior and dangerous action driving behavior, if the intelligent care of fatigue driving behavior is opened, the voice reminding about fatigue driving is played through the loudspeaker, the graphic text reminding about fatigue driving is played through the combination instrument, the vehicle window is controlled to be lowered through the left and right window controllers, and the air conditioner is controlled to be opened through the electric air outlet module, so as to remind the driver to return to normal driving behavior.

[0035] Further, if the intelligent care of distraction driving behavior is opened, the voice reminding about distraction driving is played through the loudspeaker, the graphic text reminding about distraction driving is played through the combination instrument, the vehicle window is controlled to be lowered through the left and right window controllers, the air conditioner is controlled to be opened through the electric air outlet module, and the volume of the voice reminding, the eye-catching degree of the graphic text reminding and the opening size of the vehicle window are adjusted, so as to remind the driver to return to normal driving behavior.

[0036] Further, if the intelligent care of dangerous action driving behavior is opened, the voice reminding about dangerous action driving is played through the loudspeaker, the graphic text reminding about dangerous action driving is played through the combination instrument, the vehicle window is controlled to be lowered through the left and right window controllers, the air conditioner is controlled to be opened through the electric air outlet module, and the volume of the voice reminding, the eye-catching degree of the graphic text reminding, the opening size of the vehicle window and the air inlet and outlet of the air conditioner are adjusted, so as to remind the driver to return to normal driving behavior.

[0037] Compared with the prior art, the present application has the following advantages:

[0038] Firstly, in the present application, the driver detection system analyzes the vehicle state information obtained by the vehicle information detection module, so that the driver detection system further analyzes whether the driver has abnormal action through the vehicle state information and the driver image.

[0039] Secondly, in the present application, the driver detection system can generate instructions according to the driver abnormal action result, the driver interaction system reminds the driver through voice and image according to the instructions, and the vehicle control module adjusts the vehicle state according to the instructions, so as to further remind and guide the driver to return to normal driving behavior through the adjustment of the vehicle state.

[0040] The application will be described in greater detail with reference to the accompanying drawings, in which specific embodiments of the application are shown. BRIEF DESCRIPTION OF DRAWINGS

[0041] Figure 1 System block diagram of the application;

[0042] Figure 2 Flow chart of the application.

[0043] In the figure: 10, driver monitoring camera; 20, vehicle control module; 21, line control braking system; 22, combination switch module; 23, rear motor control unit; 24, front motor control unit; 25, left side window controller; 26, right side window controller; 27, electric air outlet module; 30, driver detection system; 31, right field controller; 32, left field controller; 33, digital cockpit; 40, driver interaction system; 41, combination instrument; 42, audio power amplifier module; 43, loudspeaker. DETAILED DESCRIPTION

[0044] In order to facilitate the understanding of the application, the application will be described more fully below with reference to the accompanying drawings, in which several embodiments of the application are given. However, the application can be realized in different forms and is not limited to the embodiments described herein. On the contrary, these embodiments are provided to make the disclosure of the application more thorough and comprehensive.

[0045] It should be noted that when an element is referred to as being "fixedly attached" to another element, it can be directly on the other element or there can be intervening elements, and when an element is referred to as being "connected" to another element, it can be directly connected to the other element or there can be intervening elements. The terms "vertical", "horizontal", "left", "right", and similar expressions used herein are for illustrative purposes only.

[0046] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0047] The embodiment of the present application provides an intelligent driver behavior monitoring and safety reminding system, and a schematic diagram of the intelligent driver behavior monitoring and safety reminding system is as shown in the figure Figure 1As shown. An intelligent driver behavior monitoring and safety reminder system includes a driver monitoring camera 10, which is used to acquire driver image information in real time; a vehicle control module 20, which is used to acquire vehicle status information in real time and control the vehicle status; a driver detection system 30, connected to the driver monitoring camera 10 and the vehicle information detection module, which analyzes the driver image information acquired by the driver monitoring camera 10 and the vehicle status information acquired by the vehicle information detection module to obtain abnormal driver actions, and generates feedback instructions and motion instructions based on the abnormal driver actions, and the vehicle control module 20 adjusts the vehicle status according to the motion instructions; and a driver interaction system 40, connected to the driver detection system 30, which receives feedback instructions and reminds the driver according to the feedback instructions.

[0048] In this embodiment, the driver detection system 30 analyzes the driver image information acquired by the driver monitoring camera 10 to determine whether the driver has made any abnormal movements.

[0049] The driver detection system 30 analyzes the vehicle status information obtained by the vehicle information detection module, enabling the driver detection system 30 to further analyze whether the driver has made any abnormal actions by combining the vehicle status information with the driver image.

[0050] The driver detection system 30 generates feedback instructions and motion instructions based on the abnormal actions of the driver. The driver interaction system reminds the driver based on the feedback instructions. At the same time, the vehicle control module adjusts the vehicle status based on the motion instructions, so as to further remind and guide the driver to return to normal driving behavior through the adjustment of the vehicle status.

[0051] Optionally, such as Figure 1 As shown, the vehicle status information acquired by the vehicle control module 20 includes wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left window information, right window information, and air conditioning information. The vehicle control module 20 includes a brake-by-wire system 21 for sending wheel speed information to the driver detection system 30; a combination switch module 22 for sending gear information to the driver detection system 30; a rear motor control unit 23 for sending rear motor wheel speed to the driver detection system 30; a front motor control unit 24 for sending front motor wheel speed to the driver detection system 30; and a left window controller 25 for sending left window information to the driver detection system 30.

[0052] The vehicle control module 20 includes a right-side window controller 26 for sending right-side window information to the driver detection system 30; and an electric air vent module 27 for sending air conditioning information to the driver detection system 30.

[0053] In this embodiment, wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, and left window information are obtained through the brake-by-wire system 21, combination switch module 22, rear motor control unit 23, front motor control unit 24, and left window controller 25.

[0054] Information about the right-side window and air conditioning is obtained through the right-side window controller 26 and the electric air vent module 27.

[0055] Optionally, such as Figure 1 As shown, the abnormal driver actions obtained by the driver detection system 30 include fatigued driving behavior, distracted driving behavior, and dangerous driving behavior. The driver detection system 30 includes a right domain controller 31, which is connected to the right side window controller 26 and the electric air vent module 27. The right domain controller 31 is used to receive information from the right side window and the air conditioning, and to simplify the electronic circuitry of the right side window controller 26 and the electric air vent module 27. The right domain controller 31 analyzes the right side window and air conditioning information to obtain the right side window lifting height and the in-vehicle air conditioning information, and generates a negative ion activation status feedback signal, an air conditioning fan speed feedback signal, and an air conditioning internal / external circulation mode switching feedback signal based on the right side window lifting height and the in-vehicle air conditioning information.

[0056] The left domain controller 32 is connected to the brake-by-wire system 21, the combination switch module 22, the rear motor control unit 23, the front motor control unit 24, and the left window controller. The left domain controller 32 is used to receive wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, and left window information, and simplifies the electronic circuitry of the brake-by-wire system 21, the combination switch module 22, the rear motor control unit 23, the front motor control unit 24, and the left window controller 25. The left domain controller 32 is connected to the right domain controller 31. The left domain controller 32 is used to receive negative ion activation status feedback signals, air conditioning fan speed feedback signals, and air conditioning internal / external circulation mode switching feedback signals sent by the right domain controller 31.

[0057] In this embodiment, the left domain controller 32 cooperates with the right domain controller 31 to receive vehicle control information, and the configuration of the left domain controller 32 and the right domain controller 31 simplifies the wiring of each component in the vehicle control module 20.

[0058] Optionally, such as Figure 1As shown, the feedback instructions generated by the driver detection system 30 include a text reminder signal, a distraction driving warning sound signal, a camera blocked or malfunction feedback signal, a voice reminder signal, and a volume adjustment signal. The motion instructions generated by the driver detection system 30 include a negative ion opening request signal, an air conditioner wind speed reduction request signal, a vehicle window opening angle request signal, and an air conditioner internal and external circulation mode switching request signal. The driver detection system 30 further includes a digital cockpit 33 connected to the driver monitoring camera 10. The digital cockpit 33 is configured to receive and analyze the image information of the driver sent by the driver monitoring camera 10. The digital cockpit 33 is further connected to the left domain controller 32 and receives the vehicle state information sent by the left domain controller 32. The digital cockpit 33 generates feedback instructions based on the driver image information sent by the driver monitoring camera 10 and the negative ion opening state feedback signal, the air conditioner wind speed feedback signal, the air conditioner internal and external circulation mode switching feedback signal, the steering wheel angle signal, the actual gear signal, and the vehicle speed signal sent by the left domain controller 32. The left domain controller 32 receives the feedback instructions and sends them to the right domain controller 31. The right domain controller 31 generates vehicle window control signals and wind speed adjustment signals based on the above signals. The right vehicle window controller 26 receives the vehicle window control signals, and the electric air outlet module 27 receives the wind speed adjustment signals.

[0059] For example, the driver detection system 30 further includes a digital cockpit 33 connected to the driver monitoring camera 10. The digital cockpit 33 is configured to receive and analyze the image information of the driver sent by the driver monitoring camera 10. The digital cockpit 33 is further connected to the left domain controller 32 and receives the negative ion opening state feedback signal, the air conditioner wind speed feedback signal, the air conditioner internal and external circulation mode switching feedback signal, the steering wheel angle signal, and the actual gear signal and vehicle speed signal sent by the left domain controller 32.

[0060] The digital cockpit 33 generates a text reminder signal, a distraction driving warning sound signal, a camera blocked or malfunction feedback signal, a voice reminder signal, a volume adjustment signal, a negative ion opening request signal, an air conditioner wind speed reduction request signal, a vehicle window opening angle request signal, and an air conditioner internal and external circulation mode switching request signal based on the driver image information sent by the driver monitoring camera 10 and the negative ion opening state feedback signal, the air conditioner wind speed feedback signal, the air conditioner internal and external circulation mode switching feedback signal, the steering wheel angle signal, the actual gear signal, and the vehicle speed signal sent by the left domain controller 32.

[0061] The left domain controller 32 receives the negative ion opening request signal, the air conditioner wind speed reduction request signal, the vehicle window opening angle request signal, and the air conditioner internal and external circulation mode switching request signal, and sends the above signals to the right domain controller 31. The right domain controller 31 generates a vehicle window control signal and a wind speed adjustment signal according to the above signals. The right vehicle window controller 26 receives the vehicle window control signal, and the electric air outlet module 27 receives the wind speed adjustment signal.

[0062] Optionally, as shown in Figure 1 The driver interaction system 40 includes an instrument cluster 41 connected with the digital cockpit 33, receiving the text reminder signal, the distracted driving warning sound signal, and the camera blocked or failure feedback signal. The instrument cluster 41 gives a text prompt according to the text reminder signal, the distracted driving warning sound signal, and the camera blocked or failure feedback signal.

[0063] The audio power amplifier module 42 is connected with the digital cockpit 33, receiving the voice reminder signal and the volume adjustment signal. The audio power amplifier module 42 generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal.

[0064] The loudspeaker 43 is connected with the audio power amplifier module 42, receiving the voice reminder instruction and the volume adjustment instruction. The loudspeaker plays a voice reminder and adjusts the volume size according to the voice reminder instruction and the volume adjustment instruction.

[0065] The instrument cluster 41 is connected with the digital cockpit 33, receiving the text reminder signal, the distracted driving warning sound signal, and the camera blocked or failure feedback signal. The instrument cluster 41 gives a text prompt according to the text reminder signal, the distracted driving warning sound signal, and the camera blocked or failure feedback signal.

[0066] The audio power amplifier module 42 is connected with the digital cockpit 33, receiving the voice reminder signal and the volume adjustment signal. The audio power amplifier module 42 generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal.

[0067] The loudspeaker 43 is connected with the audio power amplifier module 42, receiving the voice reminder instruction and the volume adjustment instruction. The loudspeaker 43 plays a voice reminder and adjusts the volume size according to the voice reminder instruction and the volume adjustment instruction.

[0068] Based on the same inventive concept, the embodiment also provides a control method of the intelligent driver behavior monitoring and safety reminding system, including the following steps.

[0069] Step one, obtaining the state information of the vehicle through the vehicle control module 20, and obtaining the image information of the driver through the driver monitoring camera 10.

[0070] Step two, the driver detection system 30 receives the vehicle condition information sent by the vehicle control module 20 and the driver image information obtained by the driver monitoring camera 10, and judges whether to execute the driver behavior monitoring and safety reminding according to the vehicle condition information. If the driver behavior monitoring and safety reminding is executed, the driver detection system 30 judges whether the driver abnormal action occurs according to the vehicle condition information and the driver image information.

[0071] Step three, if the driver abnormal action occurs, the driver detection system 30 opens the intelligent care mode through the driver abnormal action, and generates different feedback instructions and motion instructions according to different intelligent care modes.

[0072] Step four, the driver interaction system 40 performs voice reminding and graphic text reminding according to the different feedback instructions obtained in step three, and the vehicle control module 20 adjusts the vehicle state according to the different motion instructions obtained in step three, so as to remind the driver to return to normal driving behavior through adjusting the vehicle state.

[0073] In this embodiment, the abnormal driving action of the driver is obtained by real-time monitoring of the driver behavior, and multi-level safety reminding is provided according to different abnormal driving actions of the driver, so as to effectively improve the driving safety.

[0074] Optionally, as shown in the figure, Figure 2 The driver abnormal action obtained in step two includes fatigue driving behavior, distraction driving behavior and dangerous action driving behavior. If the intelligent care of fatigue driving behavior is opened, the voice reminding about fatigue driving is played through the loudspeaker 43, the graphic text reminding about fatigue driving is played through the combination instrument panel 41, the vehicle window is controlled to be lowered through the left and right window controllers 26, and the air conditioner is controlled to be opened through the electric air outlet module 27, so as to remind the driver to return to normal driving behavior.

[0075] For example, when the camera monitors that the driver has fatigue behavior, the system judges the fatigue driving into two levels of heavy and light by combining the current driving time obtained by the vehicle control module 20, and different levels of prompting are provided respectively. When the light fatigue driving behavior (yawning and closing eyes for a short time) is monitored, the voice reminding "you have light fatigue" is played through the loudspeaker 43, and the text prompting is displayed on the combination instrument panel 41 for 10 seconds. If the driver continues the above fatigue driving behavior, the reminding is continued at intervals of 3 seconds until the action stops. If the action continues during the period, no response is given.

[0076] When the heavy fatigue driving behavior (closing eyes for more than 2 seconds) is monitored, the loudspeaker 43 reminds you that you have heavy fatigue, and the combination instrument panel 41 displays the text prompting for 10 seconds.

[0077] If the driver continues the fatigue driving behavior, the system continues to remind every 3 seconds until the action stops, and the system does not react during the continued action.

[0078] When both the mild fatigue driving behavior and the severe fatigue driving behavior exist, the system sends a signal state of the severe fatigue driving level value, and executes the action of the severe fatigue driving behavior.

[0079] The condition for not enabling the intelligent care function of the fatigue driving behavior is that the vehicle power gear is switched to the off state.

[0080] Through the information obtained by the camera and the vehicle control module 20, the degree of fatigue driving is distinguished, and corresponding vehicle reminding actions are executed according to the fatigue degree of the driver, so as to provide multi-level safety reminders about fatigue driving in this way, and further improve driving safety.

[0081] Optionally, as shown in Figure 2 If the intelligent care of the distraction driving behavior is enabled, the system plays a voice reminder about the distraction driving through the loudspeaker 43, plays a text and image reminder about the distraction driving through the combination instrument 41, controls the window to be lowered through the left and right window controllers 26, controls the air conditioner to be turned on through the electric air outlet module 27, and adjusts the volume of the voice reminder, the prominence of the text and image reminder, and the opening size of the window, so as to remind the driver to return to the normal driving behavior.

[0082] For example, during driving, all behaviors that do not pay attention to driving are called distraction behaviors (such as looking down for something, looking left and right, etc.), and the system monitors the above behaviors for 3 seconds, and plays a voice reminder through the loudspeaker 43: please concentrate, drive carefully, and at the same time, the combination instrument 41 plays a text prompt and a warning sound reminder (by default) for 10 seconds. The air conditioner is turned on through the electric air outlet module 27, and the window is lowered through the left and right window controllers 26, so as to further remind the driver to return to the normal driving behavior through the opening and closing of the air conditioner and the window and adjustment.

[0083] If the driver continues the distraction behavior, the system continues to remind every 3 seconds until the action stops, and the system does not react during the continued action.

[0084] The driver monitoring camera 10 is used to observe the driver's action, so as to reduce false positives, for example, observing that the driver looks at the outside mirror, looks at the rear blind spot, etc. is not considered as a distraction behavior.

[0085] When the attention and fatigue monitoring work together, the distraction alarm is preferentially reminded when both distraction and fatigue occur.

[0086] The condition for not enabling the intelligent care function of the distraction driving behavior is that the vehicle power gear is switched to the off state.

[0087] Compared with the fatigue driving behavior, the distraction driving behavior is more likely to cause danger, so the safety reminding mode is increased to further improve the driving safety.

[0088] Optionally, as shown in Figure 2 If the intelligent care of dangerous driving behavior is started, the voice reminder about the dangerous driving is played through the loudspeaker 43, the text and picture reminder about the dangerous driving is played through the combination instrument panel 41, the vehicle window is controlled to be lowered through the left and right window controllers 26, the air conditioner is controlled to be turned on through the electric air outlet module 27, and the volume of the voice reminder, the prominence of the text and picture reminder, the opening size of the vehicle window, and the air inlet and outlet of the vehicle air conditioner are adjusted to remind the driver to return to the normal driving behavior.

[0089] When the camera monitors the dangerous driving behavior (such as smoking, drinking, and making a phone call) for 3 seconds, the intelligent care reminds the driver to pay attention to the driving safety through the combination instrument panel 41 and the loudspeaker 43, and the text prompt on the combination instrument panel 41 lasts for 10 seconds. If the driver continues the dangerous driving behavior, the reminder is continued at intervals of 3 seconds until the behavior is stopped. If the driver continues the behavior during the reminder, no response is given.

[0090] When the driver's smoking behavior is monitored, no dangerous driving reminder is given, and the intelligent care of the dangerous driving behavior is activated according to the conditions, the electric air outlet module 27 is turned on to realize the opening of the negative ion purification and the switching of the internal and external circulation, and the left and right window controllers 25 and 26 are turned on to open the vehicle window by 30°.

[0091] When the driver's phone call behavior is monitored, no dangerous driving reminder is given, and the media playback volume and the air conditioner speed are actively reduced (by 10). After the phone call is finished, the media playback volume is actively restored. When the phone Bluetooth is connected with the car Bluetooth, the incoming call and the phone call actively reduce the volume and the air conditioner speed, and the Bluetooth strategy is preferentially executed. The driver monitoring camera does not perform repeated operations.

[0092] The condition for not starting the intelligent care function of the dangerous driving behavior is that the vehicle power supply gear is switched to the off state.

[0093] The information obtained through the camera and the vehicle control module 20 is used to distinguish the dangerous behavior, so that corresponding vehicle reminding actions are performed according to the dangerous behavior of the driver, so as to provide multi-level safety reminders about the fatigue driving in this way to further improve the driving safety.

[0094] The application is described above by way of example with reference to the accompanying drawings, and it is obvious that the specific implementation of the application is not limited to the above-described manner, and as long as such non-essential improvements are made by adopting the method concept and technical solutions of the application, or the concept and technical solutions of the application are directly applied to other occasions without improvement, they are all within the protection scope of the application.

Claims

1. An intelligent driver behavior monitoring and safety alert system, characterized by, The application relates to a driver monitoring system and a vehicle control module. The driver monitoring system comprises a driver monitoring camera for acquiring image information of a driver in real time, a vehicle information detection module for acquiring state information of a vehicle in real time, and a driver detection system connected with the driver monitoring camera and the vehicle information detection module, wherein the driver detection system analyzes the image information of the driver acquired by the driver monitoring camera and the state information of the vehicle acquired by the vehicle information detection module to obtain a driver abnormal action result, generates feedback instructions and motion instructions according to the driver abnormal action result, and the vehicle control module adjusts the state of the vehicle according to the motion instructions. The driver interaction system is connected with the driver detection system, receives the feedback instructions, and reminds the driver according to the feedback instructions. The state information of the vehicle acquired by the vehicle control module comprises wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left side window information, right side window information and air conditioner information. The vehicle control module comprises a brake-by-wire system for sending the wheel speed information to the driver detection system, a combination switch module for sending the gear information to the driver detection system, a rear motor control unit for sending the rear motor wheel speed to the driver detection system, a front motor control unit for sending the front motor wheel speed to the driver detection system, a left side window controller for sending the left side window information to the driver detection system, a right side window controller for sending the right side window information to the driver detection system, and an electric air outlet module for sending the air conditioner information to the driver detection system. The driver abnormal action result obtained by the driver detection system comprises a fatigue driving behavior, a distraction driving behavior and a dangerous action driving behavior. The driver detection system comprises a right domain controller connected with the right side window controller and the electric air outlet module, which is used for receiving the state information of the vehicle and simplifying the electronic circuits of the right side window controller and the electric air outlet module; the right domain controller analyzes the state information of the vehicle to obtain the lifting height of the right side window and the air conditioner information in the vehicle, and generates a negative ion opening state feedback signal, an air conditioner wind speed feedback signal and an air conditioner internal and external circulation mode switching feedback signal according to the lifting height of the right side window and the air conditioner information in the vehicle. The left domain controller is connected with the brake-by-wire system, the combination switch module, the rear motor control unit, the front motor control unit and the left side window controller, and is used for receiving the state information of the vehicle and simplifying the electronic circuits of the brake-by-wire system, the combination switch module, the rear motor control unit, the front motor control unit and the left side window controller; the left domain controller is connected with the right domain controller, and is used for receiving the negative ion opening state feedback signal, the air conditioner wind speed feedback signal and the air conditioner internal and external circulation mode switching feedback signal sent by the right domain controller. ​ ​ ​ ​ ​ 2. The intelligent driver behavior monitoring and safety alert system according to claim 1, wherein, ​ ​ ​ 3. The intelligent driver behavior monitoring and safety alert system according to claim 2, wherein, The feedback instructions generated by the driver detection system include a text reminder signal, a distraction driving warning sound signal, a camera blocked or malfunction feedback signal, a voice reminder signal, and a volume adjustment signal. The motion instructions generated by the driver detection system include a negative ion opening request signal, an air conditioner wind speed reduction request signal, a vehicle window opening angle request signal, and an air conditioner internal and external circulation mode switching request signal. The driver detection system further comprises: A digital cockpit connected to the driver monitoring camera, the digital cockpit being configured to receive and analyze image information of the driver sent by the driver monitoring camera. The digital cockpit is also connected to the left domain controller and receives vehicle state information sent by the left domain controller. The digital cockpit generates feedback instructions based on the driver image information sent by the driver monitoring camera and the negative ion opening state feedback signal, the air conditioner wind speed feedback signal, the air conditioner internal and external circulation mode switching feedback signal, the steering wheel angle signal, the actual gear signal, and the vehicle speed signal sent by the left domain controller. The left domain controller receives the feedback instructions and sends them to the right domain controller. The right domain controller generates a window control signal and a wind speed adjustment signal based on the above signals. The right window controller receives the window control signal, and the electric air outlet module receives the wind speed adjustment signal.

4. The intelligent driver behavior monitoring and safety alert system according to claim 3, wherein, The driver interaction system comprises: A combination instrument connected to the digital cockpit and receiving a text reminder signal, a distraction driving warning sound signal, and a camera blocked or malfunction feedback signal. The combination instrument provides a text prompt based on the text reminder signal, the distraction driving warning sound signal, and the camera blocked or malfunction feedback signal. An audio power amplifier module connected to the digital cockpit and receiving a voice reminder signal and a volume adjustment signal. The audio power amplifier module generates a voice reminder instruction and a volume adjustment instruction based on the voice reminder signal and the volume adjustment signal. A loudspeaker connected to the audio power amplifier module and receiving the voice reminder instruction and the volume adjustment instruction. The loudspeaker plays a voice reminder and adjusts the volume based on the voice reminder instruction and the volume adjustment instruction.

5. A control method of the intelligent driver behavior monitoring and safety reminding system, using the intelligent driver behavior monitoring and safety reminding system according to any one of claims 1-4, characterized in that, The method comprises the following steps: Step one: obtaining vehicle state information through a vehicle control module and obtaining image information of the driver through a driver monitoring camera; Step two: the driver detection system receives vehicle condition information sent by the vehicle control module and driver image information obtained by the driver monitoring camera. The driver detection system determines whether to perform driver behavior monitoring and safety reminders based on the vehicle condition information. If driver behavior monitoring and safety reminders are performed, the driver detection system determines whether driver abnormal actions occur based on the vehicle condition information and the driver image information; Step three: if driver abnormal actions occur, the driver detection system opens an intelligent care mode through the driver abnormal actions. Different feedback instructions and motion instructions are generated based on different intelligent care modes. Step four, the driver interaction system gives voice and text reminders according to the different feedback instructions obtained in step three, and the vehicle control module adjusts the vehicle state according to the different motion instructions obtained in step three, so as to remind the driver to return to normal driving behavior by adjusting the vehicle state.

6. The control method of the intelligent driver behavior monitoring and safety reminding system according to claim 5, characterized in that, The abnormal driving behaviors obtained in step two include fatigue driving behavior, distraction driving behavior and dangerous driving behavior. If the intelligent care for fatigue driving behavior is turned on, the speaker plays a voice reminder about fatigue driving, the combination instrument plays a text reminder about fatigue driving, the left and right window controllers control the windows to be lowered, and the electric air outlet module controls the air conditioner to be turned on, so as to remind the driver to return to normal driving behavior.

7. The control method of the intelligent driver behavior monitoring and safety reminding system according to claim 6, characterized in that, If the intelligent care for distraction driving behavior is turned on, the speaker plays a voice reminder about distraction driving, the combination instrument plays a text reminder about distraction driving, the left and right window controllers control the windows to be lowered, the electric air outlet module controls the air conditioner to be turned on, and the volume of the voice reminder, the prominence of the text reminder, and the size of the window opening are adjusted, so as to remind the driver to return to normal driving behavior.

8. The control method of the intelligent driver behavior monitoring and safety reminding system according to claim 7, characterized in that, If the intelligent care for dangerous driving behavior is turned on, the speaker plays a voice reminder about dangerous driving, the combination instrument plays a text reminder about dangerous driving, the left and right window controllers control the windows to be lowered, the electric air outlet module controls the air conditioner to be turned on, and the volume of the voice reminder, the prominence of the text reminder, the size of the window opening, and the air inlet and outlet of the air conditioner are adjusted, so as to remind the driver to return to normal driving behavior.

Images