Intelligent driver behavior monitoring and safety reminding system and control method thereof

Abstract

The invention provides an intelligent driver behavior monitoring and safety reminding system and a control method thereof, and the system comprises a driver monitoring camera which is used for obtaining the image information of a driver in real time; the vehicle control module is used for acquiring state information of the vehicle in real time and controlling the state of the vehicle; the driver detection system is connected with the driver monitoring camera and the vehicle information detection module, and the driver detection system analyzes the driver image information acquired by the driver monitoring camera and the vehicle state information acquired by the vehicle information detection module; and the driver interaction system is connected with the driver detection system, and the driver interaction system receives the feedback instruction. According to the invention, the driver detection system is used for further analyzing whether the driver has abnormal actions by matching the vehicle state information with the driver image, and further reminding and guiding the driver to return to normal driving behaviors by adjusting the vehicle state.

Description

Technical Field

[0001] The present invention mainly relates to the technical field of new energy vehicle safety, and specifically to an intelligent driver behavior monitoring and safety reminder system and a control method thereof. Background Art

[0002] As the level of vehicle automation gradually and steadily improves, drivers are very likely to become distracted by fatigue, lack of concentration, or make dangerous actions during actual driving. In order to ensure the driver's safe driving, operation behavior monitoring systems are currently being used in cars.

[0003] Existing driver monitoring systems usually have single functions and are unable to effectively monitor and promptly and accurately remind all kinds of different driving behaviors. Summary of the invention

[0004] The present invention mainly provides an intelligent driver behavior monitoring and safety reminder system to solve the technical problems raised in the above background technology.

[0005] The technical solution adopted by the present invention to solve the above technical problems is:

[0006] An intelligent driver behavior monitoring and safety reminder system, comprising:

[0007] A driver monitoring camera, which is used to obtain image information of the driver in real time;

[0008] A vehicle control module, which is used to obtain vehicle status information in real time and control the vehicle status;

[0009] a driver detection system connected to the driver monitoring camera and the vehicle information detection module, wherein the driver detection system analyzes the driver image information acquired by the driver monitoring camera and the vehicle status information acquired by the vehicle information detection module to obtain the driver's abnormal action result, generates a feedback instruction and a motion instruction according to the driver's abnormal action result, and the vehicle control module adjusts the vehicle status according to the motion instruction;

[0010] The driver interaction system is connected to the driver detection system, and the driver interaction system receives the feedback instruction and reminds the driver according to the feedback instruction.

[0011] Further, the vehicle status information acquired by the vehicle control module includes wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left window information, right window information and air conditioning information, and the vehicle control module includes:

[0012] a brake-by-wire system that sends wheel speed information to the driver detection system;

[0013] Combination switch module, used to send gear position information to the driver detection system;

[0014] A rear motor control unit for sending rear motor wheel speed to a driver detection system;

[0015] Front motor control unit, used to send the front motor wheel speed to the driver detection system;

[0016] The left window air sensor is used to send the left window information to the driver detection system.

[0017] Furthermore, the vehicle control module includes:

[0018] A right window controller, used to send right window information to the driver detection system;

[0019] Electric air outlet module, used to send air conditioning information to the driver detection system.

[0020] Furthermore, the abnormal driver behavior results obtained by the driver detection system include fatigue driving behavior, distracted driving behavior and dangerous driving behavior, and the driver detection system includes:

[0021] A right domain controller is connected to the right window controller and the electric air outlet module, and is used to receive vehicle status information and simplify the electronic circuits of the right window controller and the electric air outlet module; the right domain controller analyzes the vehicle status information to obtain the right window lifting height and in-vehicle air conditioning information, and generates a negative ion opening state feedback signal, an air conditioning wind speed feedback signal, and an air conditioning internal and external circulation mode switching feedback signal according to the right window lifting height and in-vehicle air conditioning information;

[0022] The left domain controller is connected with the wire control brake system, the combination switch module, the rear motor control unit, the front motor control unit and the left window controller. The left domain controller is used to receive vehicle status information and simplify the electronic circuits of the wire control brake system, the combination switch module, the rear motor control unit, the front motor control unit and the left window air conditioner; the left domain controller is connected with the right domain controller. The left domain controller is used to receive the negative ion opening status feedback signal, the air conditioning wind speed feedback signal, and the air conditioning internal and external circulation mode switching feedback signal sent by the right domain controller.

[0023] Furthermore, the feedback instructions generated by the driver detection system include text reminder signals, distracted driving warning sound signals, camera obstruction or fault feedback signals, voice reminder signals, and volume adjustment signals. The motion instructions generated by the driver detection system include negative ion opening request signals, air conditioning wind speed reduction request signals, window opening angle request signals, and air conditioning internal and external circulation mode switching request signals. The driver detection system also includes:

[0024] A digital cockpit is connected to a driver monitoring camera. The digital cockpit is used to receive and analyze the image information of the driver sent by the driver monitoring camera. The digital cockpit is also connected to a left domain controller and receives the vehicle status information sent by the left domain controller. The digital cockpit generates a feedback instruction based on the driver image information sent by the driver monitoring camera and the negative ion opening status feedback signal, air conditioning wind speed feedback signal, air conditioning internal and external circulation mode switching feedback signal, steering wheel angle signal, actual gear position signal and vehicle speed signal sent by the left domain controller. The left domain controller receives the feedback instruction and sends the feedback instruction to the right domain controller. The right domain controller generates a window control signal and a wind speed adjustment signal based on the above signals. The right window controller receives the window control signal, and the electric air outlet module receives the wind speed adjustment signal.

[0025] Furthermore, the driver interaction system includes:

[0026] A combination instrument is connected to the digital cockpit, and receives a text reminder signal, a distracted driving warning sound signal, and a camera blocked or faulty feedback signal, and the combination instrument gives a text reminder according to the text reminder signal, the distracted driving warning sound signal, and the camera blocked or faulty feedback signal;

[0027] An audio power amplifier module is connected to the digital cockpit and receives a voice reminder signal and a volume adjustment signal. The audio power amplifier module generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal;

[0028] The speaker is connected to the audio power amplifier module and receives the voice reminder instruction and the volume adjustment instruction. The speaker plays the voice reminder and adjusts the volume according to the voice reminder instruction and the volume adjustment instruction.

[0029] According to the above technical solution of the intelligent driver behavior monitoring and safety reminder system, a control method of the intelligent driver behavior monitoring and safety reminder system is also provided, comprising the following steps:

[0030] Step 1: obtaining vehicle status information through a vehicle control module and obtaining driver image information through a driver monitoring camera;

[0031] Step 2: The driver detection system receives the vehicle status information sent by the vehicle control module and the driver image information obtained by the driver monitoring camera. The driver detection system determines whether to perform driver behavior monitoring and safety reminders based on the vehicle status information. If driver behavior monitoring and safety reminders are performed, the driver detection system determines whether abnormal driver behavior occurs based on the vehicle status information and the driver image information.

[0032] Step 3: If an abnormal driver action occurs, the driver detection system activates the intelligent care mode through the abnormal driver action, and generates different feedback instructions and motion instructions according to different intelligent care modes;

[0033] In step 4, the driver interaction system provides voice reminders and graphic reminders according to the different feedback instructions obtained in step 3. The vehicle control module adjusts the vehicle state according to the different motion instructions obtained in step 3, and reminds the driver to return to normal driving behavior by adjusting the vehicle state.

[0034] Furthermore, the abnormal driver actions obtained in the step two include fatigue driving behavior, distracted driving behavior and dangerous driving behavior. If the intelligent care for fatigue driving behavior is turned on, a voice reminder about fatigue driving is played through the speaker, a graphic reminder about fatigue driving is played through the instrument cluster, the window is controlled to be lowered through the left window controller and the right window controller, and the air conditioner is controlled to be turned on through the electric air outlet module, so as to remind the driver to return to normal driving behavior.

[0035] Furthermore, if the intelligent care for distracted driving behavior is turned on, voice reminders about distracted driving will be played through the speaker, graphic reminders about distracted driving will be played through the instrument cluster, the windows will be controlled to be lowered through the left window controller and the right window controller, the air conditioner will be controlled to be turned on through the electric air outlet module, and the volume of the voice reminder, the conspicuousness of the graphic reminder, and the size of the window opening will be adjusted to remind the driver to return to normal driving behavior.

[0036] Furthermore, if the intelligent care for dangerous driving behaviors is turned on, voice reminders about dangerous driving behaviors will be played through the speaker, graphic reminders about dangerous driving behaviors will be played through the instrument cluster, the windows will be lowered by the left window controller and the right window controller, the air conditioner will be turned on by the electric air outlet module, and the volume of the voice reminder, the conspicuousness of the graphic reminder, the size of the window opening, and the air inlet and outlet of the car air conditioner will be adjusted to remind the driver to return to normal driving behavior.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] First, the driver detection system of the present invention analyzes the vehicle status information obtained by the vehicle information detection module, so that the driver detection system further analyzes whether the driver has made abnormal actions through the vehicle status information in conjunction with the driver image.

[0039] Secondly, the driver detection system in the present invention can generate instructions according to the results of the driver's abnormal actions, and the driver interaction system can give voice and image reminders to the driver according to the instructions; the vehicle control module adjusts the vehicle status according to the instructions to further remind and guide the driver to return to normal driving behavior through the adjustment of the vehicle status.

[0040] The present invention will be explained in detail below with reference to the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a system block diagram of the present invention;

[0042] Figure 2 It is a flow chart of the present invention.

[0043] In the figure: 10, driver monitoring camera; 20, vehicle control module; 21, wire control brake system; 22, combination switch module; 23, rear motor control unit; 24, front motor control unit; 25, left window air conditioner; 26, right window controller; 27, electric air outlet module; 30, driver detection system; 31, right domain controller; 32, left domain controller; 33, digital cockpit; 40, driver interaction system; 41, instrument cluster; 42, audio amplifier module; 43, speaker. DETAILED DESCRIPTION

[0044] To facilitate understanding of the present invention, the present invention will be described more comprehensively below with reference to the relevant drawings. Several embodiments of the present invention are given in the drawings, but the present invention can be implemented in different forms and is not limited to the embodiments described in the text. On the contrary, these embodiments are provided to make the content disclosed in the present invention more thorough and comprehensive.

[0045] It should be noted that when an element is referred to as being "fixed on" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used in this article are for illustrative purposes only.

[0046] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly connected by technicians in the technical field to which the present invention belongs. The terminology used in the specification of the present invention is for the purpose of describing specific embodiments and is not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0047] The embodiment of the present application provides an intelligent driver behavior monitoring and safety reminder system. The schematic diagram of the intelligent driver behavior monitoring and safety reminder system is as follows: Figure 1As shown. An intelligent driver behavior monitoring and safety reminder system includes a driver monitoring camera 10, which is used to obtain the image information of the driver in real time; a vehicle control module 20, which is used to obtain the status information of the vehicle in real time and control the vehicle status; a driver detection system 30, which is connected to the driver monitoring camera 10 and the vehicle information detection module, and the driver detection system 30 analyzes the driver image information obtained by the driver monitoring camera 10 and the vehicle status information obtained by the vehicle information detection module to obtain the driver's abnormal action result, generates feedback instructions and motion instructions according to the driver's abnormal action result, and the vehicle control module 20 adjusts the vehicle status according to the motion instruction; a driver interaction system 40, which is connected to the driver detection system 30, and the driver interaction system 40 receives the feedback instruction and reminds the driver according to the feedback instruction.

[0048] In this embodiment, the driver detection system 30 analyzes the driver image information acquired by the driver monitoring camera 10 to determine whether the driver has made an abnormal action through the image information.

[0049] The driver detection system 30 analyzes the vehicle status information acquired by the vehicle information detection module, so that the driver detection system 30 further analyzes whether the driver has made abnormal actions through the vehicle status information in conjunction with the driver image.

[0050] The driver detection system 30 generates feedback instructions and motion instructions based on the results of the driver's abnormal actions, and the driver interaction system reminds the driver based on the feedback instructions; at the same time, the vehicle control module adjusts the vehicle state according to the motion instructions to further remind and guide the driver to return to normal driving behavior through the adjustment of the vehicle state.

[0051] Alternatively, if Figure 1 As shown, the vehicle status information acquired by the vehicle control module 20 includes wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left window information, right window information and air conditioning information. The vehicle control module 20 includes a wire control brake system 21, which is used to send wheel speed information to the driver detection system 30; a combination switch module 22, which is used to send gear information to the driver detection system 30; a rear motor control unit 23, which is used to send the rear motor wheel speed to the driver detection system 30; a front motor control unit 24, which is used to send the front motor wheel speed to the driver detection system 30; and a left window air conditioner 25, which is used to send the left window information to the driver detection system 30.

[0052] The vehicle control module 20 includes a right window controller 26 for sending right window information to the driver detection system 30 ; and an electric air outlet module 27 for sending air conditioning information to the driver detection system 30 .

[0053] In this embodiment, wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, and left window information are obtained through the wire control brake system 21, the combination switch module 22, the rear motor control unit 23, the front motor control unit 24, and the left window air conditioner 25.

[0054] The right window information and air conditioning information are obtained through the right window controller 26 and the electric air outlet module 27.

[0055] Alternatively, if Figure 1 As shown, the abnormal driver behavior results obtained by the driver detection system 30 include fatigue driving behavior, distracted driving behavior and dangerous driving behavior. The driver detection system 30 includes a right domain controller 31, which is connected to the right window controller 26 and the electric air outlet module 27. The right domain controller 31 is used to receive the right window information and air conditioning information, and simplify the electronic circuits of the right window controller 26 and the electric air outlet module 27; the right domain controller 31 analyzes the right window information and air conditioning information to obtain the right window lifting height and the air conditioning information in the car, and generates a negative ion opening state feedback signal, an air conditioning wind speed feedback signal, and an air conditioning internal and external circulation mode switching feedback signal according to the right window lifting height and the air conditioning information in the car.

[0056] The left domain controller 32 is connected to the wire control brake system 21, the combination switch module 22, the rear motor control unit 23, the front motor control unit 24 and the left window controller. The left domain controller 32 is used to receive wheel speed information, gear information, rear motor wheel speed, front motor wheel speed and left window information, and simplify the electronic circuits of the wire control brake system 21, the combination switch module 22, the rear motor control unit 23, the front motor control unit 24 and the left window air conditioner 25; the left domain controller 32 is connected to the right domain controller 31, and the left domain controller 32 is used to receive the negative ion opening state feedback signal, the air conditioning wind speed feedback signal, and the air conditioning internal and external circulation mode switching feedback signal sent by the right domain controller 31.

[0057] In this embodiment, the left domain controller 32 cooperates with the right domain controller 31 to receive vehicle control information, and the circuits of various components in the vehicle control module 20 are simplified through the configuration of the left domain controller 32 and the right domain controller 31.

[0058] Alternatively, if Figure 1As shown, the feedback instructions generated by the driver detection system 30 include text reminder signals, distracted driving warning sound signals, camera obstruction or fault feedback signals, voice reminder signals, and volume adjustment signals. The motion instructions generated by the driver detection system 30 include negative ion opening request signals, air conditioning wind speed reduction request signals, window opening angle request signals, and air conditioning internal and external circulation mode switching request signals. The driver detection system 30 also includes a digital cockpit 33, which is connected to the driver monitoring camera 10. The digital cockpit 33 is used to receive and analyze the image information of the driver sent by the driver monitoring camera 10. The digital cockpit 33 is also connected to the left domain controller 32. The digital cockpit 33 is connected and receives the vehicle status information sent by the left domain controller 32. The digital cockpit 33 generates a feedback instruction according to the driver image information sent by the driver monitoring camera 10 and the negative ion opening status feedback signal, air conditioning wind speed feedback signal, air conditioning internal and external circulation mode switching feedback signal, steering wheel angle signal, actual gear position signal and vehicle speed signal sent by the left domain controller 32. The left domain controller 32 receives the feedback instruction and sends the feedback instruction to the right domain controller 31. The right domain controller 31 generates a window control signal and a wind speed adjustment signal according to the above signals. The right window controller 26 receives the window control signal, and the electric air outlet module 27 receives the wind speed adjustment signal.

[0059] Exemplarily, the driver detection system 30 further includes a digital cockpit 33, which is connected to the driver monitoring camera 10, and is used to receive and analyze the image information of the driver sent by the driver monitoring camera 10. The digital cockpit 33 is also connected to the left domain controller 32, and receives the negative ion opening state feedback signal, the air conditioning wind speed feedback signal, the air conditioning internal and external circulation mode switching feedback signal, the steering wheel angle signal, the actual gear position signal, and the vehicle speed signal sent by the left domain controller 32.

[0060] The digital cockpit 33 generates a text reminder signal, a distracted driving warning sound signal, a camera obstruction or fault feedback signal, a voice reminder signal, a volume adjustment signal, a negative ion turn-on request signal, an air conditioning wind speed reduction request signal, a window opening angle request signal, and an air conditioning internal and external circulation mode switching request signal based on the driver image information sent by the driver monitoring camera 10 and the negative ion turn-on status feedback signal, air conditioning wind speed feedback signal, air conditioning internal and external circulation mode switching feedback signal, steering wheel angle signal, actual gear position signal, and vehicle speed signal sent by the left domain controller 32.

[0061] The left domain controller 32 receives the negative ion turn-on request signal, the air conditioning wind speed reduction request signal, the window opening angle request signal, and the air conditioning internal and external circulation mode switching request signal, and sends the above signals to the right domain controller 31. The right domain controller 31 generates a window control signal and a wind speed adjustment signal according to the above signals. The right window controller 26 receives the window control signal, and the electric air outlet module 27 receives the wind speed adjustment signal.

[0062] Alternatively, if Figure 1 As shown, the driver interaction system 40 includes an instrument cluster 41, which is connected to the digital cockpit 33 and receives text reminder signals, distracted driving warning sound signals, and camera blocked or faulty feedback signals. The instrument cluster 41 provides text reminders based on the text reminder signals, distracted driving warning sound signals, and camera blocked or faulty feedback signals.

[0063] The audio power amplifier module 42 is connected to the digital cockpit 33 and receives a voice reminder signal and a volume adjustment signal. The audio power amplifier module 42 generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal.

[0064] The speaker 43 is connected to the audio power amplifier module 42 and receives the voice reminder instruction and the volume adjustment instruction. The speaker plays the voice reminder and adjusts the volume according to the voice reminder instruction and the volume adjustment instruction.

[0065] Exemplarily, the instrument cluster 41 is connected to the digital cockpit 33, and receives text reminder signals, distracted driving warning sound signals, and camera blocked or faulty feedback signals. The instrument cluster 41 gives text reminders based on the text reminder signals, distracted driving warning sound signals, and camera blocked or faulty feedback signals.

[0066] The audio power amplifier module 42 is connected to the digital cockpit 33 to receive the voice reminder signal and the volume adjustment signal. The audio power amplifier module 42 generates the voice reminder instruction and the volume adjustment instruction according to the voice reminder signal and the volume adjustment signal.

[0067] The speaker 43 is connected to the audio power amplifier module 42 to receive the voice reminder instruction and the volume adjustment instruction. The speaker 43 plays the voice reminder and adjusts the volume according to the voice reminder instruction and the volume adjustment instruction.

[0068] Based on the same inventive concept, this embodiment also provides a control method for an intelligent driver behavior monitoring and safety reminder system, including the following steps.

[0069] Step 1: Acquire vehicle status information through the vehicle control module 20 and acquire driver image information through the driver monitoring camera 10.

[0070] Step two, the driver detection system 30 receives the vehicle status information sent by the vehicle control module 20 and the driver image information obtained by the driver monitoring camera 10. The driver detection system 30 determines whether to perform driver behavior monitoring and safety reminders based on the vehicle status information. If driver behavior monitoring and safety reminders are performed, the driver detection system 30 determines whether abnormal driver behavior occurs based on the vehicle status information and the driver image information.

[0071] Step three: if an abnormal driver action occurs, the driver detection system 30 activates the intelligent care mode through the abnormal driver action, and generates different feedback instructions and motion instructions according to different intelligent care modes.

[0072] In step 4, the driver interaction system 40 provides voice reminders and graphic reminders according to the different feedback instructions obtained in step 3, and the vehicle control module 20 adjusts the vehicle state according to the different motion instructions obtained in step 3, and reminds the driver to return to normal driving behavior by adjusting the vehicle state.

[0073] In this embodiment, the driver's abnormal driving actions are obtained by real-time monitoring of the driver's behavior, and multi-level safety reminders are provided according to the driver's different abnormal driving actions, thereby effectively improving driving safety.

[0074] Alternatively, if Figure 2 As shown, the abnormal driver actions obtained in step 2 include fatigue driving behavior, distracted driving behavior and dangerous driving behavior. If the intelligent care for fatigue driving behavior is turned on, a voice reminder about fatigue driving is played through the speaker 43, a graphic reminder about fatigue driving is played through the combination instrument 41, the window is controlled to be lowered through the left window controller and the right window controller 26, and the air conditioner is controlled to be turned on through the electric air outlet module 27, so as to remind the driver to return to normal driving behavior.

[0075] For example, when the camera detects that the driver is fatigued, the system combines with the vehicle control module 20 to obtain the current driving time for judgment, and divides fatigue driving into two levels: severe and mild, with different levels of prompts. When mild fatigue driving behavior (yawning multiple times in a short period of time, closing eyes, etc.) is detected, a voice reminder "You are mildly fatigued" is given through the speaker 43, and a text prompt is displayed on the instrument cluster 41 for 10 seconds; if the driver continues the above fatigue driving behavior, the reminder will continue at intervals of 3 seconds until the action stops. If the action continues during this period, there will be no response.

[0076] When severe fatigue driving behavior is detected (closing eyes for more than 2 seconds), the speaker 43 reminds you that you are severely fatigued, and the text prompt of the instrument cluster 41 lasts for 10 seconds.

[0077] If the driver continues to drive while fatigued, the system will continue to remind the driver every 3 seconds until the action stops. If the driver continues to drive while fatigued, there will be no response.

[0078] When both mild fatigue driving behavior and severe fatigue driving behavior exist, the system sends a signal state of severe fatigue driving level value and executes the action of severe fatigue driving behavior.

[0079] The condition for not enabling the intelligent care function for fatigue driving behavior is that the vehicle power gear is switched to the off state.

[0080] The information obtained through the camera and the vehicle control module 20 is used to distinguish the degree of fatigue driving, and then the corresponding vehicle reminder action is executed according to the driver's fatigue level. In this way, multi-level safety reminders about fatigue driving are provided to further improve driving safety.

[0081] Alternatively, if Figure 2 As shown, if the intelligent care for distracted driving behavior is turned on, a voice reminder about distracted driving is played through the speaker 43, a graphic reminder about distracted driving is played through the instrument cluster 41, the window is controlled to be lowered through the left window controller and the right window controller 26, the air conditioner is controlled to be turned on through the electric air outlet module 27, and the volume of the voice reminder, the conspicuousness of the graphic reminder, and the size of the window opening are adjusted to remind the driver to return to normal driving behavior.

[0082] For example, during driving, any behavior that is not focused on driving is called distracted behavior (such as looking down to find something, looking around, etc.). If the system detects the above behavior for 3 seconds, it will give a voice reminder through the speaker 43: Please concentrate and drive carefully. At the same time, the text prompt and warning sound reminder (default) on the instrument cluster 41 will last for 10 seconds. The air conditioner is turned on through the electric air outlet module 27, and the window is lowered through the left window controller and the right window controller 26, so as to further remind the driver to return to normal driving behavior through the opening and closing of the air conditioner and the window.

[0083] If the driver continues to be distracted, the system will continue to remind the driver at intervals of 3 seconds until the behavior stops. If the driver continues to be distracted during this period, there will be no response.

[0084] The driver's actions are observed by the driver monitoring camera 10 to reduce false alarms. For example, observing the driver checking the exterior rearview mirrors or the blind spot behind the vehicle is not considered as distraction.

[0085] Because when attention and fatigue monitoring work together, when distraction and fatigue occur at the same time, the distraction alarm will be given priority.

[0086] The condition for not activating the distracted driving intelligent care function is that the vehicle power gear is switched to the off state.

[0087] Compared with fatigue driving, distracted driving is more likely to be dangerous. Therefore, adding safety reminders can further improve driving safety.

[0088] Alternatively, if Figure 2 As shown, if the intelligent care for dangerous driving behavior is turned on, a voice reminder about dangerous driving behavior is played through the speaker 43, a graphic reminder about dangerous driving behavior is played through the instrument cluster 41, the window is controlled to be lowered through the left window controller and the right window controller 26, the air conditioner is controlled to be turned on through the electric air outlet module 27, and the volume of the voice reminder, the conspicuousness of the graphic reminder, the size of the window opening, and the air inlet and outlet of the car air conditioner are adjusted to remind the driver to return to normal driving behavior.

[0089] Intelligent Care: When the camera detects dangerous driving behavior (smoking, drinking, making phone calls, etc.) for 3 seconds, a voice reminder will be given on the instrument cluster 41 and the speaker 43: Pay attention to driving safety. The text reminder on the instrument cluster 41 will last for 10 seconds. If the user continues the dangerous driving behavior, the reminder will continue at intervals of 3 seconds until the action stops. If the action continues during this period, there will be no response.

[0090] When the driver's smoking behavior is detected, no dangerous driving reminder is given, and intelligent care for dangerous driving behavior is activated according to the conditions, the electric air outlet module 27 is turned on, negative ion purification is turned on, internal and external circulation is switched, the left window controller 25 and the right window controller 26 are turned on, and the window is opened at a 30° angle;

[0091] When it detects that the driver is making a phone call, the system will not issue a dangerous driving reminder, but will actively lower the media playback volume and the air conditioning wind speed (by 10%). After the call, the media playback volume will be restored. When the mobile phone Bluetooth is connected to the car's large-screen Bluetooth, the incoming call will actively lower the volume and air conditioning wind speed and prioritize the Bluetooth strategy, and the driver monitoring camera will not perform repeated operations.

[0092] The condition for not enabling the intelligent care function for dangerous action behaviors is that the vehicle power gear is switched to the off state.

[0093] The information obtained through the camera and the vehicle control module 20 is used to distinguish dangerous actions, and then corresponding vehicle reminder actions are performed according to the driver's dangerous actions. In this way, multi-level safety reminders about fatigue driving are provided to further improve driving safety.

[0094] The above is an exemplary description of the present invention in combination with the accompanying drawings. It is obvious that the specific implementation of the present invention is not limited to the above-mentioned method. As long as such non-substantial improvements are made by adopting the method concept and technical solution of the present invention, or the concept and technical solution of the present invention are directly applied to other occasions without improvement, they are all within the protection scope of the present invention.

Claims

1. An intelligent driver behavior monitoring and safety reminder system, characterized in that: include: A driver monitoring camera, which is used to obtain image information of the driver in real time; A vehicle control module, which is used to obtain vehicle status information in real time and control the vehicle status; a driver detection system connected to the driver monitoring camera and the vehicle information detection module, wherein the driver detection system analyzes the driver image information acquired by the driver monitoring camera and the vehicle status information acquired by the vehicle information detection module to obtain the driver's abnormal action result, generates a feedback instruction and a motion instruction according to the driver's abnormal action result, and the vehicle control module adjusts the vehicle status according to the motion instruction; The driver interaction system is connected to the driver detection system, and the driver interaction system receives the feedback instruction and reminds the driver according to the feedback instruction.

2. The intelligent driver behavior monitoring and safety reminder system according to claim 1, characterized in that: The vehicle status information acquired by the vehicle control module includes wheel speed information, gear information, rear motor wheel speed, front motor wheel speed, left window information, right window information and air conditioning information. The vehicle control module includes: a brake-by-wire system that sends wheel speed information to the driver detection system; Combination switch module, used to send gear position information to the driver detection system; A rear motor control unit for sending rear motor wheel speed to a driver detection system; Front motor control unit, used to send the front motor wheel speed to the driver detection system; The left window air sensor is used to send the left window information to the driver detection system.

3. The intelligent driver behavior monitoring and safety reminder system according to claim 1 or 2, characterized in that: The vehicle control module comprises: A right window controller, used to send right window information to the driver detection system; Electric air outlet module, used to send air conditioning information to the driver detection system.

4. The intelligent driver behavior monitoring and safety reminder system according to claim 3, characterized in that: The abnormal driver behavior results obtained by the driver detection system include fatigue driving behavior, distracted driving behavior and dangerous driving behavior, and the driver detection system includes: A right domain controller is connected to the right window controller and the electric air outlet module, and is used to receive vehicle status information and simplify the electronic circuits of the right window controller and the electric air outlet module; the right domain controller analyzes the vehicle status information to obtain the right window lifting height and in-vehicle air conditioning information, and generates a negative ion opening state feedback signal, an air conditioning wind speed feedback signal, and an air conditioning internal and external circulation mode switching feedback signal according to the right window lifting height and in-vehicle air conditioning information; The left domain controller is connected with the wire control brake system, the combination switch module, the rear motor control unit, the front motor control unit and the left window controller. The left domain controller is used to receive vehicle status information and simplify the electronic circuits of the wire control brake system, the combination switch module, the rear motor control unit, the front motor control unit and the left window air conditioner; the left domain controller is connected with the right domain controller. The left domain controller is used to receive the negative ion opening status feedback signal, the air conditioning wind speed feedback signal, and the air conditioning internal and external circulation mode switching feedback signal sent by the right domain controller.

5. The intelligent driver behavior monitoring and safety reminder system according to claim 4, characterized in that: The feedback instructions generated by the driver detection system include text reminder signals, distracted driving warning sound signals, camera obstruction or fault feedback signals, voice reminder signals, and volume adjustment signals. The motion instructions generated by the driver detection system include negative ion opening request signals, air conditioning wind speed reduction request signals, window opening angle request signals, and air conditioning internal and external circulation mode switching request signals. The driver detection system also includes: A digital cockpit is connected to a driver monitoring camera. The digital cockpit is used to receive and analyze the image information of the driver sent by the driver monitoring camera. The digital cockpit is also connected to a left domain controller and receives the vehicle status information sent by the left domain controller. The digital cockpit generates a feedback instruction based on the driver image information sent by the driver monitoring camera and the negative ion opening status feedback signal, air conditioning wind speed feedback signal, air conditioning internal and external circulation mode switching feedback signal, steering wheel angle signal, actual gear position signal and vehicle speed signal sent by the left domain controller. The left domain controller receives the feedback instruction and sends the feedback instruction to the right domain controller. The right domain controller generates a window control signal and a wind speed adjustment signal based on the above signals. The right window controller receives the window control signal, and the electric air outlet module receives the wind speed adjustment signal.

6. The intelligent driver behavior monitoring and safety reminder system according to claim 5, characterized in that: The driver interaction system comprises: A combination instrument is connected to the digital cockpit, and receives a text reminder signal, a distracted driving warning sound signal, and a camera blocked or faulty feedback signal, and the combination instrument gives a text reminder according to the text reminder signal, the distracted driving warning sound signal, and the camera blocked or faulty feedback signal; An audio power amplifier module is connected to the digital cockpit and receives a voice reminder signal and a volume adjustment signal. The audio power amplifier module generates a voice reminder instruction and a volume adjustment instruction according to the voice reminder signal and the volume adjustment signal; The speaker is connected to the audio power amplifier module and receives the voice reminder instruction and the volume adjustment instruction. The speaker plays the voice reminder and adjusts the volume according to the voice reminder instruction and the volume adjustment instruction.

7. A control method for an intelligent driver behavior monitoring and safety reminder system, using the intelligent driver behavior monitoring and safety reminder system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step 1: obtaining vehicle status information through a vehicle control module and obtaining driver image information through a driver monitoring camera; Step 2: The driver detection system receives the vehicle status information sent by the vehicle control module and the driver image information obtained by the driver monitoring camera. The driver detection system determines whether to perform driver behavior monitoring and safety reminders based on the vehicle status information. If driver behavior monitoring and safety reminders are performed, the driver detection system determines whether abnormal driver behavior occurs based on the vehicle status information and the driver image information. Step 3: If an abnormal driver action occurs, the driver detection system activates the intelligent care mode through the abnormal driver action, and generates different feedback instructions and motion instructions according to different intelligent care modes; In step 4, the driver interaction system provides voice reminders and graphic reminders according to the different feedback instructions obtained in step 3. The vehicle control module adjusts the vehicle state according to the different motion instructions obtained in step 3, and reminds the driver to return to normal driving behavior by adjusting the vehicle state.

8. The intelligent driver behavior monitoring and safety reminder method according to claim 7, characterized in that: The abnormal driver actions obtained in the step 2 include fatigue driving behavior, distracted driving behavior and dangerous driving behavior. If the intelligent care for fatigue driving behavior is turned on, a voice reminder about fatigue driving is played through the speaker, a graphic reminder about fatigue driving is played through the instrument cluster, the window is controlled to be lowered through the left window controller and the right window controller, and the air conditioner is controlled to be turned on through the electric air outlet module, so as to remind the driver to return to normal driving behavior.

9. The intelligent driver behavior monitoring and safety reminder method according to claim 7, characterized in that: If intelligent care for distracted driving behavior is turned on, voice reminders about distracted driving will be played through the speaker, graphic reminders about distracted driving will be played through the instrument cluster, the windows will be lowered by the left and right window controllers, the air conditioner will be turned on by the electric air outlet module, and the volume of the voice reminder, the conspicuousness of the graphic reminder, and the size of the window opening will be adjusted to remind the driver to return to normal driving behavior.

10. The intelligent driver behavior monitoring and safety reminder method according to claim 7, characterized in that: If the intelligent care for dangerous driving behaviors is turned on, voice reminders about dangerous driving behaviors will be played through the speaker, graphic reminders about dangerous driving behaviors will be played through the instrument cluster, the windows will be lowered by the left and right window controllers, the air conditioner will be turned on by the electric air outlet module, and the volume of the voice reminders, the conspicuousness of the graphic reminders, the size of the window opening, and the air inlet and outlet of the car air conditioner will be adjusted to remind the driver to return to normal driving behaviors.

Images