Driver fatigue early warning system of new energy electric vehicle

Abstract

The invention discloses a driver fatigue early warning system of a new energy electric vehicle, and belongs to the technical field of vehicle monitoring management. The trolley comprises a trolley body, a driver seat is arranged on the front side of the vehicle body; a fatigue camera is arranged on the vehicle body opposite to the driver's seat; the fatigue camera is connected with the host through a wire. A wireless communication module and a storage module are integrated in the host; the host is placed in the vehicle body and is connected with the alarm through a wire; according to the invention, the problems of insufficient detection precision, single function and response delay of the current vehicle driving state monitoring system are effectively solved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle monitoring and management, and particularly relates to a driver fatigue warning system for new energy electric vehicles. Background Art

[0002] With the popularization of new energy electric vehicles, the degree of vehicle intelligence has been continuously improved, and driving safety has become the focus of the industry. Fatigue driving or distracted driving caused by fatigue of drivers is an important cause of traffic accidents; at present, some vehicles on the market are equipped with assisted driving systems, but these systems usually have the following problems: 1. Insufficient detection accuracy: Traditional fatigue detection systems mainly rely on indirect indicators such as steering wheel operation and lane departure, and it is difficult to accurately identify the true fatigue state of drivers (such as closing eyes, yawning, etc.); 2. Single function: It can only detect the fatigue state and cannot cover distracted driving; 3. Response delay: After detecting abnormal behaviors, only simple alarm prompts are provided, which is difficult to meet the needs of fleet management or accident tracing; Therefore, there is an urgent need for an intelligent and multifunctional driver fatigue warning system for new energy electric vehicles, which can real-time monitor the physiological state and driving behavior of drivers and improve driving safety. Summary of the Invention

[0003] The technical problem to be solved by the present invention is: to provide a driver fatigue warning system for new energy electric vehicles to solve the problems of insufficient detection accuracy, single function and response delay existing in the current vehicle driving state monitoring system.

[0004] To solve the above problems, the present invention provides the following technical solutions: A driver fatigue warning system for new energy electric vehicles; it includes a vehicle body; a driver's seat is arranged on the front side of the vehicle body; a fatigue camera is arranged on the vehicle body directly opposite the driver's seat; the fatigue camera is connected to the host through a wire; a wireless communication module and a storage module are integrally arranged in the host; the host is placed in the vehicle body and is connected to an alarm through a wire.

[0005] Preferably, a forward camera is further arranged in the middle of the front windshield of the vehicle body; the forward camera is connected to the host through a wire; the fatigue camera is rotatably arranged at the A-pillar position in front of the driver's seat, and there is no obstruction between the fatigue camera and the driver's head.

[0006] Preferably, both the fatigue camera and the forward camera are communicatively connected to the host in the way of serial port RS232; and the transmission rule uses the byte order of the little-endian mode to transfer words and double words; the message structure sent is a 4-byte structure including a frame header, a fatigue alarm state, an ADAS alarm state and a frame tail arranged in sequence.

[0007] Preferably, the alarm includes a sound alarm and a light alarm.

[0008] The present invention also discloses a working method of a driver fatigue warning system for a new energy electric vehicle; it includes the following steps: S1. After the driver starts the vehicle, the on-vehicle power supply supplies power to the host. S2. The host controls the front camera to turn on and continuously detects the current driving state of the vehicle and the environmental conditions around the vehicle. S3. During the process of the driver driving the vehicle, when the front camera detects that the vehicle speed is greater than the set value, it is determined that the vehicle has entered a continuous driving state since the current start. At this time, the host controls the fatigue camera to turn on, and the fatigue camera continuously detects the driving state of the driver. S4. When the fatigue camera detects that the driver has any abnormal driving behaviors such as closing eyes, yawning, smoking, using a mobile phone, being distracted, or blocking the camera, and the duration of the behavior exceeds the corresponding set time, the host will issue an alarm to the driver through the alarm; when issuing the alarm, the host can take warning evidence of the corresponding abnormal driving behavior of the driver through the fatigue camera, store the warning evidence, and upload it to the cloud server at the same time.

[0009] In step S4, when it is detected that the driver closes eyes and the duration of this action reaches more than 1.5S to trigger a warning, the host controls the alarm to issue a voice broadcast of "Please pay attention ahead". When it is detected that the driver yawns and the duration of this action reaches more than 2S to trigger a warning, the host controls the alarm to issue a voice broadcast of "Do not drive fatigued". When it is detected that the driver smokes and the duration of this action reaches 2S to trigger a warning, the host controls the alarm to issue a voice broadcast of "Do not smoke". When it is detected that the driver uses a mobile phone and the duration of this action reaches 4S to trigger a warning, the host controls the alarm to issue a voice broadcast of "Do not use mobile phone". When it is detected that the driver's head turns left or right by more than 45°, and the duration of this action reaches 3S to trigger a warning, the host controls the alarm to issue a voice broadcast of "beep". When it is detected that the driver's face is not in the camera area or the camera is blocked, and the duration of this action reaches 60s to trigger a warning, the host controls the alarm to issue a voice broadcast of "Please align with the face".

[0010] The warning evidence taken by the host through the fatigue camera for the corresponding abnormal driving behavior of the driver in step S4 is a video with a duration exceeding 10S.

[0011] During the process of a driver driving a vehicle, when the front camera detects any abnormal driving state such as sudden acceleration, sudden deceleration, sharp turn, overtime driving or speeding in real time, the host will issue an alarm through the alarm, and at the same time, take warning evidence of the abnormal driving state and photos of the driver through the front camera and the fatigue camera respectively, and store and upload these photos.

[0012] When it is detected that the vehicle is in a state where the acceleration is greater than 1.67 m / s² for a duration greater than 2 seconds, an alarm is triggered, and the host controls the alarm to issue a voice broadcast of "Be careful of sudden acceleration"; When it is detected that the vehicle is in a state where the acceleration is greater than -1.67 m / s² for a duration greater than 2 seconds, an alarm is triggered, and the host controls the alarm to issue a voice broadcast of "Be careful of sudden deceleration"; When it is detected that the steering angle of the vehicle turns more than 15 degrees within 1 second, an alarm is triggered, and the host controls the alarm to issue a voice broadcast of "Be careful of sharp turn"; When it is detected that the vehicle runs continuously for more than 4 hours, an alarm is triggered, and the host controls the alarm to issue a voice broadcast of "Do not drive overtime"; When it is detected that the vehicle speed exceeds 100 km / h during driving, an alarm is triggered, and the host controls the alarm to issue a voice broadcast of "Do not speed".

[0013] The beneficial effects of the present invention are mainly reflected in the following aspects: 1. Multi-dimensional monitoring system: Through the combination of the fatigue camera and the front camera, a three-in-one monitoring system for driver status, vehicle behavior and environmental perception is constructed. It can not only capture physiological characteristics such as closing eyes and yawning in real time, but also synchronously monitor behavioral characteristics such as mobile phone use and head deflection. At the same time, combined with vehicle dynamic data such as sudden acceleration and speeding, it realizes all-round three-dimensional monitoring of driving safety; 2. Innovation of intelligent hardware architecture: Adopt a fatigue camera that can rotate on the A-pillar, combined with the best viewing distance design of 0.6 - 1.2 m, to avoid blind spots in capturing facial features at the driver's seat position; Through the modular interface design of the host with multi-protocol support such as 4G dual-band, GPS, and WIFI, the plug-and-play function of the vehicle networking function is realized; 3. Hierarchical early warning mechanism: Establish a three-level response model of behavioral characteristics, time threshold, and voice feedback, and set different trigger durations (1.5 s - 60 s) and corresponding voice prompts for 6 types of driver abnormal behaviors; It can accurately prompt the driver's abnormal behaviors; 4. Closed-loop management of evidence chain: Combine video and photo evidence collection with local storage and cloud synchronization. When dealing with abnormal driving states of the vehicle, dual cameras are also used to cooperate in evidence collection to form a complete electronic evidence chain, which is convenient for tracing and verifying abnormal data; 5. Improvement of management efficiency: The cloud data docking function enables the fleet management platform to obtain the driver behavior profile in real time. Combined with modules such as overtime driving reminder, it improves the safety management efficiency of transportation enterprises and thus reduces the accident rate. Description of the Drawings

[0014] Figure 1 is a schematic diagram when the fatigue camera is installed on the vehicle body in this embodiment; Figure 2 is a schematic diagram of the connection of electrical components in this embodiment; Figure 3 is a schematic diagram of the interface side of the host in this embodiment; Description of the reference numerals: 1. Vehicle body, 2. Driver's seat, 3. Fatigue camera, 4. Host, 5. Wireless communication module, 6. Storage module, 7. Alarm, 8. Forward camera, 71. Sound alarm, 72. Light alarm. Detailed Embodiment

[0015] The present invention will be further introduced below in conjunction with the drawings and specific embodiments: Embodiment: Referring to Figure 1 , this embodiment provides a driver fatigue warning system for a new energy electric vehicle; it includes a vehicle body 1; a driver's seat 2 is provided on the front side of the vehicle body 1; a fatigue camera 3 is provided on the vehicle body 1 directly opposite the driver's seat 2; the fatigue camera 3 is connected to the host 4 through a wire; a wireless communication module 5 and a storage module 6 are integrally provided in the host 4; the host 4 is placed in the vehicle body 1 and is connected to the alarm 7 through a wire. The storage module 6 in this embodiment is a TF card; the wireless communication module 5 is a cellular communication module, which can cooperate with the SIM card for remote communication.

[0016] The layout of each interface on the host in this embodiment is as Figure 3 shown. The interfaces on the host in the legend are, in order from left to right: 1. Power supply interface, as the power supply interface for the host (needs to be connected to constant power, ACC, GND); 2. Network interface, as the network communication interface; 3. Main harness interface, this interface includes image / signal input, audio output and 485 / 232 communication functions; 4, 4G - secondary interface, this interface is used to connect the 4G secondary antenna, mainly supporting Telecom 2G / 3G; 5. 4G - main interface, this interface is used to connect the 4G main antenna, supporting Mobile 2G / 3G / 4G, Unicom 2G / 3G / 4G and Telecom 4G; 6. WIFI interface, used to connect the WIFI / BT antenna; 7. GPS interface, used to connect the GPS antenna; 8. TF interface, for installing the TF card; 9. SIM interface, this interface is used to install the SIM card.

[0017] The host needs to be installed at a suitable position according to different vehicle models and fixed firmly. The principles to be followed are: keeping away from humid environments; having good ventilation; being effectively fixed; preventing unauthorized personnel from touching randomly; the length of the equipped extension cable meeting the requirements. In this embodiment, the installation position of the host is selected behind the driver's seat and placed in an iron box with certain protective performance.

[0018] A forward camera 8 is also provided in the middle of the front windshield of the vehicle body 1; the forward camera 8 is connected to the host 4 through a wire; the fatigue camera 3 is rotatably arranged at the position of the A-pillar on the front side of the driver's seat 2, and there is no obstruction between the fatigue camera 3 and the driver's head. In this embodiment, the straight-line distance between the driver's eyes and the center point of the camera mirror surface is designed to be between 0.6 m and 1.2 m, and there are no obstructions such as the steering wheel and the center console between the two. The forward camera in this embodiment is an ADAS camera.

[0019] Both the fatigue camera 3 and the forward camera 8 are communicatively connected to the host in the way of serial port RS232, with a baud rate of 115200 and an 8-N-1 format; the transmission rule uses the byte order of the little-endian mode to transfer words and double words; the agreement is as follows: Transmission agreement for byte (BYTE): Transmitted in the way of byte stream; Transmission agreement for word (WORD): First transmit the lower 8 bits, and then transmit the higher 8 bits; Transmission agreement for double word (DWORD): First transmit the lower 8 bits, then transmit the lower 16 bits, then transmit the lower 24 bits, and finally transmit the higher 8 bits; The structure of the sent message is a 4-byte structure including a frame header, a fatigue alarm status, an ADAS alarm status, and a frame tail set in sequence.

[0020] The alarm 7 includes a sound alarm 71 and a light alarm 72.

[0021] The present invention also discloses a working method of a driver fatigue warning system for a new energy electric vehicle; it includes the following steps: S1. After the driver starts the vehicle, the on-vehicle power supply supplies power to the host 4; S2. The host 4 controls the front camera 8 to turn on and continuously detects the current driving state of the vehicle and the environmental conditions around the vehicle; S3. During the process of the driver driving the vehicle, when the front camera 8 detects that the vehicle speed is greater than the set value, it is determined that the vehicle has entered a continuous driving state since the current start. At this time, the host 2 controls the fatigue camera 3 to turn on, and the fatigue camera 3 continuously detects the driving state of the driver; S4. When the fatigue camera 3 detects any abnormal driving behavior of the driver, such as closing eyes, yawning, smoking, using a mobile phone, being distracted, or blocking the camera, and the duration exceeds the corresponding set time, the host will issue an alarm to the driver through the alarm 7; when issuing the alarm, the host 4 can take warning evidence of the corresponding abnormal driving behavior of the driver through the fatigue camera 3, store the warning evidence, and upload it to the cloud server at the same time.

[0022] In step S4, when it is detected that the driver closes eyes and the duration of this action reaches more than 1.5 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Please pay attention ahead"; When it is detected that the driver yawns and the duration of this action reaches more than 2 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Do not drive fatigued"; When it is detected that the driver smokes and the duration of this action reaches 2 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Do not smoke"; When it is detected that the driver uses a mobile phone and the duration of this action reaches 4 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Do not use mobile phone"; When it is detected that the driver's head turns left or right by more than 45° and the duration of this action reaches 3 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Beep"; When it is detected that the driver's face is not in the camera area or the camera is blocked and the duration of this action reaches 60 s to trigger a warning, the host 4 controls the alarm 7 to issue a voice broadcast of "Please align with the face".

[0023] In step S4, the warning evidence taken by the host 3 through the fatigue camera 3 of the corresponding abnormal driving behavior of the driver is a video with a duration exceeding 10 s.

[0024] During the process of the driver driving the vehicle, when the front camera 8 detects any abnormal driving state of the vehicle, such as rapid acceleration, rapid deceleration, sharp turn, overtime driving, or speeding, the host 3 will issue an alarm through the alarm, and at the same time, take warning evidence of the abnormal driving state and a photo of the driver through the front camera 8 and the fatigue camera 3 respectively, and store and upload these photos.

[0025] When it is detected that the vehicle is in a state with an acceleration greater than 1.67 m / s² for a duration greater than 2 seconds to trigger an alarm, the host 4 controls the alarm 7 to issue a voice broadcast of "Be careful of rapid acceleration"; When it is detected that the vehicle is in a state where the acceleration is greater than -1.67 m / s² for a duration greater than 2 seconds, an alarm is triggered, and the host 4 controls the alarm 7 to issue a voice broadcast of "Be careful of sudden deceleration"; When it is detected that the steering angle of the vehicle turns more than 15 degrees within 1 second, an alarm is triggered, and the host 4 controls the alarm 7 to issue a voice broadcast of "Be careful of sharp turns"; When it is detected that the vehicle has been running continuously for more than 4 hours, an alarm is triggered, and the host 4 controls the alarm 7 to issue a voice broadcast of "Do not drive overtime"; When it is detected that the vehicle is traveling at a speed exceeding 100 km / h, an alarm is triggered, and the host 4 controls the alarm 7 to issue a voice broadcast of "Do not speed";

[0026] In this embodiment, when the driver exhibits abnormal driving behavior, the light alarm will flash at a low frequency of once per second; when an abnormal driving state occurs, the light alarm will flash at a high frequency of once every 0.2 seconds for warning.

[0027] The performance parameters of the host in this embodiment are as follows: Main processor: High-performance processor; Operating system: Android operating system; Video input: 1 analog signal input, 1 high-definition digital signal input; I / O: 4 * GPIO signal inputs, supporting high-level signal inputs of 9 - 36V; 2 * GPIO signal outputs, outputting 5V high level Device memory: 16GB, 1 * expandable TF card storage, maximum support of 32GB Function interface: 1 * RS232 external interface, supporting external 232 communication devices; 1 * RS485 external interface, supporting external 485 communication devices; 1 * ACC signal input interface, vehicle ignition signal; Positioning parameters: Support gyroscope and GPS positioning; Network parameters: Wired network, RJ45, built-in standard TCP / IP protocol stack; Wireless network, built-in 4G module, WIFI / BT module; Operating voltage: Normal operating voltage range: 10 - 32V Device power consumption: <= 12W.

[0028] In this embodiment, the fatigue detection camera is a DSM camera, and its performance parameters are as follows: Sensor: Automotive-grade CMOS chip; Resolution: 300,000 pixels; Operating & storage temperature: -40°C to +85°C; Power supply voltage: DC5 - 12V; Output video format: NTSC; Frame rate: 25 frames per second; HFOV: 34.6°; VFOV: 26.1°.

Claims

1. A driver fatigue warning system for a new energy electric vehicle, comprising a vehicle body (1); a driver's seat (2) is arranged on the front side of the vehicle body (1); and the system is characterized in that: A fatigue camera (3) is arranged on the vehicle body (1) facing the driver's seat (2); the fatigue camera (3) is connected to a host (4) via a wire; a wireless communication module (5) and a storage module (6) are integrated in the host (4); the host (4) is placed in the vehicle body (1) and is connected to an alarm (7) via a wire.

2. A driver fatigue warning system for a new energy electric vehicle according to claim 1, characterized in that: A forward camera (8) is also arranged in the middle of the front windshield of the vehicle body (1); the forward camera (8) is connected to the host (4) via a wire; the fatigue camera (3) is rotatably arranged at the A-pillar position in front of the driver's seat (2), and there is no obstruction between the fatigue camera (3) and the driver's head.

3. The driver fatigue warning system for a new energy electric vehicle according to claim 1 is characterized in that: The fatigue camera (3) and the forward camera (8) are both connected to the host by serial port RS232; and the transmission rule adopts the byte order of the little end mode to transfer words and double words; the message structure sent is a 4-byte structure including a frame header, fatigue alarm status, ADAS alarm status and frame tail, which are arranged in sequence.

4. The driver fatigue warning system for a new energy electric vehicle according to claim 1 is characterized in that: The alarm (7) comprises a sound alarm (71) and a light alarm (72).

5. A working method of a driver fatigue warning system for a new energy electric vehicle according to any one of claims 1 to 4; characterized in that: The following steps are involved: S1, after the driver starts the vehicle, the vehicle power supply supplies power to the host (4); S2, the host (4) controls the front camera (8) to turn on, and detects the current driving state of the vehicle and the environment around the vehicle in real time; S3, when the driver is driving the vehicle, if the front camera (8) detects that the vehicle speed is greater than a set value, it is determined that the vehicle has entered a continuous driving state from the current start, and the host (2) controls the fatigue camera (3) to turn on, and the fatigue camera (3) detects the driver's driving state in real time; S4. When the fatigue camera (3) detects that the driver has any abnormal driving behavior such as closing eyes, yawning, smoking, using mobile phone, distracted or blocking the camera and the time exceeds the corresponding set time, the host will issue an alarm to the driver through the alarm (7); when the alarm is issued, the host (4) can take a warning evidence of the corresponding abnormal driving behavior of the driver through the fatigue camera (3), store the warning evidence, and upload it to the cloud server.

6. The working method of the driver fatigue warning system of a new energy electric vehicle according to claim 5 is characterized by: In step S4, when it is detected that the driver closes his eyes and the action lasts for more than 1.5 seconds to trigger a warning, the host (4) controls the alarm (7) to issue a voice announcement of "Pay attention to the front"; When the driver is detected to be yawning and the yawning lasts for more than 2 seconds, triggering an early warning, the host (4) controls the alarm (7) to issue a voice announcement "Do not drive while tired"; When the driver is detected to be smoking, and the action lasts for 2 seconds, triggering an early warning, the host (4) controls the alarm (7) to issue a voice announcement of "Do not smoke"; When the driver is detected to be using a mobile phone, and the action lasts for 4 seconds, a warning is triggered, and the host (4) controls the alarm (7) to issue a voice announcement "Do not use mobile phone"; When it is detected that the driver's head turns left or right more than 45 degrees, and the action lasts for 3 seconds, a warning is triggered, and the host (4) controls the alarm (7) to emit a "beep" voice broadcast; When it is detected that the driver's face is not in the camera area or the camera is blocked, and this action lasts for 60 seconds, a warning is triggered, and the host (4) controls the alarm (7) to issue a voice broadcast of "Please aim at the face".

7. The working method of the driver fatigue warning system of a new energy electric vehicle according to claim 5 is characterized by: In step S4, the host (3) uses the fatigue camera (3) to take a video of the driver's abnormal driving behavior, which often lasts for more than 10 seconds.

8. The working method of the driver fatigue warning system of a new energy electric vehicle according to claim 5 is characterized by: When the driver is driving the vehicle, if the front camera (8) detects in real time that the vehicle is in any abnormal driving state of sudden acceleration, sudden deceleration, sharp turn, overtime driving or speeding, the host (3) will sound an alarm through the alarm, and at the same time, the front camera (8) and the fatigue camera (3) will respectively take pictures of the warning evidence of the abnormal driving state and the driver's photo, and store and upload these photos.

9. The working method of the driver fatigue warning system of a new energy electric vehicle according to claim 8 is characterized by: When it is detected that the vehicle is in a state of acceleration greater than 1.67 M / s^2 for a period of more than 2 seconds, an alarm is triggered, and the host (4) controls the alarm (7) to issue a voice broadcast of "Caution, Accelerate Rapidly"; When it is detected that the vehicle is in a state of acceleration greater than -1.67M / s^2 for more than 2 seconds, an alarm is triggered, and the host (4) controls the alarm (7) to issue a voice broadcast of "Caution, slow down urgently"; When it is detected that the vehicle's driving angle turns more than 15 degrees within 1 second, an alarm is triggered, and the host (4) controls the alarm (7) to issue a voice announcement of "Beware of sharp turns"; When the alarm is triggered by detecting that the vehicle has been running continuously for more than 4 hours, the host (4) controls the alarm (7) to issue a voice announcement "Do not drive beyond the time limit"; When it is detected that the vehicle is traveling at a speed exceeding 100 km / h, an alarm is triggered, and the host (4) controls the alarm (7) to issue a voice announcement of "Do not exceed the speed limit".

10. The working method of the driver fatigue warning system of a new energy electric vehicle according to claim 8 is characterized by: The warning evidence taken by the host (3) through the front camera (8) is at least three photos, and the photo of the driver taken by the fatigue camera (3) is at least one photo.

Images