Vehicle fatigue driving early warning system based on facial features

Abstract

A vehicle fatigue driving early warning system based on facial features comprises an image acquisition unit, an image processing and control unit, a video display unit, a voice alarm unit, a storage unit, a microcontroller unit, a CAN transceiver and a system power supply unit, the face of a driver is acquired in real time through a vehicle-mounted camera, and the features of the whole face are extracted and analyzed; the driving state of a driver can be judged, various requirements such as fatigue monitoring, data communication, data caching, detection result display, fatigue driving early warning and system quick starting can be met at the same time, the system has the advantages of being high in real-time performance and accuracy, easy to popularize and suitable for various driving scenes such as buses, private cars and trucks, and the driving safety is effectively improved.

Description

Technical Field

[0001] The utility model relates to the field of vehicle fatigue driving safety systems, in particular to a vehicle fatigue driving warning system based on facial features. Background Art

[0002] With the rapid development of my country's economy, cars have become the most commonly used means of transportation for Chinese citizens. While cars provide convenience to our lives, they also bring a series of problems, such as the frequent occurrence of traffic accidents, which cause huge losses to people's lives and property. According to incomplete statistics, among the many causes of traffic accidents, fatigue driving is one of the main reasons behind road traffic accidents, and about 20%-25% of accidents are related to fatigue driving. Therefore, realizing fatigue driving warning is of great practical significance for reducing the occurrence of traffic accidents and improving traffic safety.

[0003] Existing fatigue driving warning methods mainly include detection methods based on driver physiological characteristics and detection methods based on motor vehicle parameters. The detection method based on driver physiological characteristics determines the driver's fatigue state by real-time monitoring of changes in various physiological signals of the driver. Although it has high accuracy, it requires wearing detection equipment, which will hinder the driver's operation to a certain extent and reduce driving safety. In addition, the equipment required for detection is relatively expensive and has a low cost-effectiveness. The detection method based on motor vehicle parameters will be affected by various factors such as the driver's driving habits, road conditions, and environment, which will affect the accuracy of the experiment. It is usually only used as an auxiliary tool for other detection methods and it is difficult to meet the detection and warning needs of vehicle fatigue driving alone. Utility Model Content

[0004] The purpose of the utility model is to provide a vehicle fatigue driving warning system based on facial features, which has the characteristics of real-time and high accuracy, is easy to popularize, and is suitable for various driving scenarios, such as buses, private cars, trucks, etc., effectively improving driving safety.

[0005] The technical solution adopted by the utility model to solve the above technical problems is: a vehicle fatigue driving warning system based on facial features, including an image acquisition unit, an image processing and control unit, a video display unit, a voice alarm unit, a storage unit, a microcontroller unit, a CAN transceiver and a system power supply unit;

[0006] The image acquisition unit includes a face camera and a cab camera. The face camera is installed on the inner side of the A-pillar on the left side of the cab to collect the driver's facial feature information. The cab camera is installed in the upper left corner of the cab to collect the cab environment information.

[0007] The image processing and control unit includes a main control chip, a video decoding chip, a video conversion chip and two video encoding chips. The face camera and the cab camera are electrically connected to the video decoding chip respectively, and the video decoding chip is also electrically connected to the main control chip. The video decoding chip can convert the analog signals of the face camera and the cab camera into digital signals and then transmit them to the main control chip;

[0008] The main control chip is electrically connected to a video conversion chip and a video encoding chip respectively, the video conversion chip is electrically connected to another video encoding chip, the video conversion chip can convert the output signal of the main control chip, and the two video encoding chips can convert the output signal of the video conversion chip and the output signal of the main control chip into video output signals respectively; the video display unit includes a central control display screen of the car, the central control display screen of the car is electrically connected to a video encoding chip, and is used to display the cab situation, the driver's status and monitoring information; the storage unit includes a driving recorder, and the driving recorder is electrically connected to another video encoding chip;

[0009] The main control chip is also electrically connected to the voice alarm unit and the microcontroller unit respectively. The voice alarm unit is used to send an alarm sound to the cab. The microcontroller unit is electrically connected to the CAN transceiver through the CAN bus. The CAN transceiver is electrically connected to the vehicle system and is used to send system data to the vehicle system and receive real-time information of the vehicle.

[0010] The system power supply unit includes a power management chip and a buck-voltage regulator chip. The car battery is connected to the buck-voltage regulator chip, the face camera and the cab camera for power supply. The buck-voltage regulator chip is used to power the power management chip. The power management chip is used to power the main control chip, video decoding chip, video conversion chip, two video encoding chips, microcontroller unit, CAN transceiver and system peripheral interface.

[0011] Preferably, the face camera and the cab camera are both infrared AHD cameras.

[0012] Preferably, the main control chip is an RV1126 processor.

[0013] Preferably, the video decoding chip is a XS9922B decoding chip.

[0014] Preferably, the video conversion chip is an LT9211 conversion chip, and the two video encoding chips are both XS5013 encoding chips.

[0015] Preferably, the microcontroller unit is a N32G435CBL7 microcontroller, and the CAN transceiver is a SN65HVD256DR transceiver.

[0016] Preferably, the power management chip is an RK809-2 chip, and the step-down and voltage stabilization chip is an RT2808AGSP chip.

[0017] According to the above technical solution, the beneficial effects of the utility model are:

[0018] The utility model collects the driver's face in real time through the on-board camera, extracts and analyzes the features of the entire face, and completes the judgment of the driver's driving status. It can simultaneously realize fatigue monitoring, data communication, data caching, detection result display, fatigue driving warning and system rapid startup and other requirements. It has the characteristics of real-time and high accuracy, and is easy to popularize. It is suitable for various driving scenarios, buses, private cars, trucks, etc., and effectively improves driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is the system functional architecture block diagram;

[0020] Figure 2 This is a block diagram of the data input architecture of the main control chip;

[0021] Figure 3 This is a block diagram of the data output architecture of the main control chip;

[0022] Figure 4 Block diagram of the power supply architecture for the system. DETAILED DESCRIPTION

[0023] With reference to the accompanying drawings, the specific implementation is as follows:

[0024] like Figure 1 As shown, a vehicle fatigue driving warning system based on facial features includes an image acquisition unit, an image processing and control unit, a video display unit, a voice alarm unit, a storage unit, a microcontroller unit, a CAN transceiver and a system power supply unit.

[0025] The image acquisition unit collects the driver's facial features and cab environment information through the camera installed in the car, and then sends the image data to the image processing control unit for analysis and processing.

[0026] The image processing control unit is responsible for processing the collected facial signals of the driver, judging the driver's status based on the driver's facial features, and performing resource scheduling and logic control within the system.

[0027] The video display unit is used to display the cab situation, the driver's status and monitoring information.

[0028] Voice alarm unit: When the system determines that the driver is driving fatigued based on his facial features, the voice alarm unit will immediately issue a warning to remind the driver to pay attention to fatigue driving and suggest measures to be taken.

[0029] The storage unit is used to store the driver's image and vehicle information, such as fatigue status image, vehicle speed and driving path, etc.

[0030] Microcontroller Unit (MCU), used to enable the system to start quickly, is connected to the CAN transceiver and sends communication information to the car through the CAN transceiver.

[0031] CAN transceiver realizes data exchange and control between vehicle and system.

[0032] The system power supply unit is used to supply power to each module of the system.

[0033] like Figure 2 , 4 As shown, the image acquisition unit includes a face camera and a cab camera. Both cameras are infrared AHD cameras. The face camera is installed on the inner side of the A-pillar on the left side of the cab to collect the driver's facial feature information. The cab camera is installed in the upper left corner of the cab to collect the cab environment information.

[0034] The image processing and control unit includes a main control chip, a video decoding chip, a video conversion chip and two video encoding chips. The main control chip is an RV1126 processor, the video decoding chip is an XS9922B decoding chip, the video conversion chip is an LT9211 conversion chip, and the two video encoding chips are both XS5013 encoding chips.

[0035] like Figure 2 As shown, the face camera and the cab camera are electrically connected to the video decoding chip XS9922B respectively, and the video decoding chip XS9922B is also electrically connected to the main control chip RV1126. The video decoding chip XS9922B can convert the AHD analog signals of the face camera and the cab camera into MIPI-CSI digital signals, and then transmit them to the main control chip RV1126.

[0036] like Figure 3 As shown, the main control chip RV1126 is electrically connected to the video conversion chip LT9211 and a video encoding chip XS5013 respectively, the video conversion chip LT9211 is electrically connected to another video encoding chip XS5013, the video conversion chip LT9211 can convert the output signal of the main control chip RV1126 into a BT1120 digital signal, and the two video encoding chips XS5013 can respectively convert the BT1120 digital signal of the video conversion chip and the BT1120 digital signal directly output by the main control chip into an AHD video output signal.

[0037] like Figure 1 , 3As shown, the video display unit includes a central control display screen of the car, which is electrically connected to a video encoding chip XS5013 and is used to display the cab situation, the driver's status and monitoring information; the storage unit includes a driving recorder, which is electrically connected to another video encoding chip XS5013.

[0038] The main control chip is also electrically connected to the voice alarm unit and the microcontroller unit respectively. The voice alarm unit is used to send an alarm sound to the cab. The microcontroller unit is an N32G435CBL7 microcontroller. The microcontroller unit is electrically connected to the CAN transceiver through the CAN bus. The CAN transceiver is a SN65HVD256DR transceiver. The CAN transceiver is electrically connected to the vehicle system for sending system data to the vehicle system and receiving real-time information of the vehicle.

[0039] like Figure 4 As shown, the system power supply unit includes a power management chip and a buck-stabilizing chip. The power management chip is the RK809-2 chip, and the buck-stabilizing chip is the RT2808AGSP chip. The car battery is connected to the buck-stabilizing chip, the face camera and the cab camera for power supply at the same time. The buck-stabilizing chip can step down the 24V voltage of the car battery to 5V, and then power the power management chip. The power management chip is used to power the main control chip, the video decoding chip, the video conversion chip, the two video encoding chips, the microcontroller unit, the CAN transceiver and the system peripheral interface.

[0040] Among the system peripheral interfaces, the system's programming and debugging interface is used for firmware programming, software debugging, parameter configuration and fault diagnosis; the TF card interface is connected to the SDMMC controller of the main control chip RV1126, and the memory card can be plugged in and out to store image information and vehicle information; in order to simplify the system peripheral interface design, 1318745-2 is selected as the system's main connector. The system's power input interface, two-way AHD infrared camera power and video input interface, two-way AHD video output interface, audio input and output interface and CAN bus interface are uniformly connected to the main connector 1318745-2 to improve system reliability.

[0041] The system includes three key steps when working: face detection, facial key point detection and fatigue judgment. First, the system uses the face detection algorithm to locate the driver's face; then, the facial key point detection algorithm is used to extract the key point features of the eyes, mouth and head; finally, the fatigue driving detection-related algorithm is selected to determine the driver's fatigue state, thereby realizing the system's fatigue driving detection function.

[0042] During the actual use of the system, the driver's facial features and cab condition information are converted into digital video signals by the image acquisition unit through the video decoding chip XS9922B and transmitted to the image processing control unit RV1126 for image processing, and the driver's facial features are extracted. The driver's fatigue state is determined based on the driver's eye blinking frequency and closure time, mouth opening size and head nodding amplitude. When the driver is judged to be in fatigue driving, a signal is sent to the voice alarm unit, and the voice alarm system issues a voice alarm; if it is judged not to be fatigue driving, the image video acquisition unit repeats the video acquisition work in a cycle.

Claims

1. A vehicle fatigue driving warning system based on facial features, characterized by: It includes an image acquisition unit, an image processing and control unit, a video display unit, a voice alarm unit, a storage unit, a microcontroller unit, a CAN transceiver and a system power supply unit; The image acquisition unit includes a face camera and a cab camera. The face camera is installed on the inner side of the A-pillar on the left side of the cab to collect the driver's facial feature information. The cab camera is installed in the upper left corner of the cab to collect the cab environment information. The image processing and control unit includes a main control chip, a video decoding chip, a video conversion chip and two video encoding chips. The face camera and the cab camera are electrically connected to the video decoding chip respectively, and the video decoding chip is also electrically connected to the main control chip. The video decoding chip can convert the analog signals of the face camera and the cab camera into digital signals and then transmit them to the main control chip; The main control chip is electrically connected to a video conversion chip and a video encoding chip respectively, the video conversion chip is electrically connected to another video encoding chip, the video conversion chip can convert the output signal of the main control chip, and the two video encoding chips can convert the output signal of the video conversion chip and the output signal of the main control chip into video output signals respectively; the video display unit includes a central control display screen of the car, the central control display screen of the car is electrically connected to a video encoding chip, and is used to display the cab situation, the driver's status and monitoring information; the storage unit includes a driving recorder, and the driving recorder is electrically connected to another video encoding chip; The main control chip is also electrically connected to the voice alarm unit and the microcontroller unit respectively. The voice alarm unit is used to send an alarm sound to the cab. The microcontroller unit is electrically connected to the CAN transceiver through the CAN bus. The CAN transceiver is electrically connected to the vehicle system and is used to send system data to the vehicle system and receive real-time information of the vehicle. The system power supply unit includes a power management chip and a buck-voltage regulator chip. The car battery is connected to the buck-voltage regulator chip, the face camera and the cab camera for power supply. The buck-voltage regulator chip is used to power the power management chip. The power management chip is used to power the main control chip, video decoding chip, video conversion chip, two video encoding chips, microcontroller unit, CAN transceiver and system peripheral interface.

2. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized by: Both the face camera and the cab camera are infrared AHD cameras.

3. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized in that: The main control chip is the RV1126 processor.

4. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized by: The video decoding chip is the XS9922B decoding chip.

5. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized by: The video conversion chip is the LT9211 conversion chip, and the two video encoding chips are both XS5013 encoding chips.

6. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized by: The microcontroller unit is the N32G435CBL7 microcontroller and the CAN transceiver is the SN65HVD256DR transceiver.

7. The vehicle fatigue driving warning system based on facial features according to claim 1 is characterized by: The power management chip is the RK809-2 chip, and the step-down voltage regulator chip is the RT2808AGSP chip.

Images