A driver behavior detection device based on AI recognition and its behavior analysis and early warning method

Through the driver behavior detection device based on AI recognition, combined with cameras, near-infrared light sources and micro motors to remove mist and dust, the impact of winter fog and dust on camera analysis is solved, and the accurate analysis and early warning of driver behavior is achieved, reducing the risk of traffic accidents.

CN117095154BActive Publication Date: 2025-08-12HANGZHOU WANGUO RUANBAO INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310852566.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-12
Publication Date
2025-08-12
Estimated Expiration
2043-07-12

AI Technical Summary

Technical Problem

The existing driver behavior detection device has poor camera analysis effect under the influence of winter fog and dust impurities, resulting in inaccurate driver behavior analysis.

Method used

Using AI-based driver behavior detection device, combined with a camera, near-infrared light source, ventilation module and micro motor, the mist and dust are removed through brush plates and ventilation ducts to ensure that the camera is clearly photographed, and behavior analysis and early warning are performed through the data processor.

Benefits of technology

Effectively remove fog and dust in winter, ensure clear camera shooting, achieve accurate analysis and timely warning of driver behavior, and reduce the risk of traffic accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117095154B_ABST
    Figure CN117095154B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of driver behavior detection technology, and specifically to a driver behavior detection device based on AI recognition and a behavior analysis and early warning method thereof, comprising: when used in winter, after the driver enters the vehicle, fog usually appears on the vehicle windshield, and the detection device is started at this time, and the micro motor inside the detection device is started. After the micro motor is started, the micro motor drives the rotating shaft to rotate, and when the rotating shaft rotates, the rotating shaft drives the brush plate to rotate. When the brush plate rotates, a soft brush is provided under the brush plate, and the material of the soft brush is flexible rubber, so when the brush plate rotates, the brush plate brushes the camera below, and the brush plate can scrape off the fog on the camera, thereby preventing the fog from affecting the camera, resulting in unclear camera shots of the driver.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of driver behavior detection, and in particular to a driver behavior detection device based on AI recognition and a behavior analysis and early warning method thereof. Background Art

[0002] Talking on the phone while driving, driving while fatigued, and smoking in the car are bad habits for many drivers. Every year, there are many traffic accidents caused by talking on the phone while driving, driving while fatigued, and smoking in the car.

[0003] According to Article 62 (3) of the Regulations for the Implementation of the Road Traffic Safety Law of the People's Republic of China, drivers of motor vehicles are prohibited from making or receiving calls on handheld phones. Violators will be fined 200 yuan and have 2 points deducted.

[0004] The main risk factor for talking on the phone while driving is that it distracts the driver, thus affecting their reaction time. During normal driving, the driver's time to sense and brake in an emergency is 0.57 seconds, while when using a phone while driving, the time to sense and brake in an emergency is 2.12 seconds. The latter is nearly four times higher than the former, proving that using a phone can seriously reduce a driver's reaction time.

[0005] In the prior art, driver behavior analysis is mostly performed through in-car cameras. However, in-car cameras have the following problems:

[0006] 1) In winter or in cold weather, when the driver starts the vehicle, fog will appear inside the vehicle. When fog forms, it will affect the camera's light exposure, thereby affecting the camera's analysis of the driver's behavior;

[0007] 2) When the car is driven for a long time, dust and impurities will accumulate inside the car, which will block the camera and affect the camera's analysis of the driver's behavior;

[0008] In summary, in order to solve the technical problems raised in this paper, the present invention proposes a driver behavior detection device based on AI recognition and its behavior analysis and early warning method Summary of the Invention

[0009] In order to make up for the deficiencies of the existing technology, the present invention proposes a driver behavior detection device based on AI recognition and a behavior analysis and early warning method thereof to solve the above technical problems.

[0010] The technical solution adopted by the present invention to solve the technical problem is: a driver behavior detection device based on AI recognition; comprising a camera, wherein the camera is provided with a near-infrared light source; and further comprising;

[0011] A support plate, the support plate is detachably connected to the cockpit, and the camera is detachably connected to the support plate;

[0012] A slot number 1, the slot number 1 being provided on the surface of the support plate, and the camera being installed inside the slot number 1;

[0013] a circuit board, the circuit board being disposed inside the support plate, the circuit board being exposed from the first slot, and the camera being connected to the circuit board after being mounted on the support plate;

[0014] The circuit board is internally provided with a control system, which is internally provided with a data processor, a data storage device, a satellite positioning module, a wireless communication transmission module and a data communication interface, etc. The data communication interface is used to connect the circuit board with the internal circuit of the cockpit;

[0015] The ventilation module is arranged on the support plate, and the air outlet of the ventilation module faces the camera side.

[0016] The ventilation module comprises:

[0017] A ventilation pipe is provided on the support plate, the inlet of the ventilation pipe is located on the lower side, and the air outlet of the ventilation pipe is located on one side of the camera;

[0018] The aperture of the air inlet of the ventilation duct is larger than the aperture of the air outlet;

[0019] A rotating shaft, the rotating shaft is arranged on both sides of the carrying port, and a brush plate is sleeved on the rotating shaft, and the brush plate is a flexible brush structure;

[0020] A micro motor is used to realize the rotation of the rotating shaft.

[0021] A paper sheet is provided at one end of the brush plate away from the camera, and the paper sheet blocks the brush.

[0022] An arc groove is provided on the side of the No. 1 groove, and the interface of the arc groove is an inverted T-shape, and one end of the arc groove has a larger opening; a card block is provided at the lower end of the camera, and the shape of the card block is an inverted T-shape, and when the camera is installed, the card block can enter from the large opening end of the arc groove; and the outer ring of the camera is rough.

[0023] The method is applicable to a driver behavior detection device based on AI recognition in the above claim; including:

[0024] And when the data processor analyzes the driver's dynamic behavior information through the camera, when the driver's dynamic behavior violates traffic rules or laws, the data processor is connected to the playback module inside the cockpit through the circuit board, or the data processor is connected to the vibration module inside the cockpit through the circuit board.

[0025] When the data processor performs dynamic module analysis on the driver through the camera, the data processor is electrically connected to the satellite positioning module, and the data processing module is connected to the wireless call module inside the cockpit, and the wireless call module is wirelessly connected to the customer service background.

[0026] The data processor includes a data processor that is electrically connected to a circuit board and a camera. The camera transmits dynamic information of the driver in real time to a data storage device, and the storage time of the data storage device is seven days.

[0027] The beneficial effects of the present invention are as follows:

[0028] 1. The driver behavior detection device based on AI recognition and the behavior analysis and early warning method thereof described in the present invention, when used in winter, after the driver enters the vehicle, fog will usually appear on the windshield of the vehicle, and the detection device is started at this time, and the micro motor inside the detection device is started. After the micro motor is started, the micro motor will drive the rotating shaft to rotate, and when the rotating shaft rotates, the rotating shaft drives the brush plate to rotate. When the brush plate rotates, a soft brush is provided under the brush plate, and the material of the soft brush is flexible rubber, so when the brush plate is rotating, the brush plate brushes the camera below, and the brush plate can scrape off the fog on the camera, thereby preventing the fog from affecting the camera, causing the camera to take unclear pictures of the driver.

[0029] 2. The present invention describes a driver behavior detection device based on AI recognition and a behavior analysis and early warning method thereof. On the one hand, the gas generated by the front windshield is blown upward, and then the gas is blown to the camera through the ventilation pipe. At this time, the gas blows the paper, and the paper blocks the brush plate. Then the micro motor rotates, and the micro motor drives the rotating shaft to rotate. When the rotating shaft rotates, the rotating shaft drives the scraper to rotate, and when the scraper rotates, the paper is always in a state of close fit with the brush plate. When the micro motor does not rotate, the front windshield defogger is started at this time. When the gas passes through the inside of the ventilation pipe, the paper blocks the gas to prevent the gas from blowing onto the scraper, and the gas from blowing dust and impurities on the scraper onto the camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0031] Figure 1 is a perspective view of the present invention;

[0032] Figure 2 yes Figure 1 Structural view of the central ventilation duct;

[0033] Figure 3 yes Figure 2 Structural view of the middle scraper;

[0034] Figure 4 yes Figure 1 Structural view of the middle support plate;

[0035] Figure 5 yes Figure 1 Structural view of the middle camera;

[0036] In the figure: camera 1, support plate 11, slot No. 1 12, circuit board 13, arc slot 14, clamping block 15, ventilation module 2, ventilation pipe 21, rotating shaft 22, brush plate 23, paper 24. DETAILED DESCRIPTION

[0037] In order to make the technical means, creative features, objectives and effects achieved by the present invention easier to understand, the present invention is further described below in conjunction with specific implementation methods.

[0038] like Figure 1-Figure 5 As shown, a driver behavior detection device based on AI recognition; comprising a camera 1, wherein the camera 1 is provided with a near-infrared light source; and further comprising;

[0039] A support plate 11, the support plate 11 is detachably connected to the cockpit, and the camera 1 is detachably connected to the support plate 11;

[0040] A slot 12 is provided on the surface of the support plate 11 and the camera 1 is installed inside the slot 12;

[0041] A circuit board 13 is provided inside the support plate 11 . The circuit board 13 is exposed from the first slot 12 . After the camera 1 is mounted on the support plate 11 , the camera 1 is connected to the circuit board 13 .

[0042] The circuit board 13 is internally provided with a control system, which includes a data processor, a data storage device, a satellite positioning module, a wireless communication transmission module, and a data communication interface. The data communication interface is used to connect the circuit board 13 with the internal circuit of the cockpit.

[0043] The ventilation module 2 is provided on the support plate 11, and the air outlet of the ventilation module 2 faces the camera side;

[0044] The ventilation module 2 includes:

[0045] The ventilation pipe 21 is provided on the support plate 11 , the inlet of the ventilation pipe 21 is located at the lower side, and the air outlet of the ventilation pipe 21 is located on one side of the camera 1 ;

[0046] The aperture of the air inlet of the ventilation pipe 21 is larger than the aperture of the air outlet;

[0047] A rotating shaft 22 is provided on both sides of the carrying port, and a brush plate 23 is sleeved on the rotating shaft 22, and the brush plate 23 is a flexible brush structure;

[0048] A micro motor, which is used to rotate the rotating shaft 22;

[0049] First, when in use, the driver enters the cockpit and starts the vehicle. When the vehicle starts, the vehicle will drive the detection device to run synchronously. When the vehicle starts, the camera 1 starts with the vehicle, and then the detection device enters the working state;

[0050] After the vehicle is started, the circuit inside the driver's cabin transmits current to the electronic components inside the cockpit. At this time, the current is connected to the circuit board 13 through the communication interface. When the circuit board 13 is electrically connected, the data processor, data storage, satellite positioning module, and wireless communication transmission module inside the circuit board 13 are powered on; the data processor, data storage, satellite positioning module, and wireless communication transmission module are working, and the support plate 11 is disassembled and installed in a position where the cockpit does not affect the line of sight, such as on the A-pillar, and by making the support plate 11 detachable and connected to the cockpit, the support plate 11 can be easily disassembled inside the cockpit, thereby facilitating the installation and disassembly of the support plate 11; and by making the camera 1 detachable and connected to the support plate 11, when installing the camera 1, by twisting the camera 1 into the No. 1 slot 12, when the camera 1 is twisted into the No. 1 slot 12, the bottom of the camera 1 is connected to the circuit board 13 inside the support plate 11, and the camera 1 is powered on. The camera 1 monitors the driver in real time to achieve dynamic analysis of the driver's behavior;

[0051] And by arranging the ventilation module 2 on the support plate 11, and by making the ventilation module 2 include a ventilation pipe 21, and making the ventilation pipe 21 be arranged on the support plate 11, when used in winter, after the driver enters the vehicle, fog will usually appear on the vehicle windshield, at this time the detection device is started, and the micro motor inside the detection device is started. After the micro motor is started, the micro motor will drive the rotating shaft 22 to rotate, and when the rotating shaft 22 rotates, the rotating shaft 22 drives the brush plate 23 to rotate, and when the brush plate 23 rotates, a soft brush is arranged under the brush plate 23, and the material of the soft brush is flexible rubber, so when the brush plate 23 rotates, the brush plate 23 brushes the camera 1 below, and the brush plate 23 can scrape off the fog on the camera 1, thereby preventing the fog from affecting the camera 1, resulting in unclear shooting of the driver by the camera 1;

[0052] And by setting the ventilation pipe 21, the aperture of the air inlet of the ventilation pipe 21 is larger than that of the air outlet. When the driver turns on the front windshield defogger button inside the cockpit in winter, by tilting the air inlet of the ventilation pipe 21 downward, the wind force discharged by the front windshield defogger inside the cockpit enters the interior of the ventilation pipe 21. Since the shape of the ventilation pipe 21 is a large opening at one end and a small opening at the other end, after the wind force blown out by the front windshield defogger enters the interior of the ventilation pipe 21, when the wind force passes through the air inlet and enters the air outlet, the aperture size of the ventilation pipe 21 is reduced. The air pressure caused by the wind will be enhanced, which will increase the force of the wind blown out, thereby increasing the wind force transmitted to the camera 1 by the ventilation pipe 21, thereby achieving defogging of the surface of the camera 1; and the brush plate 23 can cooperate with the ventilation pipe 21 to first scrape off the fog and dust impurities from the camera 1, and some of the dust adhering to the lens of the camera 1 can be scraped off from the lens of the camera 1 by the brush plate 23, and then the dust and fog adhering to the camera 1 are cleaned by the wind force of the front windshield defogging, thereby preventing the fog and dust from obstructing the camera 1.

[0053] Example 2

[0054] A paper sheet 24 is provided at one end of the brush away from the camera 1, and the paper sheet 24 blocks the brush;

[0055] A paper sheet 24 is provided at one end of the brush away from the camera 1, and the paper sheet 24 blocks the brush; on the one hand, when the vehicle is started, if it is winter, fog appears on the front windshield of the vehicle while the car is driving, then the driver can start the front windshield defogger, and the air flow sprayed by the front windshield defogger blows the front windshield, on the other hand, the gas generated by the front windshield blows upward, and then the gas is blown to the camera 1 through the vent pipe, and at this time the gas blows the paper sheet 24, and the paper sheet is blown away. The piece of paper 24 blocks the brush plate 23, and then the micro motor rotates, and the micro motor drives the shaft 22 to rotate. When the shaft 22 rotates, the shaft 22 drives the scraper to rotate, and when the scraper is rotating, the paper piece 24 is always in a state of close contact with the brush plate 23, and when the micro motor is not rotating, the front windshield defogger is started. When the gas passes through the inside of the ventilation pipe, the paper piece 24 blocks the gas to prevent the gas from blowing onto the scraper, and the gas will blow the dust and impurities on the scraper onto the camera 1.

[0056] Example 3:

[0057] An arc-shaped groove 14 is provided on the side of the first groove 12, and the interface of the arc-shaped groove 14 is inverted T-shaped, and one end of the arc-shaped groove 14 is wide open; a clamping block 15 is provided at the lower end of the camera 1, and the shape of the clamping block 15 is inverted T-shaped, and when the camera 1 is installed, the clamping block 15 can enter from the wide open end of the arc-shaped groove 14; and the outer ring of the camera 1 is roughened;

[0058] By providing an arc groove 14 on the side of groove No. 1, and making the interface of the arc groove 14 an inverted T shape, and the opening at one end of the arc groove 14 is large, and by providing a card block 15 at the lower end of the camera 1, and making the interface shape of the card block 15 the same as the interface shape of the arc groove 14, when installing the camera 1, each card block 15 is aligned with the large end of each arc groove 14, and then the camera 1 is pressed to embed the camera 1 into the arc groove 14. After the camera 1 is embedded in the arc groove 14, the camera 1 is then rotated clockwise, and the card block 15 on the camera 1 rotates inside the arc groove 14, so that the camera 1 is installed on the support plate 11; and by making the outer ring of the camera 1 rough, it is convenient for the driver to install, inspect and replace the camera 1.

[0059] Example 4:

[0060] A driver behavior analysis and warning method based on AI recognition, which is applicable to a driver behavior detection device based on AI recognition as described in claims 1-4 above; including:

[0061] When the data processor analyzes the driver's dynamic behavior information through the camera 1, when the driver's dynamic behavior violates traffic rules or laws, the data processor is connected to the playback module inside the cockpit through the circuit board 13, or the data processor is connected to the vibration module inside the cockpit through the circuit board 13;

[0062] When the data processor performs dynamic module analysis on the driver through the camera 1, the data processor is electrically connected to the satellite positioning module, and the data processing module is connected to the wireless communication module inside the cockpit, and the wireless communication module is wirelessly connected to the customer service background;

[0063] By making the data processor analyze the dynamic behavior information of the driver through the camera 1, when the driver has illegal or illegal behavior during driving, the data processor inside the camera 1 analyzes the driver's behavior;

[0064] For example, when a driver is driving, camera 1 detects the driver's behavior, and the data processing module performs image processing through three-dimensional contours to identify the driver's behavior; the driver's behavior includes but is not limited to normal driving, making phone calls, operating a mobile phone, and smoking;

[0065] 1) When the processor detects that the driver is holding the steering wheel with both hands and that their sitting posture matches the steering angle of the steering wheel, it can determine that the driver is driving normally and continue to monitor the driver's subsequent actions;

[0066] 2) When the processor detects that the driver's hands are off the steering wheel and remain on the side of the head for a long time, it can determine that the driver is on the phone;

[0067] 3) When the processor detects that the driver's hands are off the steering wheel and their head is facing their hands for a long time, it can determine that the driver is using a mobile phone;

[0068] 4) When the processor detects that the driver's hand is off the steering wheel and close to their mouth, and there is a hot spot near their hand, it can determine that the driver is smoking;

[0069] When the data processor detects any one of the above four (but not limited to the above four) during the monitoring process of camera 1, the data processor transmits the dynamic information to the playback module inside the cockpit. After the playback module receives the information, the playback module plays the corresponding prompt sound inside the cockpit. At the same time, the data processor transmits the dynamic information to the vibration module inside the cockpit. The vibration module receives any information and vibrates the inside of the cockpit; this is used to remind the driver to drive in accordance with traffic regulations, thereby avoiding traffic hazards to a certain extent and playing a warning role;

[0070] When the driver is driving fatigued for a long time on the road, when the camera 1 captures the driver's hands placed on the face, or recognizes that the driver's mouth is wide open, the data processor analyzes that the driver is in a state of fatigue. At this time, the data processor transmits the information to the playback module and the vibration module to remind the driver to take a proper rest. The data processor transmits the data information to the satellite positioning module. The satellite positioning module analyzes the current location of the driver and the vehicle, and transmits the surrounding rest locations to the central control screen inside the cockpit, along with the route. If the driver does not enter the corresponding rest area after three reminders, the data processing module transmits the corresponding information to the wireless call module and the customer service background, such as OnStar customer service the day after tomorrow. The customer service staff will manually make a call through the playback module inside the cockpit the day after tomorrow to remind the driver to drive into the rest area ahead, thereby avoiding traffic hazards to a certain extent and playing a warning role.

[0071] Example 5

[0072] The data processor includes a data processor that is electrically connected to the circuit board 13 and the camera 1. The camera 1 transmits the dynamic information of the driver in real time to the data storage device, and the storage time of the data storage device is seven days;

[0073] The data processor and data storage device provided by the present invention store computer instructions thereon; when the computer instructions are executed by the data processor, the driver behavior monitoring method provided by any of the above embodiments can be implemented to monitor whether the driver has committed any illegal behavior during driving, thereby avoiding the hidden dangers of traffic accidents.

Claims

1. A driver behavior detection device based on AI recognition; The invention comprises a camera (1), wherein the camera (1) is provided with a near-infrared light source; and is characterized in that it further comprises: A support plate (11), the support plate (11) is detachably connected to the driving cabin, and the camera (1) is detachably connected to the support plate (11); A first slot (12), the first slot (12) being provided on the surface of the support plate (11), and the camera (1) being installed inside the first slot (12); A circuit board (13), wherein the circuit board (13) is arranged inside the support plate (11), the circuit board (13) is exposed from the numbered slot (12), and after the camera (1) is mounted on the support plate (11), the camera (1) is connected to the circuit board (13); a control system is provided inside the circuit board (13), and a data processor, a data storage device, a satellite positioning module, a wireless communication transmission module and a data communication interface are provided inside the control system, and the data communication interface is used to realize the connection between the circuit board (13) and the internal circuit of the cockpit; A ventilation module (2), the ventilation module (2) being arranged on the support plate (11), and the air outlet of the ventilation module (2) facing the camera side; The ventilation module (2) comprises: A ventilation pipe (21), the ventilation pipe (21) is arranged on the support plate (11), the inlet of the ventilation pipe (21) is located on the lower side, and the air outlet of the ventilation pipe (21) is located on the side of the camera (1); the aperture of the air inlet of the ventilation pipe (21) is larger than the aperture of the air outlet; A rotating shaft (22), the rotating shaft (22) is arranged on both sides of the carrying port, and a brush plate (23) is sleeved on the rotating shaft (22), and the brush plate (23) is a flexible brush structure; A micro motor, the micro motor being used to realize the rotation of the rotating shaft (22); A paper sheet (24) is provided at one end of the brush plate (23) away from the camera (1), and the paper sheet (24) blocks the brush.

2. The driver behavior detection device based on AI recognition according to claim 1, characterized in that: The side of the No. 1 slot (12) is provided with an arc groove (14), and the interface of the arc groove (14) is in an inverted T shape, and one end of the arc groove (14) has a large opening; the lower end of the camera (1) is provided with a card block (15), the shape of the card block (15) is in an inverted T shape, and when the camera (1) is installed, the card block (15) can enter from the large end opening of the arc groove (14); and the outer ring of the camera (1) is rough.

3. A driver behavior analysis and warning method based on AI recognition, characterized by: This method is applicable to a driver behavior detection device based on AI recognition in claims 1-2 above; These include; When the data processor analyzes the driver's dynamic behavior information through the camera (1), when the driver's dynamic behavior violates traffic rules or laws, the data processor is connected to the playback module inside the cockpit through the circuit board (13), or the data processor is connected to the vibration module inside the cockpit through the circuit board (13).

4. A driver behavior analysis and warning method based on AI recognition according to claim 3, characterized in that: When the data processor performs dynamic module analysis on the driver through the camera (1), the data processor is electrically connected to the satellite positioning module, and the data processing module is connected to the wireless communication module inside the driving cabin, and the wireless communication module is wirelessly connected to the customer service background.

5. A driver behavior analysis and warning method based on AI recognition according to claim 4, characterized in that: The data processor includes: the data processor is electrically connected to a circuit board (13) and a camera (1); the camera (1) transmits dynamic information of the driver captured in real time to a data storage device; and the storage time of the data storage device is seven days.

Citation Information

Patent Citations

  • A vehicle driver monitoring method, arrangement, system, software and mobile application

    AU2015101831A4

  • A vehicle driver monitoring method, arrangement, system, software and application

    AU2015271971A1