High-speed driving safety auxiliary intelligent glasses and method

Abstract

The invention provides safety auxiliary intelligent glasses and method for high-speed driving, and the safety auxiliary intelligent glasses for high-speed driving comprise a front vehicle camera device which is disposed on the edge of a glasses frame and is used for shooting a front vehicle to obtain a front vehicle image; the eyebrow monitoring device is arranged in the middle of the glasses frame and is used for capturing an eyebrow state of a wearer according to a preset time interval so as to obtain an eyebrow state image; the mainboard is used for analyzing and calculating the front vehicle image and the eyebrow state image to obtain following vehicle distance and eyebrow state data; and if the vehicle following distance and the eyebrow state data reach the preset threshold values, auxiliary reminding is sent out, so that the conditions of fatigue driving and too close vehicle following of the driver are avoided, and the driving safety is improved.

Description

Technical Field

[0001] This invention relates to the field of driver assistance technology, and more specifically, to a high-speed driving safety assistance smart glasses and method. Background Technology

[0002] With the continuous increase in the number of cars, the number of traffic accidents is also increasing every year. Drivers, especially on highways, often cause accidents due to factors such as fatigue, excessive speed, and following too closely. Therefore, reducing the number of traffic accidents and improving the intelligence of driver assistance systems are becoming increasingly important.

[0003] Advanced driver assistance systems (ADAS) can sense the surrounding environment and trigger assistance mechanisms to provide real-time monitoring and intervention in situations such as driver fatigue, distraction, or errors. This significantly reduces the risk of accidents, allows for the timely identification of potential collision risks, and can automatically brake to avoid collisions if the driver fails to react in time. However, due to shortcomings such as high blindness and low coverage in existing ADAS technologies, problems frequently occur, meaning that ADAS technologies can never truly replace driver operation.

[0004] Therefore, there is an urgent need for a high-speed driving safety assistance solution that can detect fatigue driving, speeding, and following distance when users are driving at high speeds, and provide corresponding prompts to assist users in driving at high speeds. Summary of the Invention

[0005] In view of the above problems, the purpose of this invention is to provide a high-speed driving safety assistance smart glasses and a high-speed driving safety assistance method to solve the problem that accidents often occur when drivers are driving at high speeds, especially on highways, due to factors such as fatigue driving, excessive speed, and following too closely.

[0006] The high-speed driving safety assistance smart glasses provided by this invention include temples and a frame, and further include:

[0007] A forward camera device is mounted on the edge of the mirror frame to capture images of the vehicle in front.

[0008] An eyebrow monitoring device is installed in the middle of the frame to capture the wearer's eyebrow state at preset time intervals to obtain eyebrow state images.

[0009] A motherboard, mounted on the temple of the mirror, is used to analyze and process the image of the vehicle in front and the image of the eyebrow state to obtain following distance and eyebrow state data; wherein...

[0010] If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued.

[0011] Preferably, it also includes a positioning module;

[0012] The positioning module is connected to the speed detection module integrated on the motherboard;

[0013] The speed detection module is used to determine the vehicle speed based on the positioning information generated by the positioning module, and compare the vehicle speed with a preset speed threshold; wherein, if the vehicle speed is higher than the speed threshold, an overspeed warning command is issued.

[0014] Preferably, a vehicle distance prediction unit is integrated on the motherboard;

[0015] The vehicle distance prediction unit includes a vehicle distance self-generation model and a vehicle distance prompting module, which are pre-trained based on a convolutional neural network.

[0016] The vehicle distance self-generation model is used to automatically predict and generate the following distance based on the image of the vehicle in front.

[0017] The following distance warning module is used to compare the following distance with a preset following distance threshold corresponding to the vehicle speed based on the vehicle speed. If the following distance is lower than the following distance threshold, a rear-end collision warning command is issued.

[0018] Preferably, a status monitoring unit is integrated on the motherboard;

[0019] The status monitoring unit includes a driver status monitoring model and a status prompting module pre-trained based on a convolutional neural network;

[0020] The driver state monitoring model is used to determine whether the driver is yawning based on the eyebrow state data, and to count the frequency of yawning as eyebrow state data.

[0021] The status prompt module is used to compare the eyebrow status data with a preset frequency threshold. If the occurrence frequency is greater than the frequency threshold, a fatigue prompt command is issued.

[0022] Preferably, a speaker is provided on the temple of the mirror, the speaker being used to emit a speeding warning sound, a rear-end collision warning sound, and a fatigue driving warning sound as auxiliary reminders according to the speeding warning command, the rear-end collision warning command, and the fatigue driving warning command, respectively.

[0023] Preferably, the temples include a left temple and a right temple, wherein,

[0024] The positioning module and the motherboard are mounted on the right temple of the mirror.

[0025] A battery is located on the left temple.

[0026] Preferably, the front vehicle camera device is a medium-to-long telephoto RGB camera.

[0027] Preferably, the eyebrow monitoring device uses an ultra-wide-angle EBT camera;

[0028] The EBT camera takes a picture of the driver's eyebrows and the area between his eyebrows every two seconds to obtain eyebrow status data.

[0029] The present invention also provides a high-speed driving safety assistance method, wherein the method is used to perform safe driving assistance using the high-speed driving safety assistance smart glasses as described above, comprising:

[0030] A camera is used to capture images of the vehicle in front of it by placing a camera on the edge of the mirror frame.

[0031] An eyebrow monitoring device positioned in the center of the frame captures the wearer's eyebrow state at preset time intervals to obtain an image of the eyebrow state.

[0032] The mainboard mounted on the temple of the mirror analyzes and processes the image of the vehicle in front and the image of the eyebrow state to obtain following distance and eyebrow state data; wherein...

[0033] If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued.

[0034] Preferably, if the following distance and the eyebrow status data reach a preset threshold, then during the process of issuing an auxiliary reminder,

[0035] Based on the desired vehicle speed, the following distance is compared with a preset distance threshold corresponding to the vehicle speed. If the following distance is lower than the distance threshold, a rear-end collision warning command is issued. The eyebrow status data is compared with a preset frequency threshold. If the occurrence frequency is greater than the frequency threshold, a fatigue warning command is issued.

[0036] The speakers mounted on the temples of the mirrors provide auxiliary reminders, including rear-end collision warning sounds and fatigue driving warning sounds, based on the rear-end collision warning command and the fatigue driving warning command, respectively.

[0037] As can be seen from the above technical solution, the high-speed driving safety assistance smart glasses and high-speed driving safety assistance method provided by the present invention include: a front vehicle camera device set on the edge of the frame for capturing images of the vehicle in front; an eyebrow monitoring device set in the middle of the frame for capturing the wearer's eyebrow state at preset time intervals; and a motherboard for analyzing and processing the front vehicle image and eyebrow state image to obtain following distance and eyebrow state data; determining the current following distance and eyebrow state data, and issuing an assistance reminder if the following distance and eyebrow state data reach a preset threshold, thereby avoiding driver fatigue and following too closely, and thus improving driving safety. Attached Figure Description

[0038] Other objects and results of the invention will become more apparent and readily understood by referring to the following description taken in conjunction with the accompanying drawings, and with a more complete understanding of the invention. In the drawings:

[0039] Figure 1 This is a schematic diagram of the logical structure of smart glasses for high-speed driving safety assistance according to an embodiment of the present invention;

[0040] Figure 2 This is a flowchart of a high-speed driving safety assistance method according to an embodiment of the present invention. Detailed Implementation

[0041] Existing driver assistance systems can only sense the surrounding environment through sensors to trigger the assistance system, but this technology is highly unreliable and has low coverage.

[0042] To address the aforementioned problems, this invention provides smart glasses for high-speed driving safety assistance and a method for high-speed driving safety assistance. The specific embodiments of this invention will be described in detail below with reference to the accompanying drawings.

[0043] To illustrate the high-speed driving safety assistance smart glasses and high-speed driving safety assistance method provided by this invention Figure 1 , Figure 2 The embodiments of the present invention are illustrated by way of example.

[0044] The following description of exemplary embodiments is merely illustrative and is in no way intended to limit the invention or its application or use. Techniques and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques and equipment should be considered part of the specification.

[0045] like Figure 1 As shown, the present invention provides a high-speed driving safety assistance smart glasses 100, including temples and a frame (not shown in the figure), wherein the glasses further include:

[0046] A forward vehicle camera device 110 is mounted on the edge of the mirror frame and is used to capture images of vehicles ahead.

[0047] An eyebrow monitoring device 120 is installed in the middle of the frame and is used to capture the wearer's eyebrow state at preset time intervals to obtain eyebrow state images.

[0048] The mainboard 130, mounted on the temple of the mirror, is used to analyze and process images of the vehicle in front and eyebrow status images to obtain following distance and eyebrow status data; among which...

[0049] If the following distance and eyebrow status data reach the preset threshold, an auxiliary reminder will be issued.

[0050] In this embodiment, a positioning module 140 is also included. This positioning module 140 is connected to a speed detection module 131 integrated on the motherboard 130. The speed detection module 131 determines the vehicle speed based on the positioning information generated by the positioning module 140 and compares the vehicle speed with a preset speed threshold. If the vehicle speed exceeds the speed threshold, an overspeed warning command is issued. More specifically, using the positioning module 140 built into the high-speed driving safety assistance smart glasses in this embodiment, the current location of the user (driver) and the user's current vehicle speed can be obtained. Based on the location, the current road speed limit can be obtained. This speed limit is used as a speed threshold and compared with the obtained vehicle speed to determine whether the user is speeding. If the user is speeding, an overspeed warning command is issued, followed by a loudspeaker announcement of "Currently speeding, please slow down."

[0051] In this embodiment, a vehicle distance prediction unit 132 is integrated on the motherboard 130. The vehicle distance prediction unit 132 includes a vehicle distance self-generation model 1321 pre-trained based on a convolutional neural network and a vehicle distance prompting module 1322. The vehicle distance self-generation model 1321 is used to automatically predict and generate the following distance based on the image of the vehicle in front. The vehicle distance prompting module 1322 is used to compare the following distance with a preset vehicle distance threshold corresponding to the vehicle speed based on the vehicle speed. If the following distance is lower than the vehicle distance threshold, a rear-end collision warning command is issued. More specifically, when performing following distance detection, a deep learning model for following distance prediction is trained using a convolutional neural network. That is, photos of the vehicle in front are taken using an RGB camera at various following distances (such as 5 meters, 10 meters, 30 meters, 50 meters, 100 meters, 200 meters, 300 meters, 400 meters, 500 meters, and no vehicle in front). The vehicle distance self-generation model is trained using a convolutional neural network and then deployed on the motherboard.

[0052] Specifically, as an example, when a user is driving, the camera in the vehicle ahead can take a picture every 5 seconds to determine the current following distance, and then make a judgment based on the current vehicle speed. For example, at a speed of 100km / h, the following distance should be at least 100 meters. If the user's current following distance is too close, a rear-end collision warning command will be issued, followed by an audio prompt of "Please maintain a safe following distance" through the speaker.

[0053] In this embodiment, a state monitoring unit 133 is integrated on the motherboard. This state monitoring unit 133 includes a driver state monitoring model 1331 pre-trained based on a convolutional neural network and a state prompting module 1332. The driver state monitoring model 1331 is used to determine whether the driver is yawning based on the eyebrow state data, and to count the frequency of yawning as eyebrow state data. The state prompting module 1332 is used to compare the eyebrow state data with a preset frequency threshold; if the frequency is greater than the frequency threshold, a fatigue prompt command is issued. More specifically, a deep learning model for fatigue driving detection is trained using a convolutional neural network as the driver state monitoring model. Specifically, an eyebrow tracking camera is used to take photos of the user's eyebrows when yawning and when not yawning. The yawning photos need to include images of the eyebrows at each stage of the yawn (before, during, and after). The images are labeled before and after, and the driver state monitoring model is obtained by training with a convolutional neural network. The model is then deployed on the motherboard.

[0054] Specifically, as an example, while a user is driving, the eyebrow monitoring device can take a picture of the user's eyebrows every 2 seconds and input the image into a driver state monitoring model that detects fatigue driving. The model can then output a judgment on whether the user is currently yawning. If the number of yawns by the user exceeds a threshold within half an hour (this threshold can be set, such as 3 yawns within half an hour), the user is judged to be driving while fatigued, a fatigue warning command is issued, and then a "Do not drive while fatigued" prompt is broadcast through the speaker.

[0055] In one specific embodiment of the present invention, a speaker 150 is provided on the temple of the mirror. The speaker 150 is used to emit a speeding warning sound, a rear-end collision warning sound, and a fatigue driving warning sound as auxiliary reminders according to the above-mentioned speeding warning command, rear-end collision warning command, and fatigue driving warning command.

[0056] In one specific embodiment, the high-speed driving safety assistance smart glasses mainly comprise three parts: left and right temples and a front frame, all electrically connected via an FPC. In this embodiment, a battery is mounted on the temple to provide power to the components of the entire high-speed driving safety assistance smart glasses. More specifically, the positioning module 140 and the main board 130 can be mounted on the same temple, while the battery is mounted on the other temple. This facilitates the transmission of data generated by the positioning module to the main board and ensures a reasonable spatial distribution between the two temples. As an example, the positioning module and main board can be mounted on the right temple, and the battery on the left temple, thereby minimizing the unit area of ​​the temples.

[0057] In this embodiment, the front vehicle camera device uses a medium-long telephoto RGB camera, and the eyebrow monitoring device uses an ultra-wide-angle EBT camera; the EBT camera takes a picture of the driver's eyebrows and the center of the eyebrows every two seconds to obtain eyebrow status data.

[0058] The core components required in this embodiment are a front-view camera and an eyebrow monitoring device, specifically an eyebrow-tracking camera. The front-view camera can be an RGB camera, and the eyebrow-tracking camera is an EBT camera. The RGB camera is located on the front frame and simulates a first-person view of the user to capture the vehicle in front of them; its main function is to detect following distance. It is important to note that, to ensure accuracy, the RGB camera should not be the wide-angle camera commonly used in smart glasses, but rather a medium-to-long telephoto camera with an equivalent focal length of approximately 75mm. For example, in this embodiment, a medium-to-long telephoto camera with an equivalent focal length of approximately 60-95mm is used. The eyebrow-tracking camera is located in the center of the front frame and can be an ultra-wide-angle monochrome camera to capture eyebrows for fatigue driving detection. The positioning module and main control module are both located on the right temple of the mirror. The positioning module detects vehicle speed, while the main control module is responsible for overall system control, neural network calculations, image processing, and issuing prompts. Combined with a speaker receiving the prompts, it emits audible alerts to prevent driver fatigue and over-following, thereby improving driving safety.

[0059] As described above, the high-speed driving safety assistance smart glasses provided by the present invention monitor the vehicle ahead and detect the state of the eyebrows by setting up a forward vehicle camera and an eyebrow monitoring device, and provide corresponding prompts for following too closely and fatigue driving by setting up a motherboard and a speaker, thereby providing real-time prompts to the driver to avoid fatigue driving and following too closely, and improving the driver's driving safety.

[0060] like Figure 2As shown, the present invention also provides a high-speed driving safety assistance method, which involves wearing the high-speed driving safety assistance smart glasses described above for safe driving assistance, including:

[0061] S1: Obtain an image of the vehicle in front by taking a picture of the vehicle in front using a front camera device set on the edge of the mirror frame;

[0062] S2: An eyebrow monitoring device positioned in the middle of the frame captures the wearer's eyebrow state at preset time intervals to obtain an image of the eyebrow state.

[0063] S3: The mainboard mounted on the temple of the mirror analyzes and processes the image of the vehicle in front and the image of the eyebrow state to obtain following distance and eyebrow state data; wherein...

[0064] If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued.

[0065] More specifically, if the following distance and the eyebrow status data reach a preset threshold, then during the process of issuing an auxiliary reminder,

[0066] Based on the desired vehicle speed, the following distance is compared with a preset distance threshold corresponding to the vehicle speed. If the following distance is lower than the distance threshold, a rear-end collision warning command is issued. The eyebrow status data is compared with a preset frequency threshold. If the occurrence frequency is greater than the frequency threshold, a fatigue warning command is issued.

[0067] The speakers mounted on the temples of the mirrors provide auxiliary reminders, including rear-end collision warning sounds and fatigue driving warning sounds, based on the rear-end collision warning command and the fatigue driving warning command, respectively.

[0068] For a more specific implementation of the above-mentioned high-speed driving safety assistance method, please refer to the aforementioned embodiment of the high-speed driving safety assistance smart glasses, which will not be repeated here.

[0069] As described above, the high-speed driving safety assistance smart glasses and high-speed driving safety assistance method provided by the present invention can enable users to perform fatigue driving detection, speeding detection, and following distance detection when driving at high speeds, and provide corresponding prompts to reduce the occurrence of rear-end collisions and fatigue driving accidents.

[0070] The high-speed driving safety assistance smart glasses and high-speed driving safety assistance method proposed according to the present invention have been described above by way of example with reference to the accompanying drawings. However, those skilled in the art should understand that various modifications can be made to the high-speed driving safety assistance smart glasses and high-speed driving safety assistance method proposed by the present invention without departing from the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the content of the appended claims.

Claims

1. A high-speed driving safety assistance smart glasses, comprising temples and a frame, characterized in that, Also includes: A forward camera device is mounted on the edge of the mirror frame to capture images of the vehicle in front. An eyebrow monitoring device is installed in the middle of the frame to capture the wearer's eyebrow state at preset time intervals to obtain eyebrow state images. A motherboard, mounted on the temple of the mirror, is used to analyze and process the image of the vehicle in front and the image of the eyebrow state to obtain following distance and eyebrow state data; wherein... If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued.

2. The high-speed driving safety assistance smart glasses as described in claim 1, characterized in that, It also includes a positioning module; The positioning module is connected to the speed detection module integrated on the motherboard; The speed detection module is used to determine the vehicle speed based on the positioning information generated by the positioning module, and compare the vehicle speed with a preset speed threshold; wherein, if the vehicle speed is higher than the speed threshold, an overspeed warning command is issued.

3. The high-speed driving safety assistance smart glasses as described in claim 2, characterized in that, A vehicle distance prediction unit is integrated on the motherboard; The vehicle distance prediction unit includes a vehicle distance self-generation model and a vehicle distance prompting module, which are pre-trained based on a convolutional neural network. The vehicle distance self-generation model is used to automatically predict and generate the following distance based on the image of the vehicle in front. The following distance warning module is used to compare the following distance with a preset following distance threshold corresponding to the vehicle speed based on the vehicle speed. If the following distance is lower than the following distance threshold, a rear-end collision warning command is issued.

4. The high-speed driving safety assistance smart glasses as described in claim 3, characterized in that, A status monitoring unit is integrated on the motherboard; The status monitoring unit includes a driver status monitoring model and a status prompting module pre-trained based on a convolutional neural network; The driver state monitoring model is used to determine whether the driver is yawning based on the eyebrow state data, and to count the frequency of yawning as eyebrow state data. The status prompt module is used to compare the eyebrow status data with a preset frequency threshold. If the occurrence frequency is greater than the frequency threshold, a fatigue prompt command is issued.

5. The high-speed driving safety assistance smart glasses as described in claim 4, characterized in that, A speaker is provided on the temple of the mirror, which is used to emit a speeding warning sound, a rear-end collision warning sound, and a fatigue driving warning sound as auxiliary reminders according to the speeding warning command, the rear-end collision warning command, and the fatigue driving warning command, respectively.

6. The high-speed driving safety assistance smart glasses as described in claim 1, characterized in that, The temples include a left temple and a right temple, wherein... The positioning module and the motherboard are mounted on the right temple of the mirror. A battery is located on the left temple.

7. The high-speed driving safety assistance smart glasses as described in claim 1, characterized in that, The front vehicle camera device uses a medium-to-long telephoto RGB camera.

8. The high-speed driving safety assistance smart glasses as described in claim 1, characterized in that, The eyebrow monitoring device uses an ultra-wide-angle EBT camera; The EBT camera takes a picture of the driver's eyebrows and the area between his eyebrows every two seconds to obtain eyebrow status data.

9. A high-speed driving safety assistance method, characterized in that, For use of the high-speed driving safety assistance smart glasses as described in any one of claims 1-8 for safe driving assistance, including: A camera is used to capture images of the vehicle in front of it by placing a camera on the edge of the mirror frame. An eyebrow monitoring device positioned in the center of the frame captures the wearer's eyebrow state at preset time intervals to obtain an image of the eyebrow state. The mainboard mounted on the temple of the mirror analyzes and processes the image of the vehicle in front and the image of the eyebrow state to obtain following distance and eyebrow state data; wherein... If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued.

10. The high-speed driving safety assistance method as described in claim 9, characterized in that, If the following distance and the eyebrow status data reach a preset threshold, an auxiliary reminder will be issued, including: Based on the desired vehicle speed, the following distance is compared with a preset distance threshold corresponding to the vehicle speed. If the following distance is lower than the distance threshold, a rear-end collision warning command is issued. The eyebrow status data is compared with a preset frequency threshold. If the occurrence frequency is greater than the frequency threshold, a fatigue warning command is issued. The speakers mounted on the temples of the mirrors provide auxiliary reminders, including rear-end collision warning sounds and fatigue driving warning sounds, based on the rear-end collision warning command and the fatigue driving warning command, respectively.

Images