Vehicle driving assistance system based on AR glasses and method thereof

Abstract

The invention discloses a vehicle driving assistance system and method based on AR glasses. The system comprises an environment sensing module, a driver state monitoring module, a danger early warning and avoiding module, an automatic driving and auxiliary driving module, a driving simulation and training module, an abnormal behavior recognition module, a road information and navigation module and a health and emergency response module. The environment perception module is used for solving the problem of poor sight in extreme weather and road perception in a complex environment; by means of sensors such as the laser radar and the camera, road obstacles, pedestrians and vehicles can be accurately recognized, highlighted marking in the AR visual field is achieved, accidents caused by sight blind areas or distraction are reduced, indexes such as the blinking frequency and the head posture of a driver can be monitored, immediate reminding is conducted when fatigue or distraction is found, and parking and resting are forcibly suggested when necessary; and when the driver does not respond in time, the system can automatically brake or adjust the direction to avoid collision.

Description

Technical Field

[0001] The present invention relates to the technical field of road traffic operation, and specifically to a vehicle driving assistance system and method based on AR glasses. Background Art

[0002] With the continuous growth of the number of motor vehicles, the problem of road traffic safety has become increasingly prominent. According to statistics, the number of deaths caused by traffic accidents globally exceeds 1.3 million every year, and most of these accidents are related to driver operation errors, fatigue driving, bad weather or sudden emergencies.

[0003] Although traditional driving assistance systems (such as reverse radars and lane departure warnings) can provide some help, they have limitations such as scattered information and poor interactivity. Drivers still need to frequently distract to check the instrument panel or the central control screen, increasing safety hazards.

[0004] In recent years, the rapid development of augmented reality (AR) technology has provided new solutions for intelligent driving assistance. AR technology can overlay virtual information (such as navigation arrows and obstacle markings) onto the real driving vision in real time, reducing line-of-sight deviation and improving driving concentration. However, in extreme weather conditions such as rain, snow, fog, etc., the recognition accuracy of traditional cameras and radars in existing AR driving assistance systems drops significantly, resulting in distorted or delayed AR display information. Existing systems mostly rely on steering wheel grip force or simple face recognition, making it difficult to accurately judge fatigue, distraction or sudden health problems. Most systems only provide audible or vibration alarms and lack deep linkage with the vehicle control system (such as automatic avoidance or emergency braking). Moreover, novice drivers in traditional systems are difficult to simulate complex road conditions (such as heavy rain at night, flat tire on the highway) through traditional methods, resulting in insufficient emergency response capabilities. Therefore, we propose a vehicle driving assistance system and method based on AR glasses. Summary of the Invention

[0005] The purpose of the present invention is to provide a vehicle driving assistance system and method based on AR glasses to solve the problems raised in the above background art.

[0006] To achieve the above purpose, a vehicle driving assistance system based on AR glasses includes an environment perception module, a driver state monitoring module, a danger warning and avoidance module, an automatic driving and assisted driving module, a driving simulation and training module, an abnormal behavior recognition module, a road information and navigation module, and a health and emergency response module; The environment perception module is used to solve the problem of poor visibility in extreme weather and perceive roads in complex environments; The driver state monitoring module is used to solve the safety hazards of driver fatigue or distraction and driver physiological abnormalities; The described danger warning and avoidance module is used to solve the warning problem of sudden traffic accidents or obstacles, as well as calculate the distance between the vehicle and the obstacle ahead and make real-time responses; The described autonomous driving and assisted driving module is used to solve the problems of lane keeping and path optimization, as well as automatically intervene in dangerous situations; The described driving simulation and training module is used to solve the problems of driving skill training and emergency situation training, as well as improve the driver's decision-making ability; The described abnormal behavior recognition module is used to solve the problem of recognizing the driver's abnormal behavior, as well as detecting the driver's fatigue or unsafe driving behavior; The described road information and navigation module is used to solve the problems of dynamic path planning and real-time road condition update, as well as enhance the display of road signs and traffic information; The described health and emergency response module is used to solve the problems of monitoring and responding to sudden health conditions of the driver, as well as responding to emergencies and automatic navigation.

[0007] Preferably, the data integrity verification module includes an integrity check unit and a constraint verification unit; The integrity check unit calculates the hash value of the database records using the hash algorithm to verify the integrity of the data during transmission or storage; The constraint verification unit uses constraint programming technology to automatically check the data constraint conditions in the database.

[0008] Preferably, the environmental perception module includes a high-precision weather prediction and visual enhancement unit, and a lidar and stereo vision fusion unit; The high-precision weather prediction and visual enhancement unit is used to use sensors and real-time weather data to perform real-time prediction and recognition of the driving environment through algorithms; The lidar and stereo vision fusion unit is used to accurately capture and construct a three-dimensional stereo image around the road by combining lidar and stereo vision.

[0009] Preferably, the driver state monitoring module includes a facial expression and eye movement analysis unit, and a physiological signal monitoring unit; The facial expression and eye movement analysis unit is used to monitor the driver's facial expression, eye movement trajectory and pupil changes through the built-in camera on the AR glasses, analyze the driver's fatigue level and attention dispersion in real time, and intervene through voice or visual reminders; The physiological signal monitoring unit is used to monitor the changes in the driver's physiological signals through sensors to judge whether the driver has psychological states such as anxiety and excitement.

[0010] Preferably, the danger warning and avoidance module includes an emergency event detection unit and a real-time decision-making and path planning unit; The emergency event detection unit is used to monitor the emergency situations on the road ahead in real time and provide clear prompts to the driver through the AR glasses; The real-time decision-making and path planning unit is used to calculate the best escape path and prompt the driver to avoid when an emergency event occurs.

[0011] Preferably, the autonomous driving and assisted driving module includes an automatic lane keeping unit and a vehicle distance control and automatic braking unit; The automatic lane keeping unit is used to monitor the lane lines through cameras and radars and automatically adjust the vehicle driving trajectory; The vehicle distance control and automatic braking unit is used to automatically control the vehicle distance when the traffic is heavy or the vehicle is driving at a low speed and automatically brake in case of an emergency.

[0012] Preferably, the driving simulation and training module includes a virtual driving environment construction unit and a driving decision-making training unit; The virtual driving environment construction unit is used to construct a virtual driving environment based on AR technology and simulate various emergency driving scenarios; The driving decision-making training unit is used to provide decision-making training based on actual road situations.

[0013] Preferably, the abnormal behavior recognition module includes a fatigue driving behavior recognition unit and a speeding and dangerous driving detection unit; The fatigue driving behavior recognition unit is used to identify whether there is a risk of fatigue driving by analyzing the driver's driving behavior; The speeding and dangerous driving detection unit is used to monitor the driving speed and behavior of the driver in real time and detect whether there is speeding or other unsafe driving behaviors.

[0014] Preferably, the road information and navigation module includes an intelligent road condition update unit, a path optimization unit, and an AR enhanced road sign unit; The intelligent road condition update unit is used to dynamically update the optimal path through real-time traffic information and give a pre-planned route; The AR enhanced road sign unit is used to enhance road signs and navigation prompts through AR technology.

[0015] Preferably, the health and emergency response module includes an emergency call and automatic navigation unit and a health condition early warning unit; The emergency call and automatic navigation unit is used to automatically call the emergency phone and provide automatic navigation to the nearest hospital or emergency service location when a traffic accident or a sudden health condition occurs; The health condition early warning unit is used to monitor the driver's health condition in real time and provide early warning and intervention suggestions.

[0016] A method for using a vehicle driving assistance system based on an AR glasses, comprising the following steps: Step 1: Wear the AR glasses correctly, ensure that the camera and sensor are in contact with the face to avoid occlusion. After starting the system, the AR glasses will automatically perform initialization checks such as environmental perception and driver status detection. Enter driver information through voice or touch input, and the system will automatically adjust vehicle settings such as the seat and rearview mirror, and load personal driving preferences; Step 2: In bad weather such as rain, snow, haze, etc., the system automatically enhances the visual image, highlights key information such as road boundaries and obstacles. Through the fusion of lidar and stereo vision, the AR glasses can display the three-dimensional positions of surrounding vehicles, pedestrians and obstacles in real time to assist in judging the safe distance; Step 3: The system monitors the blink frequency, head posture, etc. If fatigue is detected, it will remind to rest through vibration, voice or AR icons. When the driver does not look ahead for a long time or frequently looks at the mobile phone, the AR glasses will project a warning box and emit a prompt sound. When the heart rate and blood pressure are abnormal, the system recommends parking or contacting emergency services; Step 4: If the vehicle in front suddenly brakes or a pedestrian crosses the road, the AR glasses will mark the hazard source with a red flashing frame and calculate the avoidance path. In an emergency, the system will take over the steering wheel or brakes, and at the same time, the AR will display the recommended avoidance direction; Step 5: After enabling the assisted driving, the AR glasses project virtual lane lines, and the vehicle automatically fine-tunes the direction to keep centered, and emits a prompt when deviating. In a congested section, the system controls the vehicle distance and automatically starts and stops, and the AR interface displays the speed and safe distance of the vehicle in front; Step 6: When parking, extreme scenarios can be simulated through AR to train emergency responses. The system will record decision-making mistakes in actual driving, and then analyze and provide improvement suggestions through AR playback; Step 7: If behaviors such as frequent lane changes and speeding are detected, the AR glasses will forcibly reduce the speed and recommend pulling over. If the driver operates the central control screen for a long time, the system will lock non-essential functions until the line of sight returns to the front; Step 8: At intersections, AR arrows are directly projected onto the real road surface, superimposing the real-time traffic conditions. If there is congestion ahead, the system automatically calculates a new route and compares the estimated time saved compared to the original route through AR; Step 9: If the driver suddenly feels unwell, the system automatically decelerates and stops the vehicle, dials the emergency call and sends the location. After a collision, the AR glasses initiate an emergency call, contact the rescue and display the route to the nearest hospital; Step 10: After turning off the engine, the AR glasses automatically save the driving data of this time for subsequent viewing. When connected to Wi-Fi, the system automatically downloads the latest traffic algorithms and virtual training scenarios.

[0017] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. Through sensors such as lidar and cameras, the present invention can accurately identify road obstacles, pedestrians, and vehicles, and highlight them in the AR field of view, reducing accidents caused by blind spots or distractions in the line of sight. It can monitor indicators such as the driver's blink frequency and head posture, immediately remind when fatigue or distraction is detected, and forcefully recommend parking for rest when necessary. When the driver fails to respond in time, the system can automatically brake or adjust the direction to avoid collisions.

[0018] 2. The present invention can directly project information such as navigation arrows, lane lines, and traffic signs onto the real road surface, avoiding frequent looking down at the screen, reducing distraction of attention, automatically controlling the vehicle speed and direction on highways or congested sections, alleviating driver fatigue, supporting natural interaction methods, and reducing potential safety hazards caused by manually operating the central control screen.

[0019] 3. In low visibility environments such as rain, snow, haze, etc., through infrared imaging and radar data fusion, the present invention can enhance the display of roads and obstacles, avoiding accidents caused by unclear line of sight, and can enhance the display of potential dangerous targets such as pedestrians and animals in low-light environments through AR.

[0020] 4. The present invention can simulate extreme scenarios such as flat tires, slippery road surfaces, and sudden obstacles through AR, help drivers practice emergency operations in a safe environment, record behaviors such as sudden braking and lane changes, generate driving reports and provide optimization suggestions, and help drivers develop safer driving habits.

[0021] 5. The present invention can detect indicators such as heart rate and blood pressure, automatically give warnings and recommend parking when abnormalities are found. In case of serious accidents or health crises, the system automatically contacts the emergency center and sends the accurate location, shortening the rescue time. If the driver suddenly falls ill, the vehicle can automatically navigate to the nearest hospital and provide real-time traffic condition optimization. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a module diagram of the method of the present invention; Figure 2 It is a flowchart of the method of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0023] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0024] Please refer to Figure 1, the present invention provides a technical solution: a vehicle driving assistance system based on an AR glasses, comprising an environmental perception module, a driver state monitoring module, a danger warning and avoidance module, an automatic driving and assisted driving module, a driving simulation and training module, an abnormal behavior recognition module, a road information and navigation module, and a health and emergency response module; The environmental perception module is used to solve the problem of poor visibility in extreme weather and the road perception in complex environments; the driver state monitoring module is used to solve the safety hazards of driver fatigue or distraction and the problem of driver physiological abnormalities; the danger warning and avoidance module is used to solve the warning problem of sudden traffic accidents or obstacles and the distance calculation and real-time reaction of the vehicle to the front obstacle; the automatic driving and assisted driving module is used to solve the problems of lane keeping and path optimization and the automatic intervention in dangerous situations; the driving simulation and training module is used to solve the problems of driving skill training and emergency situation training and the improvement of the driver's decision-making ability; the abnormal behavior recognition module is used to solve the problem of driver abnormal behavior recognition and detect driver fatigue or unsafe driving behavior; the road information and navigation module is used to solve the problems of dynamic path planning and real-time traffic condition update and enhance the display of road signs and traffic information; the health and emergency response module is used to solve the problems of monitoring and response to sudden health conditions of the driver and the response to emergency events and automatic navigation.

[0025] It should be noted that the overall system includes a data acquisition layer, an intelligent analysis layer, a decision execution layer, and a feedback optimization layer; the data acquisition layer is to collect environmental, vehicle, and driver data in real time through multi-modal sensors, including the environmental perception module, the driver state monitoring module, the vehicle data interface (OBD-II / CAN bus), and cloud data (V2X); the vehicle data interface (used to obtain real-time vehicle data such as vehicle speed, steering angle, acceleration, and brake status); cloud data (display real-time traffic information and provide high-precision maps); the intelligent analysis layer is used to analyze the collected data in real time through edge computing (local AI of the AR glasses) and cloud AI, including environmental perception analysis, driver state analysis, danger warning and avoidance decision-making, automatic driving assistance decision-making, abnormal driving behavior recognition, and health and emergency response decision-making; the decision execution layer includes AR visual interaction, vehicle automatic control, and cloud linkage; the feedback optimization layer includes driving behavior analysis, virtual training optimization, and system self-learning.

[0026] The environmental perception module includes a high-precision weather prediction and visual enhancement unit and a lidar and stereo vision fusion unit; the high-precision weather prediction and visual enhancement unit is used to use sensors and real-time weather data to perform real-time prediction and recognition of the driving environment through algorithms; the lidar and stereo vision fusion unit is used to accurately capture and construct a three-dimensional stereoscopic image around the road by combining lidar and stereo vision.

[0027] It should be noted that the environmental perception module includes a lidar and a stereo vision camera (used to build a high-precision 3D road model and identify vehicles, pedestrians, and obstacles), a millimeter-wave radar (used to detect distant dynamic targets), an infrared camera, and a rain and fog penetration sensor (used to enhance vision in low visibility environments such as rain, snow, and haze), and a weather data interface (used to access real-time data from the meteorological bureau and predict the impact of weather changes on driving). When in use, in harsh weather conditions such as rain, snow, and haze, the system automatically enhances the visual image, highlights key information such as road boundaries and obstacles, and through the fusion of lidar and stereo vision, the AR glasses can display the three-dimensional positions of surrounding vehicles, pedestrians, and obstacles in real time to assist in judging the safe distance.

[0028] The driver status monitoring module includes a facial expression and eye movement analysis unit and a physiological signal monitoring unit; the facial expression and eye movement analysis unit is used to monitor the driver's facial expressions, eye movement trajectories, and pupil changes through the built-in camera on the AR glasses, analyze the driver's fatigue level and attention dispersion in real time, and intervene through voice or visual reminders; the physiological signal monitoring unit is used to monitor the changes in the driver's physiological signals through sensors to determine whether the driver is in a psychological state such as anxiety or excitement.

[0029] It should be noted that the driver status monitoring module includes an eye tracking camera (monitoring blink frequency and line of sight direction to judge fatigue or distraction), a facial recognition camera (detecting fatigue characteristics such as yawning and closing eyes), a heart rate / oxygen saturation sensor (used to monitor the driver's physiological state (such as sudden heart disease)), and a steering wheel / pedal pressure sensor (detecting abnormal operations). When in use, the system monitors the blink frequency, head posture, etc. If fatigue is detected, it will remind the driver to rest through vibration, voice, or AR icons. When the driver does not look ahead for a long time or frequently looks at the mobile phone, the AR glasses will project a warning box and emit a prompt sound. When the heart rate and blood pressure are abnormal, the system recommends stopping the vehicle or contacting emergency services.

[0030] The danger warning and avoidance module includes an emergency event detection unit and a real-time decision-making and path planning unit; the emergency event detection unit is used to monitor the sudden situations on the road ahead in real time and provide clear prompts to the driver through the AR glasses; the real-time decision-making and path planning unit is used to calculate the best escape path and prompt the driver to avoid when an emergency occurs.

[0031] It should be noted that when in use, calculate the collision time with the vehicle in front / obstacle. If it is lower than the safety threshold, trigger a warning; in an emergency (such as sudden braking ahead), automatically calculate the best avoidance path (changing lanes or braking). For example, when the vehicle in front brakes suddenly or a pedestrian crosses the road, the AR glasses will mark the hazard source with a red flashing frame and calculate the avoidance path. In an emergency, the system will take over the steering wheel or brakes, and at the same time, the AR will display the recommended avoidance direction.

[0032] The autonomous driving and assisted driving module includes an automatic lane keeping unit and a vehicle distance control and automatic braking unit; the automatic lane keeping unit is used to monitor lane lines through cameras and radars and automatically adjust the vehicle driving trajectory; the vehicle distance control and automatic braking unit is used to automatically control the vehicle distance during heavy traffic or low-speed driving and automatically brake in case of emergencies.

[0033] It should be noted that after the assisted driving is turned on, the AR glasses project virtual lane lines, the vehicle automatically fine-tunes the direction to keep centered, gives a prompt when deviating, in congested sections, the system controls the vehicle distance and automatically starts and stops, the AR interface displays the speed and safety distance of the vehicle ahead, identifies lane lines through cameras, fine-tunes the steering wheel to keep centered, and automatically adjusts the following distance according to the speed of the vehicle ahead.

[0034] The driving simulation and training module includes a virtual driving environment construction unit and a driving decision-making training unit; the virtual driving environment construction unit is used to construct a virtual driving environment based on AR technology and simulate various emergency driving scenarios; the driving decision-making training unit is used to provide decision-making training based on actual road situations.

[0035] It should be noted that the construction of the virtual driving environment uses a virtual reality rendering engine to generate dynamic driving scenarios, combines motion capture technology and a physics engine to simulate the driver's feedback; the driving decision-making training unit simulates different traffic situations through model-based prediction for decision-making training, and helps the driver adjust the decision-making strategy through a reinforcement learning algorithm. When parking, extreme scenarios can be simulated through AR to train emergency responses. The system will record decision-making mistakes in actual driving, and analyze and provide improvement suggestions through AR playback afterwards.

[0036] The abnormal behavior recognition module includes a fatigue driving behavior recognition unit and a speeding and dangerous driving detection unit; the fatigue driving behavior recognition unit is used to identify whether there is a risk of fatigue driving by analyzing the driver's driving behavior; the speeding and dangerous driving detection unit is used to monitor the driver's driving speed and behavior in real time and detect whether there is speeding or other unsafe driving behavior.

[0037] It should be noted that the fatigue driving behavior recognition unit analyzes the driving pattern based on data mining technology, determines whether it is an abnormal behavior, and reminds the driver to rest; the speeding and dangerous driving detection unit combines real-time GPS data and vehicle sensors, and uses a rule engine to judge whether the driver has committed speeding or dangerous driving behaviors. When in use, the system monitors the blink frequency, head posture, etc. If fatigue is detected, it will remind the driver to rest through vibration, voice or AR icons. When the driver does not look ahead for a long time or frequently looks at the mobile phone, the AR glasses will project a warning box and emit a prompt sound. When the heart rate and blood pressure are abnormal, the system recommends parking or contacting emergency services. If the vehicle in front suddenly brakes or a pedestrian crosses the road, the AR glasses will mark the hazard source with a red flashing box and calculate the avoidance path. In case of an emergency, the system will take over the steering wheel or brakes, and at the same time, the AR will display the recommended avoidance direction.

[0038] The road information and navigation module includes an intelligent road condition update unit, a path optimization unit, and an AR enhanced road sign unit; the intelligent road condition update unit is used to dynamically update the optimal path through real-time traffic information and give a pre-planned route; the AR enhanced road sign unit is used to enhance road signs and navigation prompts through AR technology.

[0039] It should be noted that the intelligent road condition update and path optimization unit uses a dynamic programming algorithm, combines real-time traffic flow data, optimizes the driving route, and provides the fastest and safest driving path. The AR enhanced road sign unit uses an object detection algorithm to identify road signs and displays them on the AR glasses in real time to increase the visibility of the prompts. At intersections, the AR arrow is directly projected onto the real road surface, superimposing the real-time road conditions. If there is congestion ahead, the system automatically calculates a new route and compares the estimated time saved compared to the original route through AR.

[0040] The health and emergency response module includes an emergency call and automatic navigation unit and a health status warning unit; the emergency call and automatic navigation unit is used to automatically dial an emergency call and provide automatic navigation to the nearest hospital or emergency service location in case of a traffic accident or sudden health condition; the health status warning unit is used to monitor the driver's health status in real time and provide early warning and intervention suggestions.

[0041] It should be noted that the emergency call and automatic navigation unit monitors abnormal situations through vehicle sensors and automatically navigates by combining GPS positioning and an emergency response algorithm; the health status warning unit uses biometric technology and machine learning to analyze health data, judge the driver's health status, and provide timely warnings. When the driver suddenly feels unwell, the system automatically decelerates and stops, dials the emergency call and sends the location. After a collision, the AR glasses initiate an emergency call, contact the rescue and display the route to the nearest hospital.

[0042] Please refer to Figure 2, A method for using a vehicle driving assistance system based on AR glasses according to any one of the above, comprising the following steps: Step 1: Wear the AR glasses correctly, ensure that the camera and sensor are in contact with the face to avoid occlusion. After starting the system, the AR glasses will automatically perform initialization checks such as environmental perception and driver status detection. Input driver information through voice or touch, and the system will automatically adjust vehicle settings such as the seat and rearview mirror, and load personal driving preferences; Step 2: In bad weather such as rain, snow, haze, etc., the system automatically enhances the visual image, highlights key information such as road boundaries and obstacles. Through the fusion of lidar and stereo vision, the AR glasses can display the three-dimensional positions of surrounding vehicles, pedestrians and obstacles in real time to assist in judging the safe distance; Step 3: The system monitors the blink frequency, head posture, etc. If fatigue is detected, it will remind the driver to rest through vibration, voice or AR icons. When the driver does not look ahead for a long time or frequently looks at the mobile phone, the AR glasses will project a warning frame and emit a prompt sound. When the heart rate and blood pressure are abnormal, the system recommends parking or contacting emergency services; Step 4: If the vehicle in front suddenly brakes or a pedestrian crosses the road, the AR glasses will mark the hazard source with a red flashing frame and calculate the avoidance path. In an emergency, the system will take over the steering wheel or brakes, and at the same time, the AR will display the recommended avoidance direction; Step 5: After enabling the assisted driving, the AR glasses project virtual lane lines, and the vehicle automatically fine-tunes the direction to keep centered. When deviating, a prompt will be issued. In a congested section, the system controls the vehicle distance and automatically starts and stops, and the AR interface displays the speed of the vehicle in front and the safe distance; Step 6: When parking, extreme scenarios can be simulated through AR to train emergency responses. The system will record decision-making mistakes in actual driving, and then analyze and provide improvement suggestions through AR playback; Step 7: If behaviors such as frequent lane changes and speeding are detected, the AR glasses will forcibly reduce the vehicle speed and recommend pulling over. If the driver operates the central control screen for a long time, the system will lock non-essential functions until the line of sight returns to the front; Step 8: At intersections, AR arrows are directly projected onto the real road surface, superimposing real-time traffic conditions. If there is congestion ahead, the system automatically calculates a new route and compares the estimated time saved compared to the original route through AR; Step 9: If the driver suddenly feels unwell, the system automatically decelerates and stops the vehicle, dials the emergency call and sends the location. After a collision, the AR glasses activate the emergency call, contact the rescue and display the route to the nearest hospital; Step 10: After turning off the engine, the AR glasses automatically save the driving data of this time for subsequent viewing. When connected to Wi-Fi, the system automatically downloads the latest traffic algorithms and virtual training scenarios.

[0043] In summary, the present invention comprehensively improves driving safety, comfort, emergency response capabilities, and health protection through intelligent perception, real-time warning, automatic intervention, AR interaction, and health monitoring, and is applicable to various scenarios such as daily commuting, long-distance driving, and special weather conditions.

[0044] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A vehicle driving assistance system based on AR glasses, characterized in that, It includes an environmental perception module, a driver state monitoring module, a danger warning and avoidance module, an autonomous driving and assisted driving module, a driving simulation and training module, an abnormal behavior recognition module, a road information and navigation module, and a health and emergency response module; The environmental perception module is used to solve the problem of poor visibility in extreme weather and perceive the road in complex environments; The driver state monitoring module is used to solve the safety hazards of driver fatigue or distraction and the problem of driver physiological abnormalities; The danger warning and avoidance module is used to solve the warning problem of sudden traffic accidents or obstacles and calculate the distance between the vehicle and the front obstacle and react in real time; The autonomous driving and assisted driving module is used to solve the problems of lane keeping and path optimization and automatically intervene in dangerous situations; The driving simulation and training module is used to solve the problems of driving skill training and emergency situation training and improve the driver's decision-making ability; The abnormal behavior recognition module is used to solve the problem of recognizing abnormal driver behavior and detect driver fatigue or unsafe driving behavior; The road information and navigation module is used to solve the problems of dynamic path planning and real-time road condition update and enhance road signs and traffic information display; The health and emergency response module is used to solve the problems of monitoring and responding to sudden health conditions of drivers and responding to emergencies and automatic navigation.

2. The vehicle driving assistance system based on an AR glasses according to claim 1, wherein, The environmental perception module includes a high-precision weather prediction and visual enhancement unit and a lidar and stereo vision fusion unit; The high-precision weather prediction and visual enhancement unit is used to use sensors and real-time weather data to perform real-time prediction and recognition of the driving environment through algorithms; The lidar and stereo vision fusion unit is used to accurately capture and construct a three-dimensional stereoscopic image around the road by combining lidar and stereo vision.

3. A vehicle driving assistance system based on an AR glasses according to claim 1, characterized in that, The driver state monitoring module includes a facial expression and eye movement analysis unit and a physiological signal monitoring unit; The facial expression and eye movement analysis unit is used to monitor the driver's facial expression, eye movement trajectory and pupil changes through the built-in camera on the AR glasses, analyze the driver's fatigue level and distraction in real time, and intervene through voice or visual reminders; The physiological signal monitoring unit is used to monitor the changes in the driver's physiological signals through sensors to judge whether the driver has psychological states such as anxiety and excitement.

4. A vehicle driving assistance system based on an AR glasses according to claim 1, wherein, The danger warning and avoidance module includes an emergency event detection unit and a real-time decision-making and path planning unit; The emergency event detection unit is used to monitor the sudden situation on the road ahead in real time and provide clear prompts to the driver through the AR glasses; The real-time decision-making and path planning unit is used to calculate the best escape path and prompt the driver to avoid it when an emergency occurs.

5. A vehicle driving assistance system based on an AR glasses according to claim 1, wherein, The autonomous driving and assisted driving module includes an automatic lane keeping unit and a vehicle distance control and automatic braking unit; The automatic lane keeping unit is used to monitor the lane lines through cameras and radars and automatically adjust the vehicle driving trajectory; The vehicle distance control and automatic braking unit is used to automatically control the vehicle distance during heavy traffic or low-speed driving and automatically brake in case of emergency.

6. A vehicle driving assistance system based on an AR glasses according to claim 1, characterized in that, The driving simulation and training module includes a virtual driving environment construction unit and a driving decision-making training unit; The virtual driving environment construction unit is used to construct a virtual driving environment based on AR technology and simulate various emergency driving scenarios; The driving decision-making training unit is used to provide decision-making training based on actual road situations.

7. The vehicle driving assistance system based on an AR glasses according to claim 1, wherein, The abnormal behavior recognition module includes a fatigue driving behavior recognition unit and a speeding and dangerous driving detection unit; The fatigue driving behavior recognition unit is used to identify whether there is a risk of fatigue driving by analyzing the driver's driving behavior; The speeding and dangerous driving detection unit is used to monitor the driver's driving speed and behavior in real time and detect whether there is speeding or other unsafe driving behaviors.

8. A vehicle driving assistance system based on an AR glasses according to claim 1, characterized in that, The road information and navigation module includes an intelligent road condition update unit, a path optimization unit, and an AR enhanced road sign unit; The intelligent road condition update unit is used to dynamically update the optimal path through real-time traffic information and give a pre-planned route; The AR enhanced road sign unit is used to enhance road signs and navigation prompts through AR technology.

9. A vehicle driving assistance system based on an AR glasses according to claim 1, characterized in that, The health and emergency response module includes an emergency call and automatic navigation unit and a health condition warning unit; The emergency call and automatic navigation unit is used to automatically dial an emergency call and provide automatic navigation to the nearest hospital or emergency service location in case of a traffic accident or sudden health condition; The health condition warning unit is used to monitor the driver's health condition in real time and provide early warning and intervention suggestions.

10. The usage method of a vehicle driving assistance system based on an AR glasses according to any one of claims 1-9, characterized in that, It includes the following steps: Step 1: Wear the AR glasses correctly, ensure that the camera, sensor are in contact with the face and avoid occlusion. After starting the system, the AR glasses will automatically perform initialization checks such as environmental perception and driver status detection. Enter the driver information through voice or touch input, and the system will automatically adjust vehicle settings such as the seat and rearview mirror and load personal driving preferences; Step 2: In bad weather such as rain, snow, haze, etc., the system automatically enhances the visual image, highlights key information such as road boundaries and obstacles. Through the fusion of lidar and stereo vision, the AR glasses can display the three-dimensional positions of surrounding vehicles, pedestrians and obstacles in real time to assist in judging the safety distance; Step 3: The system monitors the blink frequency, head posture, etc. If fatigue is detected, it will remind the driver to rest through vibration, voice or AR icons. When the driver does not look ahead for a long time or frequently looks at the mobile phone, the AR glasses will project a warning box and emit a prompt sound. When the heart rate and blood pressure are abnormal, the system recommends parking or contacting emergency services; Step 4: If the vehicle in front suddenly brakes or a pedestrian crosses the road, the AR glasses will mark the hazard source with a red flashing box and calculate the avoidance path. In an emergency, the system will take over the steering wheel or brakes, and at the same time the AR displays the recommended avoidance direction; Step 5: After enabling the assisted driving, the AR glasses project virtual lane lines, and the vehicle automatically fine-tunes the direction to keep centered, and emits a prompt when deviating. In a congested section, the system controls the vehicle distance and automatically starts and stops, and the AR interface displays the speed of the vehicle in front and the safety distance; Step 6: When parking, AR can simulate extreme scenarios to train emergency responses. The system will record decision-making mistakes in actual driving and, after the event, analyze them through AR playback and provide improvement suggestions; Step 7: If behaviors such as frequent lane changes and speeding are detected, the AR glasses will force the vehicle to slow down and suggest pulling over. If the driver operates the central control screen for a long time, the system will lock non-essential functions until the line of sight returns to the front; Step 8: At intersections, AR arrows are directly projected onto the real road surface, superimposing real-time traffic conditions. If there is congestion ahead, the system automatically calculates a new route and compares the estimated time saved compared to the original route through AR; Step 9: If the driver suddenly feels unwell, the system automatically decelerates and stops the vehicle, dials the emergency call and sends the location. After a collision, the AR glasses initiate an emergency call, contact the rescue and display the route to the nearest hospital; Step 10: After the vehicle is turned off, the AR glasses automatically save the driving data for this time for subsequent viewing. When connected to Wi-Fi, the system automatically downloads the latest traffic algorithms and virtual training scenarios.

Images