Vehicle-mounted auxiliary driving projection system

Abstract

The invention discloses a vehicle-mounted auxiliary driving projection system, and relates to the technical field of vehicle-mounted navigation and auxiliary driving, and the system comprises a sensor system module which is used for capturing the data of the surrounding environment of a vehicle in real time through a sensor; the central control processor module is used for receiving the data transmitted by the sensor system module, interacting with a navigation system and an entertainment system, integrating and processing the data and generating original image and video data; the original image and video data comprises a driving state, a navigation indication and entertainment information; the AR image processing module is used for receiving the original image and video data output by the central control processor module and performing distortion correction processing on the data by using an AR technology; and finally, projecting the three-dimensional holographic image onto the windshield glass through the holographic projection module. The problems of sight transfer risk and information display limitation existing when a traditional instrument panel and a central control display screen provide information are solved, and the driving safety and the passenger experience are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle-mounted navigation and assisted driving, and in particular to a vehicle-mounted assisted driving projection system. Background Art

[0002] With the development of intelligent and connected vehicles, the information that vehicles need to convey to drivers is becoming increasingly complex and diverse, including but not limited to navigation instructions, driving status, assisted driving warnings, etc. However, traditional instrument panels and central control displays often require drivers to divert their sight when providing this information, increasing driving risks. In addition, although existing HUD (head-up display)-based technologies can reduce sight diversion to a certain extent, they usually only provide limited two-dimensional information display, lacking immersion and intuitiveness.

[0003] Specifically, the prior art has the following defects: 1. Risk of sight diversion: Traditional instrument panels and central control displays are located to the side or below the driver's sight. When the driver needs to view this information, he has to divert his sight and temporarily leave the road ahead. This frequent sight diversion not only distracts the driver's attention, but also increases driving risks. Studies have shown that if the driver's sight is away from the road ahead for more than 2 seconds, the possibility of an accident will increase sharply, seriously threatening road traffic safety.

[0004] 2. Limitations of information display: Although existing HUD (head-up display)-based technologies can reduce the driver's line of sight to a certain extent, they usually only provide limited two-dimensional information display. This two-dimensional display method lacks immersion and intuitiveness, and it is difficult to fully display complex and changing driving information and navigation instructions, which limits the driver's comprehensive understanding and rapid response to the information.

[0005] 3. Insufficient interactive experience: The driver needs to perform complex operations to obtain the required information or set up functions, which not only reduces the usability of the system, but may also affect the driver's driving experience and satisfaction.

[0006] In summary, the existing technology has many defects and deficiencies in automobile information display and interaction, and cannot meet the needs of modern vehicle intelligence and networking development. Therefore, the present invention aims to innovatively propose an in-vehicle assisted driving projection system by combining AR technology with holographic projection technology to solve the above problems and improve driving safety and passenger experience. Summary of the invention

[0007] In view of the problems such as the risk of line of sight diversion, information display limitations and insufficient interactive experience, the present invention provides a vehicle-mounted assisted driving projection system. By integrating sensors, deep learning, AR technology and holographic projection, a vehicle-mounted assisted driving projection system is designed to capture environmental data in real time, intelligently adjust the projection image, realize the intuitive display and interaction of navigation and entertainment information, and improve driving safety and experience.

[0008] In order to achieve the above object, the present invention is implemented through the following technical solutions: a vehicle-mounted assisted driving projection system, comprising: Sensor system module: used to capture data about the vehicle's surroundings in real time through sensors, including vehicle spatial positioning information, road conditions, obstacle locations, traffic signs, and the driver's line of sight and gestures; Central control processor module: used to receive data transmitted by the sensor system module, interact with the navigation system and entertainment system, integrate and process the data, and generate original image and video data; the original image and video data include driving status, navigation instructions, and entertainment information; AR image processing module: used to receive the original image and video data output by the central control processor module, and use AR technology to perform distortion correction on these data; Holographic projection module: used to receive the image and video data after the distortion correction processing in the AR image processing module, convert the image and video data after the distortion correction processing into a three-dimensional holographic image through a laser transmitter and an optical lens group, and project the three-dimensional holographic image onto the windshield; Intelligent recognition and interaction module: used to intelligently adjust and directly manipulate the three-dimensional holographic image projected onto the windshield by the holographic projection module.

[0009] Specifically, the intelligent identification and interaction module includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path and switching entertainment information.

[0010] Specifically, the AR image processing module uses AR technology to perform distortion correction processing on these data, and the specific steps include: Step 31, annotating the data of the vehicle surrounding environment captured in real time by the sensor in the sensor system module, including the distortion area and the distortion type; Step 32: input the labeled data into the deep learning model for training, and generate a GAN adversarial network for distortion correction. During the training process, the parameters of the model are continuously adjusted to minimize the loss function, improve the correction accuracy of the model, and generate a trained deep learning model. Step 33: Use the test data set to evaluate the trained deep learning model, and optimize the trained deep learning model according to the evaluation results; Step 34: Integrate the optimized deep learning model into the AR image processing module, and adjust the image element position according to the vehicle spatial positioning information in the vehicle surrounding environment data; Specifically, the holographic projection module includes: An adaptive brightness and contrast adjustment unit, which is used to monitor the light conditions inside and outside the vehicle in real time through the ambient light sensor in the sensor, and automatically adjust the brightness and contrast of the projected image according to the changes in light intensity and contrast; Dynamic viewing angle optimization unit, which is used to adjust the viewing angle and position of the projected image in real time based on the driver's line of sight and gestures captured by the sensor system module. When the driver's line of sight or head moves, the projected image will follow and adjust accordingly to maintain the best alignment with the driver's line of sight; A multi-layer image superposition and interaction unit, which is used to simultaneously project multi-layer images on the windshield, wherein the multi-layer images include driving status, navigation instructions, and entertainment information, and the driver switches or superimposes between the multi-layer images through gestures or voice commands; An intelligent obstacle avoidance unit, which is used to automatically adjust the position and size of the projected image in combination with the obstacle position information captured by the sensor system module when projecting an image; Personalization and memory function unit: used for the driver to customize according to personal preferences and driving habits. The customization includes adjusting the color, transparency, and shape of the image. The memory function unit is used to remember the driver's preference settings and automatically load them the next time they are used.

[0011] Specifically, the intelligent identification and interaction module includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path, switching entertainment information and zooming windows.

[0012] Specifically, the specific steps for implementing intelligent adjustment in the eye tracking technology unit are: Step 1: Identify the direction of sight: Step 11, data preprocessing: The eye image data is captured in real time by an eye tracking sensor, and the eye image data is preprocessed. The preprocessing steps are: applying a denoising algorithm to reduce noise in the image; using adaptive histogram equalization to enhance the contrast of the image, and normalizing the image pixel values ​​to a specific range.

[0013] Step 12, feature extraction: using Haar features, HOG features or deep learning models to detect key feature points of the eyeball, the key feature points include pupil center and eye corners; using feature point matching algorithms or deep learning models to track changes in feature points in consecutive frames, thereby calculating the rotation angle and position change of the eyeball; Step 13, line of sight direction calculation: based on the rotation angle and position change of the eyeball, a geometric model is constructed to calculate the line of sight direction; Step 14: Relationship between sight line and projection image: Represent the sight line direction as a vector in three-dimensional space, and calculate the angle or offset between the vector and the center vector of the projection image; Step 2: Image adjustment strategy: Step 21, adjusting the position of the projected image: based on the size of the angle or the offset, judging whether the position of the projected image needs to be adjusted according to a preset threshold value, when the angle or the offset exceeds the threshold value, triggering the position adjustment mechanism, calculating the position adjustment information according to the size and direction of the angle or the offset, the position adjustment information includes the distance and direction that the projected image needs to move, and through the preset safety area and road information detection algorithm, the moved image is still within the driver's field of vision and does not block important road information; The calculated position adjustment information is converted into a specific control instruction, and the control instruction is sent to the holographic projection module, and the holographic projection module adjusts the position of the projection image according to the instruction; Step 22: Adjust the content of the projected image: Step 222, content adjustment judgment, the content adjustment judgment includes: using a deep learning model to analyze the driver's sight dwell time and eye movement pattern to determine whether he is interested in or not interested in the content of the projected image; using the sensor in the sensor system module to capture data about the vehicle's surrounding environment in real time to determine whether the content of the projected image needs to be adjusted; Step 223: formulating a content adjustment strategy based on the judgment result, wherein the content adjustment strategy includes updating the navigation route, displaying more detailed road information, highlighting important prompts, and using an AI recommendation algorithm to provide personalized entertainment information and services based on the driver's preferences and interests; Step 224: convert the content adjustment strategy into a specific control instruction. The control instruction is first processed by the central control processor module and then sent to the AR image processing module. The AR image processing module adjusts the content of the projection image according to the control instruction and sends it to the holographic projection module for display. Specifically, the specific steps of implementing direct control of holographic projection content in the gesture recognition and control unit are: Step 71: Using a high-resolution camera installed in the sensor system module to capture the driver's gestures; the gestures include sliding, clicking, and pinching; Step 72: The central control processor module runs a gesture recognition algorithm to process and analyze the received gestures, and converts the gestures into corresponding control instructions according to the processing and analysis results; Step 73: The control instruction is transmitted to the AR image processing module and the holographic projection module through the internal communication protocol to realize direct control of the holographic projection content: When the driver makes a sliding gesture, the system recognizes and generates control instructions to adjust the navigation path; when the driver makes a clicking gesture, the system switches the entertainment information; when the driver makes a pinching gesture, the system zooms the window.

[0014] Specifically, the gesture recognition includes: Swipe gestures: Recognize continuous movement of a finger across the screen or in space to adjust navigation paths, scroll lists, or zoom in and out on a map.

[0015] Click gestures: Recognize quick taps of fingers to select, confirm or switch information, including switching entertainment information and selecting menu items; Pinch gesture: Recognizes the action of two or more fingers moving toward the center at the same time to reduce the window.

[0016] Data collection and preliminary processing: 1. By projecting key information such as navigation instructions, driving status, and entertainment information onto the windshield in the form of three-dimensional holographic images, the driver can obtain the required information without frequently shifting his or her gaze, greatly reducing the time the driver's gaze is away from the road ahead, reducing the risk of gaze shifting, and thus reducing driving risks. Using AR technology and holographic projection technology, the present invention can capture environmental data in real time and intelligently adjust the projected image to achieve intuitive display of complex and ever-changing information. Three-dimensional holographic images not only provide a richer visual experience, but also enhance the immersion and intuitiveness of information, helping drivers understand and respond to information more quickly.

[0017] 2. The present invention realizes intelligent adjustment and direct control of holographic projection content through eye tracking technology unit and gesture recognition and control unit. The driver can adjust the projection position, content and perform other function settings through simple line of sight movement and gesture movements, which greatly improves the usability of the system and driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them: Figure 1 It is a schematic diagram of the modular structure of the system of the present invention; Figure 2 The figure is a schematic diagram of the process of using AR technology to correct distortion of data in the present invention. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field belong to the scope of protection of the present invention.

[0020] like Figure 1 and Figure 2 As shown in FIG. 1 , an embodiment of the present invention is provided, which provides an audio optimization system for in-car screen projection, including: Sensor system module: used to capture data about the vehicle's surroundings in real time through sensors, including vehicle spatial positioning information, road conditions, obstacle locations, traffic signs, and the driver's line of sight and gestures; Central control processor module: used to receive data transmitted by the sensor system module, interact with the navigation system and entertainment system, integrate and process the data, and generate original image and video data; the original image and video data include driving status, navigation instructions, and entertainment information; AR image processing module: used to receive the original image and video data output by the central control processor module, and use AR technology to perform distortion correction on these data; Holographic projection module: used to receive the image and video data after the distortion correction processing in the AR image processing module, convert the image and video data after the distortion correction processing into a three-dimensional holographic image through a laser transmitter and an optical lens group, and project the three-dimensional holographic image onto the windshield; Intelligent recognition and interaction module: used to intelligently adjust and directly manipulate the three-dimensional holographic image projected onto the windshield by the holographic projection module.

[0021] In this embodiment, the intelligent identification and interaction module further includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path and switching entertainment information.

[0022] In this embodiment, the AR image processing module uses AR technology to perform distortion correction processing on these data, and the specific steps include: Step 31, annotating the data of the vehicle surrounding environment captured in real time by the sensor in the sensor system module, including the distortion area and the distortion type; Step 32: input the labeled data into the deep learning model for training, and generate a GAN adversarial network for distortion correction. During the training process, the parameters of the model are continuously adjusted to minimize the loss function, improve the correction accuracy of the model, and generate a trained deep learning model. Step 33: Use the test data set to evaluate the trained deep learning model, and optimize the trained deep learning model according to the evaluation results; Step 34: Integrate the optimized deep learning model into the AR image processing module, and adjust the image element position according to the vehicle spatial positioning information in the vehicle surrounding environment data; In this embodiment, the holographic projection module further comprises: An adaptive brightness and contrast adjustment unit, which is used to monitor the light conditions inside and outside the vehicle in real time through the ambient light sensor in the sensor, and automatically adjust the brightness and contrast of the projected image according to the changes in light intensity and contrast; Dynamic viewing angle optimization unit, which is used to adjust the viewing angle and position of the projected image in real time based on the driver's line of sight and gestures captured by the sensor system module. When the driver's line of sight or head moves, the projected image will follow and adjust accordingly to maintain the best alignment with the driver's line of sight; A multi-layer image superposition and interaction unit, which is used to simultaneously project multi-layer images on the windshield, wherein the multi-layer images include driving status, navigation instructions, and entertainment information, and the driver switches or superimposes between the multi-layer images through gestures or voice commands; An intelligent obstacle avoidance unit, which is used to automatically adjust the position and size of the projected image in combination with the obstacle position information captured by the sensor system module when projecting an image; Personalization and memory function unit: used for the driver to customize according to personal preferences and driving habits. The customization includes adjusting the color, transparency, and shape of the image. The memory function unit is used to remember the driver's preference settings and automatically load them the next time they are used.

[0023] In this embodiment, the intelligent identification and interaction module further includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path, switching entertainment information and zooming windows.

[0024] In this embodiment, the specific steps of implementing intelligent adjustment in the eye tracking technology unit are as follows: Step 1: Identify the direction of sight: Step 11, data preprocessing: The eye image data is captured in real time by an eye tracking sensor, and the eye image data is preprocessed. The preprocessing steps are: applying a denoising algorithm to reduce noise in the image; using adaptive histogram equalization to enhance the contrast of the image, and normalizing the image pixel values ​​to a specific range.

[0025] Step 12, feature extraction: using Haar features, HOG features or deep learning models to detect key feature points of the eyeball, the key feature points include pupil center and eye corners; using feature point matching algorithms or deep learning models to track changes in feature points in consecutive frames, thereby calculating the rotation angle and position change of the eyeball; Step 13, line of sight direction calculation: based on the rotation angle and position change of the eyeball, a geometric model is constructed to calculate the line of sight direction; Step 14: Relationship between sight line and projection image: Represent the sight line direction as a vector in three-dimensional space, and calculate the angle or offset between the vector and the center vector of the projection image; Step 2: Image adjustment strategy: Step 21, adjusting the position of the projected image: based on the size of the angle or the offset, judging whether the position of the projected image needs to be adjusted according to a preset threshold value, when the angle or the offset exceeds the threshold value, triggering the position adjustment mechanism, calculating the position adjustment information according to the size and direction of the angle or the offset, the position adjustment information includes the distance and direction that the projected image needs to move, and through the preset safety area and road information detection algorithm, the moved image is still within the driver's field of vision and does not block important road information; The calculated position adjustment information is converted into a specific control instruction, and the control instruction is sent to the holographic projection module, and the holographic projection module adjusts the position of the projection image according to the instruction; Step 22: Adjust the content of the projected image: Step 222, content adjustment judgment, the content adjustment judgment includes: using a deep learning model to analyze the driver's sight dwell time and eye movement pattern to determine whether he is interested in or not interested in the content of the projected image; using the sensor in the sensor system module to capture data about the vehicle's surrounding environment in real time to determine whether the content of the projected image needs to be adjusted; Step 223: formulating a content adjustment strategy based on the judgment result, wherein the content adjustment strategy includes updating the navigation route, displaying more detailed road information, highlighting important prompts, and using an AI recommendation algorithm to provide personalized entertainment information and services based on the driver's preferences and interests; Step 224: convert the content adjustment strategy into a specific control instruction. The control instruction is first processed by the central control processor module and then sent to the AR image processing module. The AR image processing module adjusts the content of the projection image according to the control instruction and sends it to the holographic projection module for display. In this embodiment, the specific steps of implementing direct control of holographic projection content in the gesture recognition and control unit are as follows: Step 71: Using a high-resolution camera installed in the sensor system module to capture the driver's gestures; the gestures include sliding, clicking, and pinching; Step 72: The central control processor module runs a gesture recognition algorithm to process and analyze the received gestures, and converts the gestures into corresponding control instructions according to the processing and analysis results; Step 73: The control instruction is transmitted to the AR image processing module and the holographic projection module through the internal communication protocol to realize direct control of the holographic projection content: When the driver makes a sliding gesture, the system recognizes and generates control instructions to adjust the navigation path; when the driver makes a clicking gesture, the system switches the entertainment information; when the driver makes a pinching gesture, the system zooms the window.

[0026] In this embodiment, the gesture recognition further includes: Swipe gestures: Recognize continuous movement of a finger across the screen or in space to adjust navigation paths, scroll lists, or zoom in and out on a map.

[0027] Click gestures: Recognize quick taps of fingers to select, confirm or switch information, including switching entertainment information and selecting menu items; Pinch gesture: Recognizes the action of two or more fingers moving toward the center at the same time to reduce the window.

[0028] When the driver makes a sliding gesture, the system generates a control instruction to adjust the navigation path according to the sliding direction and speed. For example, horizontal sliding can mean moving left and right on the map, and vertical sliding can mean zooming in and out of the map or adjusting the distance of the navigation path. When the driver makes a tapping gesture, the system generates a control instruction to switch entertainment information according to the tapping position. For example, tapping the music icon on the screen can switch to the music playback interface, and tapping the movie icon can switch to the movie playlist. When the driver makes a pinch gesture, the system recognizes the action and generates control instructions to shrink the window, including shrinking a specific window in the holographic projection, reducing the size or ratio of the displayed content, and in some cases closing windows that are no longer needed.

[0029] The central control processor module, AR image processing module, and holographic projection module use efficient internal communication protocols for data transmission, including custom binary protocols, TCP / IP-based network protocols, or dedicated data bus protocols.

[0030] Instruction execution: After receiving the control instruction, the AR image processing module renders and adjusts the holographic projection image in real time. For example, it adjusts the image size and position according to the instruction to shrink the window. The holographic projection module adjusts the projection content according to the control instruction to ensure that the holographic image is consistent with the driver's gesture operation.

[0031] User feedback and interaction optimization: The system can provide visual or auditory feedback to confirm the results of gesture recognition and the execution of control instructions. By recording the user's gesture usage habits and feedback, the system can continuously optimize the gesture recognition algorithm and control logic to improve the user experience.

[0032] In summary, the in-vehicle assisted driving projection system of the present invention not only solves the risk of line of sight diversion and information display limitations of traditional instrument panels and central control displays when providing information, but also improves driving safety and passenger experience by combining AR technology with holographic projection technology. The intelligent, personalized and adaptive characteristics of the system enable it to better meet the needs of the development of modern vehicle intelligence and networking.

[0033] After the system is started, each module is initialized and a communication connection is established to ensure smooth data transmission.

[0034] The sensor system module continuously collects environmental data, and the central control processor module integrates and processes these data to generate original image and video data; the AR image processing module performs distortion correction and spatial positioning adjustment on the original image data to generate optimized image data; the holographic projection module receives the optimized image data, converts it into a three-dimensional holographic image, and projects it onto the windshield; the eye tracking technology tracks the driver's line of sight in real time, adjusts the projection position and content; the gesture recognition and control technology recognizes the driver's gestures and realizes the control of the holographic projection content. Through the above module association and workflow, the modules of this system can work together efficiently to realize the holographic intelligent windshield display function, improve driving safety and passenger experience.

[0035] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0036] Any process or method description in the flow chart or otherwise described herein can be understood to represent a module, fragment or portion of a code including one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiment of the present application includes other implementations, in which the functions may not be performed in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved.

[0037] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A vehicle-mounted assisted driving projection system, characterized in that: The system comprises: Sensor system module: used to capture data about the vehicle's surroundings in real time through sensors, including vehicle spatial positioning information, road conditions, obstacle locations, traffic signs, and the driver's line of sight and gestures; Central control processor module: used to receive data transmitted by the sensor system module, interact with the navigation system and entertainment system, integrate and process the data, and generate original image and video data; the original image and video data include driving status, navigation instructions, and entertainment information; AR image processing module: used to receive the original image and video data output by the central control processor module, and use AR technology to perform distortion correction on these data; Holographic projection module: used to receive the image and video data after the distortion correction processing in the AR image processing module, convert the image and video data after the distortion correction processing into a three-dimensional holographic image through a laser transmitter and an optical lens group, and project the three-dimensional holographic image onto the windshield; Intelligent recognition and interaction module: used to intelligently adjust and directly manipulate the three-dimensional holographic image projected onto the windshield by the holographic projection module.

2. The vehicle-mounted assisted driving projection system according to claim 1, characterized in that: The intelligent recognition and interaction module includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path and switching entertainment information.

3. The vehicle-mounted assisted driving projection system according to claim 2, characterized in that: The AR image processing module uses AR technology to perform distortion correction processing on these data, and the specific steps include: Step 31, annotating the data of the vehicle surrounding environment captured in real time by the sensor in the sensor system module, including the distortion area and the distortion type; Step 32: input the labeled data into the deep learning model for training, and generate a GAN adversarial network for distortion correction. During the training process, the parameters of the model are continuously adjusted to minimize the loss function, improve the correction accuracy of the model, and generate a trained deep learning model. Step 33: Use the test data set to evaluate the trained deep learning model, and optimize the trained deep learning model according to the evaluation results; Step 34: Integrate the optimized deep learning model into the AR image processing module, and adjust the image element position according to the vehicle spatial positioning information in the vehicle surrounding environment data.

4. The vehicle-mounted assisted driving projection system according to claim 3, characterized in that: The holographic projection module comprises: An adaptive brightness and contrast adjustment unit, which is used to monitor the light conditions inside and outside the vehicle in real time through the ambient light sensor in the sensor, and automatically adjust the brightness and contrast of the projected image according to the changes in light intensity and contrast; Dynamic viewing angle optimization unit, which is used to adjust the viewing angle and position of the projected image in real time based on the driver's line of sight and gestures captured by the sensor system module. When the driver's line of sight or head moves, the projected image will follow and adjust accordingly to maintain the best alignment with the driver's line of sight; A multi-layer image superposition and interaction unit, which is used to simultaneously project multi-layer images on the windshield, wherein the multi-layer images include driving status, navigation instructions, and entertainment information, and the driver switches or superimposes between the multi-layer images through gestures or voice commands; An intelligent obstacle avoidance unit, which is used to automatically adjust the position and size of the projected image in combination with the obstacle position information captured by the sensor system module when projecting an image; Personalization and memory function unit: used for the driver to customize according to personal preferences and driving habits. The customization includes adjusting the color, transparency, and shape of the image. The memory function unit is used to remember the driver's preference settings and automatically load them the next time they are used.

5. The vehicle-mounted assisted driving projection system according to claim 4, characterized in that: The intelligent recognition and interaction module includes: An eye tracking technology unit, which is used to track the driver's line of sight in real time through an eye tracking sensor integrated in the sensor system module, and feed back to the central control processor module and the holographic projection module to achieve intelligent adjustment, including adjustment of projection position and content; The gesture recognition and control unit is used to recognize the driver's gesture movements through computer vision technology and the camera in the sensor system module, and convert the gesture movements into control instructions. The control instructions are transmitted to the AR image processing module and the holographic projection module through the central control processor module to realize direct control of the holographic projection content, and the direct control includes adjusting the navigation path, switching entertainment information and zooming windows.

6. The vehicle-mounted assisted driving projection system according to claim 5, characterized in that: The specific steps for implementing intelligent adjustment in the eye tracking technology unit are: Step 1: Identify the direction of sight: Step 11, data preprocessing: capturing eyeball image data in real time through an eyeball tracking sensor, and preprocessing the eyeball image data, wherein the preprocessing step is: applying a denoising algorithm to reduce noise in the image; Use adaptive histogram equalization to enhance the contrast of the image and normalize the image pixel values ​​to a specific range; Step 12, feature extraction: using Haar features, HOG features or deep learning models to detect key feature points of the eyeball, the key feature points include pupil center and eye corners; using feature point matching algorithms or deep learning models to track changes in feature points in consecutive frames, thereby calculating the rotation angle and position change of the eyeball; Step 13, line of sight direction calculation: based on the rotation angle and position change of the eyeball, a geometric model is constructed to calculate the line of sight direction; Step 14: Relationship between sight line and projection image: Represent the sight line direction as a vector in three-dimensional space, and calculate the angle or offset between the vector and the center vector of the projection image; Step 2: Image adjustment strategy: Step 21, adjusting the position of the projected image: based on the size of the angle or the offset, judging whether the position of the projected image needs to be adjusted according to a preset threshold value, when the angle or the offset exceeds the threshold value, triggering the position adjustment mechanism, calculating the position adjustment information according to the size and direction of the angle or the offset, the position adjustment information includes the distance and direction that the projected image needs to move, and through the preset safety area and road information detection algorithm, the moved image is still within the driver's field of vision and does not block important road information; The calculated position adjustment information is converted into a specific control instruction, and the control instruction is sent to the holographic projection module, and the holographic projection module adjusts the position of the projection image according to the instruction; Step 22: Adjust the content of the projected image: Step 222, content adjustment judgment, the content adjustment judgment includes: using a deep learning model to analyze the driver's sight dwell time and eye movement pattern to determine whether he is interested in or not interested in the content of the projected image; using the sensor in the sensor system module to capture data about the vehicle's surrounding environment in real time to determine whether the content of the projected image needs to be adjusted; Step 223: formulating a content adjustment strategy based on the judgment result, wherein the content adjustment strategy includes updating the navigation route, displaying more detailed road information, highlighting important prompts, and using an AI recommendation algorithm to provide personalized entertainment information and services based on the driver's preferences and interests; Step 224: convert the content adjustment strategy into a specific control instruction. The control instruction is first processed by the central control processor module and then sent to the AR image processing module. The AR image processing module adjusts the content of the projection image according to the control instruction and sends it to the holographic projection module for display.

7. The vehicle-mounted assisted driving projection system according to claim 6, characterized in that: The specific steps of implementing direct control of holographic projection content in the gesture recognition and control unit are as follows: Step 71: Using a high-resolution camera installed in the sensor system module to capture the driver's gestures; the gestures include sliding, clicking, and pinching; Step 72: The central control processor module runs a gesture recognition algorithm to process and analyze the received gestures, and converts the gestures into corresponding control instructions according to the processing and analysis results; Step 73: The control instruction is transmitted to the AR image processing module and the holographic projection module through the internal communication protocol to realize direct control of the holographic projection content: When the driver makes a sliding gesture, the system recognizes and generates control instructions to adjust the navigation path; when the driver makes a tap gesture, the system switches entertainment information; When the driver performs a pinch gesture, the system scales the window.

8. The vehicle-mounted assisted driving projection system according to claim 7, characterized in that: The gesture recognition includes: Slide gestures: Recognize the continuous movement of a finger on the screen or in space to adjust the navigation path, scroll a list, or zoom in and out a map; Click gestures: Recognize quick taps of fingers to select, confirm or switch information, including switching entertainment information and selecting menu items; Pinch gesture: Recognizes the action of two or more fingers moving toward the center at the same time to reduce the window.

Images