Double-screen air projection method and system and automobile display device

Abstract

The invention relates to the technical field of automobile projection display, in particular to a double-screen air projection method and system and an automobile display device. The method comprises the steps that a first image light beam is generated through a first image generation source, the first image generation source comprises a silicon-based liquid crystal chip, a digital light processing chip or a thin film transistor liquid crystal display screen, and the first image light beam comprises image information. According to the double-screen air projection method, a first light beam and a second light beam with different polarization states are generated through a first image generation source and a second image generation source respectively, shaping processing is carried out through a plane mirror located on a light beam propagation path, and finally a stable double-screen virtual image is formed in air.

Description

Technical Field

[0001] The present invention relates to the technical field of automotive projection display, and particularly to a dual-screen air projection method, system, and automotive display device. Background Art

[0002] Traditional automotive display methods, such as touch operations on the center console screen or HUD (Head-Up Display), have significant limitations in human-computer interaction. For example, touch operations on the center console screen require the driver to distractedly reach out and operate during driving, posing a safety hazard; while traditional button and knob operations are not intuitive and convenient enough, especially for controlling complex functions, which appears cumbersome. Although air projection technology, as an emerging display means, has gradually attracted attention, existing air projection systems usually rely on complex water curtain or fog screen imaging, which not only increases the volume and cost of the system, but also the imaging quality is easily affected by external environmental factors (such as temperature, humidity), resulting in unstable imaging and poor visual effects.

[0003] In addition, most existing air projection systems only support single-screen imaging, making it difficult to achieve rich 3D effects and multi-dimensional information display, and unable to meet the higher requirements of drivers and passengers for information display and interactive experience in the modern automotive driving environment. Especially when driving at high speed or in complex road conditions, drivers need to quickly and accurately obtain key information, which poses higher requirements for automotive display devices. Summary of the Invention

[0004] The present invention provides a dual-screen air projection method, system, and automotive display device, which can directly form an image in the air, have a small volume, strong 3D effects, and are not easily affected by the external environment.

[0005] The technical solution of the present invention to solve the above technical problems is as follows: On the one hand, a dual-screen air projection method is provided, and the steps of the method include: Generating a first image beam through a first image generation source, where the first image generation source includes a liquid crystal on silicon chip, a digital light processing chip, or a thin film transistor liquid crystal display screen, and the first image beam contains image information; Performing shaping processing on the first image beam through a plane mirror located on the light propagation path of the first image generation source, where the incident surface of the plane mirror is coated with a semi-transparent and semi-reflective film or a CMF film, and the outgoing surface is coated with an anti-reflection film, so that the first image beam forms a virtual image in the air at a preset position after reflection; Placing a second image generation source at a suitable position where the virtual image is formed, and the second image generation source emits a second image beam, and the second image beam passes through the plane mirror and exits into the air, and is superimposed with the first image beam to form a dual-screen virtual image.

[0006] On the other hand, a dual-screen air projection system is provided for implementing the dual-screen air projection method as described above. The projection system includes: A first image generation source for emitting a first image light beam; A planar reflecting mirror located on the light beam propagation path of the first image generation source for shaping the first image light beam and forming a virtual image in the air; A second image generation source for emitting a second image light beam, the second image light beam passing through the planar reflecting mirror and superimposing with the first image light beam to form a dual-screen virtual image; A rotating structure including a base and a motor for achieving 360° rotating imaging; An intelligent interaction control system including a voice recognition module, an eye tracking module, and an action recognition module for real-time interactive control of the dual-screen virtual image.

[0007] On yet another aspect, an in-vehicle display device is provided, including the dual-screen air projection system as described above. The display device further includes: A display controller for switching and adjusting the display content of the dual-screen virtual image according to the driving state and user requirements; A safety detection module for real-time monitoring of the driving environment to avoid interference of the dual-screen virtual image with driving safety; The display controller includes: A user preference learning module for analyzing the user's historical operation data through machine learning algorithms to adjust the display content and interaction mode of the dual-screen virtual image; A dynamic environment adaptation module for real-time adjustment of the display parameters of the dual-screen virtual image according to the vehicle speed, road conditions, and weather conditions to ensure the best visual effect.

[0008] The beneficial effects of the present invention are: The dual-screen air projection method of the present invention generates a first light beam and a second light beam with different polarization states respectively through a first image generation source and a second image generation source, and performs shaping through a planar reflecting mirror located on the light beam propagation path, and finally forms a stable dual-screen virtual image in the air. This technical solution solves the problems of large volume, high cost, and unstable imaging quality brought by the existing air projection system relying on complex water curtains or fog screens for imaging.

[0009] Furthermore, by plating a semi-transparent and semi-reflective film or a CMF film on the light incident surface of the planar mirror and an anti-reflection film on the light exit surface, the present invention achieves the effect of direct imaging in air, not only reducing the dependence on a physical screen, but also reducing the volume and cost of the system. Secondly, the design of the double-screen virtual image makes the imaging content more abundant and the 3D effect more significant, enhancing the visual experience. Especially when driving at high speed or in complex road conditions, the driver can quickly and accurately obtain key driving information through the double-screen virtual image, while passengers can also enjoy an independent entertainment and information interaction screen, improving the overall driving safety and comfort.

[0010] In addition, in the double-screen air projection method of the present invention, through the intelligent rotation imaging and interaction control system, users can flexibly adjust the display content and viewing angle according to their needs to ensure the best visual effect in various driving environments. The above description is only an overview of the technical solution of the present invention. In order to understand the technical means of the present invention more clearly and implement it according to the content of the specification, the following will be described in detail with reference to the preferred embodiments of the present invention and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 is a flowchart of the double-screen air projection method in an embodiment of the present invention; Figure 2 is the principle of the double-screen air projection method in an embodiment of the present invention Figure 1 ; Figure 3 is the principle of the double-screen air projection method in an embodiment of the present invention Figure 2 ; In the drawings: 1, eye box; 2, planar mirror; 3, first image generation source; 4, virtual image; 5, second image generation source; 6, base; 7, motor. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0012] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0013] The term "including" and any variations thereof in the description and claims of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units need not be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices. In addition, the use of "and / or" in the description and claims means at least one of the connected objects. For example, A and / or B means including three cases: A alone, B alone, and both A and B present.

[0014] In the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0015] The present invention provides the following preferred embodiments: Embodiment 1 To solve the problems of unstable imaging quality and difficulty in realizing multi-dimensional information display in existing air projection systems, this embodiment provides the imaging process of a dual-screen air projection method. Specifically, this embodiment details how to generate a first image beam through a first image generation source and perform shaping processing on it through a plane mirror, and finally form a virtual image in the air. On this basis, this embodiment also explores how to place a second image generation source at a suitable position for virtual image imaging to achieve the superimposed imaging of dual-screen virtual images. As Figures 1 to 3 shown, the steps of the dual-screen air projection method include: S100. Generate a first image beam through a first image generation source 3. The first image generation source includes a liquid crystal on silicon chip, a digital light processing chip, or a thin film transistor liquid crystal display screen, and the first image beam contains image information.

[0016] S200. Perform shaping processing on the first image beam through a plane mirror 2 located on the light beam propagation path of the first image generation source 3. The incident surface of the plane mirror 2 is coated with a semi-transparent and semi-reflective film or a CMF film, and the exit surface is coated with an anti-reflection film, so that the first image beam forms a virtual image 4 in the air at a preset position after reflection.

[0017] S300. Place a second image generation source 5 at a suitable position for virtual image 4 imaging. The second image generation source 5 emits a second image beam. The second image beam passes through the plane mirror 2 and exits into the air, and is superimposed with the first image beam to form a dual-screen virtual image.

[0018] The first image generation source 3 adopted in this embodiment can be a liquid crystal on silicon chip (LCoS), which can generate image light beams with high resolution and high contrast. The working principle of the liquid crystal on silicon chip is to convert image information into optical signals through the electro-controlled deflection characteristics of liquid crystal materials. The reason for choosing the liquid crystal on silicon chip is that it has high resolution and low power consumption, making it suitable for long-term stable operation in the vehicle environment. The first image light beam generated by the first image generation source contains image information, which can be the vehicle speed, navigation instructions, prompts from the driving assistance system, etc.

[0019] Further, the first image light beam generated by the first image generation source 3 is shaped by a plane mirror 2 located on its light beam propagation path during propagation. The incident surface of this plane mirror is coated with a semi-transparent and semi-reflective film, and the exit surface is coated with an anti-reflection film. It should be understood that the function of the semi-transparent and semi-reflective film is to allow partial light beams to be reflected without affecting the propagation of the first image light beam, thereby achieving the shaping of the light beam. The anti-reflection film is used to reduce the reflection loss of the light beam on the exit surface, ensuring that more light beams can pass through the mirror and enter the air. In this way, after being processed by the mirror, the first image light beam forms a virtual image 4 in the air at a preset position. The formation position of the virtual image can be adjusted according to the actual application scenario to ensure that the driver can observe clear image information at the most suitable position.

[0020] Further, a second image generation source 5 is placed at a suitable position where the virtual image 4 is formed. The second image generation source also adopts a liquid crystal on silicon chip, and the second image light beam generated by it passes through the plane mirror 2 and exits into the air, overlapping with the first image light beam to form a double-screen virtual image. The image information of the second image generation source can be passenger entertainment content, itinerary details, etc., which complement the driving information of the first image generation source. It should be understood that the light beam of the second image generation source will not be affected by the first image light beam when passing through the plane mirror, ensuring the independence of the two light beams and the clarity after superposition.

[0021] It can be understood that through the superposition imaging of the double-screen virtual image, not only can the display content be enriched, but also a more realistic 3D effect can be achieved. The driver and passengers can choose to observe different virtual image contents according to their needs, improving the efficiency of information acquisition and the visual experience. In addition, the design of the double-screen virtual image makes the display area more flexible and can be adjusted according to the interior space layout of the vehicle without relying on a fixed physical screen.

[0022] The benefits of this embodiment are as follows. By using a liquid crystal on silicon (LCOS) chip as the image generation source and combining it with the shaping process of a planar mirror, the effect of direct imaging in air is achieved. This method not only reduces the dependence on a physical screen but also significantly reduces the volume and cost of the system. At the same time, the design of the double-screen virtual image makes the imaging content more abundant and the 3D effect more prominent, enhancing the user's visual experience. Especially under high-speed driving or complex road conditions, the driver can quickly and accurately obtain key driving information through the double-screen virtual image, while passengers can also enjoy an independent entertainment and information interaction screen, improving driving safety and comfort. Through this embodiment, not only the problem of unstable imaging quality in the existing air projection system is solved, but also the function of multi-dimensional information display is realized, providing a new solution for the development of automotive display technology.

[0023] Embodiment Two To solve the possible glare problem that may occur when the image enters the eyebox in the existing air projection system, this embodiment further optimizes the design of the micro-projection module in the double-screen air projection method. Specifically, this embodiment details how to generate the first image beam through the micro-projection module and ensure that the image enters the eyebox softly through the light homogenizer and the Fresnel lens, avoiding the glare formed by the LED imaging in the eyebox. In addition, this embodiment also introduces an adaptive light intensity adjustment module to adjust the light intensity of the image beam in real time according to the ambient light intensity, ensuring the best imaging effect under different lighting conditions.

[0024] Furthermore, the micro-projection module selected in this embodiment includes a light homogenizer, which can be a reflective type or a transmissive type. The function of the light homogenizer is to homogenize the image beam from the first image generation source 3, making the image beam softer when entering the eyebox and avoiding the glare phenomenon caused by the direct imaging of the LED on the eyebox. The reflective light homogenizer is suitable for application scenarios where the beam needs to be reflected back to the eyes, while the transmissive light homogenizer is more suitable for the situation where the beam directly passes through and enters the eyes. Selecting the appropriate type of light homogenizer can ensure that no dazzling bright spots are generated when the image beam enters the eyebox, thus improving the user's visual comfort.

[0025] Furthermore, a Fresnel lens is also configured in the micro-projection module, and this lens is located between the illumination optical path and the light homogenizer. The main function of the Fresnel lens is to enhance the brightness and uniformity of the image, ensuring that the image beam has been fully enhanced and homogenized before entering the eyebox. The use of the Fresnel lens not only increases the brightness of the image but also makes the brightness distribution of the image more uniform at different viewing angles, eliminating the common brightness non-uniformity phenomenon. In addition, the Fresnel lens can be replaced by a DOE lens, which has a higher diffraction efficiency and can precisely control the light intensity distribution while maintaining a high light intensity, further improving the image quality.

[0026] Furthermore, in order to cope with the changes in different ambient light intensities, an adaptive light intensity adjustment module is introduced in this embodiment. This module is built-in with a first adjustment algorithm for adjusting the light intensity of the first image beam in real time according to the ambient light intensity. Specifically, the expression of the first adjustment algorithm is: , where I out represents the adjusted light intensity, I in represents the initial light intensity, L env represents the ambient light intensity, L ref represents the reference light intensity threshold. Through the first adjustment algorithm, the system can dynamically adjust the light intensity of the image beam according to the intensity of the ambient light, ensuring that the image will not be too dim in a bright environment and will not be too bright and dazzling in a dim environment. It should be understood that this adaptive adjustment mechanism not only improves the visibility of the image but also reduces the user's visual fatigue.

[0027] The benefits of this embodiment are that by introducing the micro-projection module, the light homogenizing sheet, the Fresnel lens, and the adaptive light intensity adjustment module, this embodiment effectively solves the problem of glare that may occur when the image enters the eyebox and ensures the best imaging effect under different lighting conditions. The design of the micro-projection module makes the image beam softer, avoiding the discomfort caused by the direct imaging of the LED on the eyebox. At the same time, the adaptive light intensity adjustment module adjusts the light intensity in real time according to the ambient light intensity, further enhancing the user's visual experience. Through this embodiment, the dual-screen air projection system not only improves the imaging quality but also provides a more comfortable visual environment for the user.

[0028] Embodiment Three In order to solve the problems of light loss and insufficient imaging clarity in the existing air projection system, this embodiment further optimizes the design of the plane mirror in the dual-screen air projection method. Specifically, this embodiment details how to reduce light loss and improve the brightness and clarity of the image by coating a CMF film on the incident surface of the plane mirror, an anti-reflection film on the exit surface, and setting a polarization control layer. In addition, this embodiment also introduces an adaptive polarization adjustment module to adjust the polarization state of the image beam in real time according to the polarization characteristics of the ambient light, ensuring that the image always has high contrast and clarity.

[0029] Furthermore, the incident surface of the planar mirror 2 selected in this embodiment is coated with a CMF film. The main function of the CMF film is to reduce the light loss during the reflection of the first image beam, ensuring that more light can be reflected and used for imaging. The CMF film has specific optical properties, which can effectively reduce light loss during reflection and improve the imaging quality. The exit surface is coated with an antireflection film, and the function of the antireflection film is to reduce the reflectivity of light, ensuring that more light can pass through the planar mirror 2, thereby improving the brightness and clarity of the image. It should be understood that through the combination of these two coating technologies, this embodiment not only reduces light loss but also increases the light transmittance, making the image brighter and clearer when formed in the air.

[0030] Furthermore, this embodiment also sets polarization control layers on the incident surface and the exit surface of the planar mirror 2. The main function of the polarization control layer is to control the polarization state of the first image beam to enhance the contrast and clarity of the virtual image 4. The polarization control layer adjusts the polarization state of the beam, making the image beam have a higher contrast when formed in the air, reducing the interference of background light, and thus enhancing the clarity of the image. In addition, the polarization control layer further includes an adaptive polarization adjustment module, which is built-in with a second adjustment algorithm for real-time adjustment of the polarization state of the first image beam according to the polarization characteristics of the ambient light. Specifically, the expression of the second adjustment algorithm is: , where P out represents the initial polarization state, P in represents the initial polarization state, P env represents the polarization characteristics of the ambient light, P ref represents the reference polarization threshold, and ΔP represents the polarization adjustment amplitude. Through the second adjustment algorithm, the system can dynamically adjust the polarization state of the image beam according to the polarization characteristics of the ambient light, ensuring that the image always has high contrast and clarity. It can be understood that this adaptive adjustment mechanism not only improves the visibility of the image but also reduces the interference of background light, further enhancing the user's visual experience.

[0031] The benefits of this embodiment are that by introducing the CMF film, the antireflection film, and the polarization control layer, this embodiment effectively reduces light loss and enhances the brightness and clarity of the image. The design of the planar mirror enables more light to be reflected and transmitted, thereby improving the brightness and clarity of the image. At the same time, the adaptive polarization adjustment module adjusts the polarization state of the beam in real time according to the polarization characteristics of the ambient light, further enhancing the contrast and clarity of the image.

[0032] Embodiment Four To solve the problems of unclear 3D effect and single display content in the existing air projection system, this embodiment further optimizes the design of the second image generation source in the dual-screen air projection method. Specifically, this embodiment details how to use a DLP projection, an LCOS projection module, or a laser projection module as the second image generation source to achieve complementary image information with the first image generation source and jointly form a complete 3D effect. In addition, this embodiment also introduces a dynamic adjustment mechanism for beam intensity and angle, as well as a color adjustment module, to adapt to different driving environments and user preferences and ensure that the image always has the best visual effect.

[0033] Furthermore, the second image generation source 5 selected in this embodiment uses a DLP projection, an LCOS projection module, or a laser projection module. These projection modules have the characteristics of high resolution and high brightness and can generate high-quality image beams. The DLP projection module realizes image generation through a micromirror array, the LCOS projection module utilizes the deflection characteristics of a liquid crystal on silicon chip, and the laser projection module generates images through laser beam scanning. The selection of the three projection modules enables the second image generation source to be flexibly adjusted according to different application scenarios to meet diverse display requirements. It should be understood that the image information of the second image generation source is complementary to the image information of the first image generation source 3 and jointly forms a complete 3D effect. For example, the first image generation source can display key driving information, while the second image generation source can display passenger entertainment content or itinerary details, and the combination of the two makes the display content more abundant.

[0034] Furthermore, this embodiment also introduces a dynamic adjustment mechanism for beam intensity and angle. The beam intensity and angle of the second image generation source 5 can be dynamically adjusted according to requirements to adapt to different driving environments and user preferences. Specifically, the adjustment of beam intensity can be made in real time according to ambient light intensity and user needs to ensure that the image always has the best brightness. The adjustment of the angle can be intelligently adjusted according to the user's line of sight direction to ensure that the user is always in the best viewing position. In addition, the beam generated by the second image generation source also needs to undergo secondary shaping processing by the plane mirror 2 to ensure that the second image beam is perfectly superimposed on the first image beam to form a seamless dual-screen virtual image. The secondary shaping processing includes detailed adjustment of the angle, intensity, and color of the second image beam, and the specific expression is: , where I 1 and I 2 respectively represent the intensities of the first image beam and the second image beam, and α is an adjustment coefficient between 0 and 1. Through this expression, the system can dynamically adjust the intensity of the second image beam according to actual needs to ensure the best superimposition effect with the first image beam.

[0035] Furthermore, this embodiment also introduces a color adjustment module, which is built with a color temperature adaptive algorithm for adjusting the color of the second image beam in real time according to the color temperature of the ambient light. Specifically, the expression of the color temperature adaptive algorithm is: , where C in represents the initial color, T env represents the color temperature of the ambient light, T ref represents the reference color temperature threshold, and ΔC represents the color adjustment amplitude. Through the color temperature adaptive algorithm, the system can dynamically adjust the color of the second image beam according to the color temperature of the ambient light, ensuring that the image always has the best color performance. It can be understood that this adaptive adjustment mechanism not only improves the color consistency of the image but also reduces the influence of ambient light on the image color.

[0036] The benefits of this embodiment are that by introducing a DLP projection, an LCOS projection module, or a laser projection module as the second image generation source, this embodiment realizes image information complementary to the first image generation source, jointly constituting a complete 3D effect. The dynamic adjustment mechanism of the beam intensity and angle and the introduction of the color adjustment module enable the image to always have the best visual effect, adapting to different driving environments and user preferences.

[0037] Embodiment Five To solve the problems of limited visual range and single interaction method in the existing air projection system, this embodiment further optimizes the rotation structure design in the dual-screen air projection method. As Figure 3 shown, this embodiment details how to achieve 360° rotation by adding a base and a motor under the imaging structure to obtain an all-round visual range. In addition, this embodiment also introduces an intelligent voice, eye tracking, and action recognition system for real-time interactive control of the dual-screen virtual image, ensuring that users can flexibly adjust the display content and perspective according to their needs. Finally, this embodiment also introduces an intelligent angle compensation module to dynamically adjust the angle of the dual-screen virtual image according to the driving posture of the vehicle, ensuring that the image is always perpendicular to the user's line of sight.

[0038] Furthermore, this embodiment adds a base 6 and a motor 7 under the imaging structure to achieve 360° rotation of the imaging structure. The design of the base and the motor enables the entire imaging structure to rotate freely within a 360° range, thus achieving an all-round visual range. This design not only expands the user's visual range but also enhances the user's visual experience. It should be understood that the 360° rotation design allows users to observe the dual-screen virtual image from any angle without being restricted by a fixed perspective, thus enhancing the flexibility of use. In addition, the design of the base and the motor also takes into account the stability during vehicle driving, ensuring that the dual-screen virtual image will not be distorted due to vibration during vehicle driving.

[0039] Furthermore, this embodiment also introduces intelligent voice, eye tracking, and action recognition systems for real-time interactive control of the dual-screen virtual image. Through speech recognition technology in the intelligent voice system, users can control the display content and viewing angle of the dual-screen virtual image through voice commands. The eye tracking system captures the user's eye movements through a camera, and the system can automatically adjust the display content and viewing angle of the dual-screen virtual image according to the user's line of sight direction. The action recognition system captures the user's limb movements through a camera, and users can control the display content and viewing angle of the dual-screen virtual image through gestures and other actions. These interaction methods not only improve the user's interaction experience but also enable users to interact with the dual-screen virtual image more naturally and conveniently. It can be understood that the introduction of multiple interaction methods not only improves the user's interaction experience but also enables users to choose the most suitable interaction method according to different needs, enhancing the convenience of use.

[0040] Furthermore, this embodiment also introduces an intelligent angle compensation module, which is built with an angle compensation algorithm for dynamically adjusting the angle of the dual-screen virtual image according to the driving posture of the vehicle to ensure that the image is always perpendicular to the user's line of sight. Specifically, the expression of the angle compensation algorithm is: , where θ comp represents the compensated posture angle, θ vehicle represents the posture angle of the vehicle, v represents the vehicle speed, v ref represents the reference speed threshold, and Δθ represents the compensation angle. Through the angle compensation algorithm, the system can dynamically adjust the angle of the dual-screen virtual image according to the driving posture of the vehicle to ensure that the image is always perpendicular to the user's line of sight. It can be understood that this intelligent angle compensation mechanism not only improves the visibility of the image but also reduces the visual fatigue of users when observing the image in different driving postures.

[0041] The benefits of this embodiment are that by introducing a base and a motor to achieve 360° rotation, this embodiment not only expands the user's visual range but also enhances the user's visual experience. The introduction of intelligent voice, eye tracking, and action recognition systems enables users to interact with the dual-screen virtual image more naturally and conveniently, enhancing the convenience of use. The introduction of the intelligent angle compensation module ensures that the image is always perpendicular to the user's line of sight.

[0042] Embodiment Six To address the issues of a single interaction method and the inability to anticipate user operation intentions in existing air projection systems, this embodiment further optimizes the intelligent interaction control mechanism in the dual-screen air projection method. Specifically, this embodiment details how to perform real-time data analysis and interaction through a voice recognition module, an eye tracking module, and an action recognition module, and introduces a behavior prediction module to anticipate user operation intentions in advance based on the user's historical operation habits, thereby achieving a more intelligent and efficient interaction experience.

[0043] Furthermore, this embodiment realizes the advance anticipation of user operation intentions through the behavior prediction algorithm built into the behavior prediction module. This algorithm first collects the user's historical operation data and constructs a user behavior database. These historical data include various behavior records of the user when operating the dual-screen virtual image in the past, such as voice commands, gesture actions, and eye movement trajectories. By constructing the user behavior database, the system can accumulate a large amount of user operation data, providing a basis for subsequent predictions. It should be understood that the user behavior database not only records the user's operation content but also records the timestamp of each operation, which provides important time dimension information for subsequent time series analysis.

[0044] Furthermore, this embodiment uses a deep neural network model to train the user behavior database to obtain a user behavior prediction model. The input of this model is the user's current operation state, and the output is the probability distribution of the user's expected operation. Specifically, through learning a large amount of user behavior data, the deep neural network can identify the patterns in the user operation mode and predict the user's next operation intention accordingly. For example, when the user frequently uses a certain gesture for operation, the system can recognize this pattern and anticipate the operation intention in advance when the user makes a similar gesture again, thereby accelerating the response speed. It can be understood that the training process of the deep neural network model not only improves the prediction accuracy but also enables the system to continuously optimize its prediction ability to adapt to the operation habits of different users.

[0045] Furthermore, the behavior prediction algorithm also includes a multimodal fusion module for analyzing the user's voice, gestures, and eye movements to improve the prediction accuracy. The multimodal fusion module can more comprehensively understand the user's operation intention by combining the user's multiple interaction methods. Specifically, the expression of multimodal fusion is: , where P multi represents the probability of the user's operation after multimodal fusion, P voice , P gesture and P eye respectively represent the probabilities of voice, gesture, and eye movement, m represents the number of time windows, t represents the current time, ω j represents the weight of the jth time window, t jdenotes the timestamp of the j-th time window, σ j denotes the time deviation, α j , β j , γ j respectively represent the weight coefficients of speech, gesture, and eye movement. Through the expression of multimodal fusion, the system can comprehensively consider various interaction methods of users and improve the accuracy of prediction.

[0046] Furthermore, the behavior prediction algorithm also calculates the user's next operation according to the probability distribution of the user's expected operation. The specific expression is: , where, P next represents the next operation, P i represents the probability of the i-th operation, w i represents the weight coefficient of the i-th operation, t i represents the timestamp of the i-th operation, σ i represents the time deviation, n represents the number of operation types, and t represents the current time. Through the behavior prediction algorithm, the system can anticipate the user's next operation according to the user's historical operation pattern, so as to achieve a more intelligent interaction experience.

[0047] The benefit of this embodiment is that by introducing the behavior prediction module and the multimodal fusion module, this embodiment not only realizes the advance prediction of the user's operation intention, but also improves the intelligent level of interaction. Users can interact through various methods such as speech, gesture, and eye movement. The system can anticipate the user's operation intention in advance according to the user's historical operation habits and current operation status, so as to speed up the response speed.

[0048] Embodiment Seven To solve the problem that the imaging effect in the existing air projection system is unstable under different lighting conditions, this embodiment further optimizes the design of the plane mirror in the double-screen air projection method. Specifically, this embodiment details how to monitor the ambient light intensity in real time through an ambient light sensor and adjust the transmittance and reflectance of the semi-transparent and semi-reflective film through a feedback control system to enhance the imaging effect under different lighting conditions.

[0049] Furthermore, the light incident surface of the plane mirror 2 selected in this embodiment is coated with a semi-transparent and semi-reflective film, and the transmittance and reflectivity of the semi-transparent and semi-reflective film can be adaptively adjusted according to the ambient light intensity. The ambient light sensor monitors the ambient light intensity in real time and adjusts the transmittance and reflectivity of the semi-transparent and semi-reflective film through a feedback control system. It should be understood that the ambient light sensor can not only monitor the light intensity but also analyze the spectral characteristics of the ambient light to optimize the adjustment strategy of the semi-transparent and semi-reflective film. Specifically, the spectral analysis module of the ambient light sensor can identify the light components of different wavelengths by analyzing the spectral characteristics of the ambient light, thereby optimizing the adjustment strategy of the semi-transparent and semi-reflective film.

[0050] Furthermore, the spectral analysis expression of the ambient light sensor is: , where S(λ) represents the spectral analysis result, I(λ) represents the intensity of the ambient light at wavelength λ, λ min and λ max represent the minimum and maximum wavelengths of the spectrum respectively, λ avg represents the average wavelength, and σ λ represents the wavelength deviation. Through the spectral analysis expression, the ambient light sensor can comprehensively analyze the spectral characteristics of the ambient light, thereby providing an accurate basis for the adjustment of the semi-transparent and semi-reflective film. It can be understood that the result of spectral analysis not only improves the accuracy of transmittance and reflectivity adjustment but also optimizes the imaging effect, making the image clear and stable under different lighting conditions.

[0051] Furthermore, the feedback control system adjusts the transmittance and reflectivity of the semi-transparent and semi-reflective film in real time according to the data provided by the ambient light sensor. Specifically, when the ambient light is strong, the system will appropriately increase the reflectivity to enhance the brightness and contrast of the image; when the ambient light is weak, the system will appropriately increase the transmittance to ensure the clarity of the image. It should be understood that the design of the feedback control system not only improves the stability of the imaging effect but also reduces the influence of ambient light on the imaging quality. In addition, the feedback control system also considers the characteristics of light of different wavelengths to ensure the best imaging effect under different lighting conditions.

[0052] The benefit of this embodiment is that by introducing the ambient light sensor and the feedback control system, this embodiment not only realizes the real-time adjustment of the transmittance and reflectivity of the semi-transparent and semi-reflective film but also optimizes the imaging effect. The spectral analysis module of the ambient light sensor further improves the adjustment accuracy by analyzing the spectral characteristics of the ambient light, making the image clear and stable under different lighting conditions.

[0053] Embodiment Eight To solve the problem of unstable imaging effects caused by beam deflection angles and ambient light interference in existing air projection systems, this embodiment further optimizes the adaptive optical algorithm in the dual-screen air projection method. Specifically, this embodiment details how to adjust the beam deflection angle through the adaptive optical algorithm and optimize the imaging effect based on the ambient light interference vector.

[0054] Furthermore, the adaptive optical algorithm in this embodiment satisfies the following constraint conditions: , where, I adjusted represents the adjusted light intensity, I 0 is the initial light intensity, L is the optical path function, θn is the nth beam deflection angle, E env is the ambient light interference vector, α is the attenuation coefficient, Δθ n represents the change in the beam deflection angle, and k represents the number of beam deflection angles. Through this formula, the system can dynamically adjust the light intensity according to the ambient light interference vector and the change in the beam deflection angle, optimizing the imaging effect. It should be understood that the optical path function L describes the path change of the beam during propagation, and the change in the beam deflection angle directly affects the propagation direction and imaging position of the beam.

[0055] Furthermore, the ambient light interference vector E env describes the degree of interference of ambient light on the imaging effect. Specifically, the ambient light interference vector includes information in multiple dimensions such as the direction, intensity, and color of the ambient light. The system dynamically adjusts the propagation path and light intensity of the beam by real-time monitoring the interference situation of the ambient light, ensuring that the imaging effect is not affected by the ambient light. It can be understood that the introduction of the ambient light interference vector not only improves the stability of the imaging effect but also reduces the impact of ambient light on the image quality.

[0056] Furthermore, the attenuation coefficient α controls the degree of influence of the ambient light interference vector on the light intensity adjustment. When the ambient light interference is strong, the system will appropriately increase the attenuation coefficient α to reduce the impact of ambient light on the imaging effect; when the ambient light interference is weak, the system will appropriately decrease the attenuation coefficient α to ensure the clarity of the image. It should be understood that the design of the attenuation coefficient not only improves the stability of the imaging effect but also optimizes the brightness and contrast of the image. In addition, the system also considers the imaging effects under different ambient light interference conditions to ensure the best imaging effect in different environments.

[0057] The benefits of this embodiment are that by introducing the adaptive optical algorithm, this embodiment not only realizes the dynamic adjustment of the beam deflection angle but also optimizes the imaging effect based on the ambient light interference vector. The introduction of the ambient light interference vector enables the system to real-time monitor the interference situation of the ambient light and dynamically adjust the light intensity according to the actual situation, ensuring that the imaging effect is not affected by the ambient light.

[0058] Embodiment Nine To solve the problems of fixed imaging structure and single interaction method in the existing air projection system, this embodiment provides a dual-screen air projection system. Specifically, this embodiment details how to achieve 360° rotational imaging through a base and a motor, and perform real-time interactive control on the dual-screen virtual image through a voice recognition module, an eye tracking module, and a motion recognition module, so as to achieve a more flexible and convenient interaction experience.

[0059] Further, as Figure 3 shown, the rotation structure in this embodiment includes a base 6 and a motor 7, which are used to achieve 360° rotation of the imaging structure. The design of the base and the motor enables the entire imaging structure to rotate freely within a 360° range, thereby achieving an all-round viewing range. This design not only expands the user's viewing range but also enhances the user's visual experience. It should be understood that the 360° rotation design allows users to observe the dual-screen virtual image from any angle without being restricted by a fixed viewing angle, thus enhancing the flexibility of use. In addition, the design of the base and the motor also takes into account the stability during vehicle driving to ensure that the dual-screen virtual image will not be distorted due to vibration during vehicle driving.

[0060] Further, the intelligent interaction control system in this embodiment includes a voice recognition module, an eye tracking module, and a motion recognition module, which are used to perform real-time interactive control on the dual-screen virtual image. Through voice recognition technology in the voice recognition module, users can control the display content and viewing angle of the dual-screen virtual image through voice commands. Through the camera in the eye tracking module to capture the user's eye movement, the system can automatically adjust the display content and viewing angle of the dual-screen virtual image according to the user's line of sight direction. Through the camera in the motion recognition module to capture the user's body movements, users can control the display content and viewing angle of the dual-screen virtual image through gestures and other movements. These interaction methods not only improve the user's interaction experience but also enable users to interact with the dual-screen virtual image more naturally and conveniently. It can be understood that the introduction of multiple interaction methods not only improves the user's interaction experience but also enables users to select the most suitable interaction method according to different needs, enhancing the convenience of use.

[0061] Further, the intelligent interaction control system in this embodiment further includes an intelligent angle compensation module, which is built-in with an angle compensation algorithm and is used to dynamically adjust the angle of the dual-screen virtual image according to the driving posture of the vehicle to ensure that the image is always perpendicular to the user's line of sight. It can be understood that this intelligent angle compensation mechanism not only improves the visibility of the image but also reduces the visual fatigue of users when observing the image in different driving postures.

[0062] The benefits of this embodiment are as follows. By introducing a base and a motor, 360° rotation is achieved, and the visual range of users is expanded in this embodiment. The introduction of the intelligent interaction control system enables users to interact with the dual-screen virtual image more naturally and conveniently, enhancing the convenience of use. The introduction of the intelligent angle compensation module ensures that the image is always perpendicular to the user's line of sight, further enhancing the user's visual experience.

[0063] Embodiment Ten To solve the problem that the display content in existing automotive display devices is single and cannot be dynamically adjusted according to the driving state and user needs, this embodiment provides a display controller and a safety detection module including a dual-screen air projection system. Specifically, this embodiment details how to switch and adjust the display content of the dual-screen virtual image by the display controller according to the driving state and user needs, and how to monitor the driving environment in real time through the safety detection module to avoid interference of the dual-screen virtual image with driving safety.

[0064] Furthermore, the display controller in this embodiment includes a user preference learning module and a dynamic environment adaptation module. The user preference learning module analyzes the historical operation data of users through machine learning algorithms to adjust the display content and interaction methods of the dual-screen virtual image. Specifically, through learning the user operation data, the user preference learning module can identify the preferences and habits of users, so as to anticipate their needs in advance and automatically adjust the display content and interaction methods when the user operates next time. For example, when a user often views navigation information during driving, the system will automatically display the navigation interface when the user starts the vehicle, reducing the number of manual operations of the user. It can be understood that the user preference learning module not only improves the operation efficiency of users, but also enables the system to better adapt to the usage habits of different users.

[0065] Furthermore, the dynamic environment adaptation module adjusts the display parameters of the dual-screen virtual image in real time according to the speed, road conditions, and weather conditions of the vehicle to ensure the best visual effect. Specifically, by monitoring the speed, road conditions, and weather conditions of the vehicle in real time, the dynamic environment adaptation module can dynamically adjust parameters such as the brightness, contrast, and color of the display content according to the actual situation, ensuring that users can obtain the best visual effect in different driving environments. For example, when driving at night, the system will reduce the brightness of the display content to avoid dazzling light affecting the driver's line of sight; while when driving during the day, the system will appropriately increase the brightness of the display content to ensure that users can clearly see the display content. It should be understood that the design of the dynamic environment adaptation module not only improves the visibility of the display content, but also reduces the influence of environmental factors on the display effect.

[0066] Furthermore, the safety detection module in this embodiment is used to monitor the driving environment in real time to avoid interference of the dual-screen virtual image with driving safety. Specifically, the safety detection module monitors various information in the driving environment in real time through sensors and cameras, such as the traffic conditions around the vehicle, road signs, and weather conditions. When potential safety hazards are detected, the system automatically adjusts the display content of the dual-screen virtual image to avoid distracting the driver's attention. For example, when the vehicle approaches an intersection, the system automatically hides unnecessary display content to ensure that the driver can focus on driving operations. It can be understood that the design of the safety detection module not only improves driving safety but also reduces the interference of the dual-screen virtual image with driving operations.

[0067] The advantages of this embodiment are that by introducing the user preference learning module and the dynamic environment adaptation module, this embodiment not only realizes the dynamic adjustment of the display content of the dual-screen virtual image according to the driving state and user needs but also ensures driving safety through the safety detection module. The user preference learning module can anticipate the user's needs in advance by learning the user operation data, automatically adjust the display content and interaction methods, and improve the user's operation efficiency; the dynamic environment adaptation module adjusts the display parameters in real time according to the vehicle speed, road conditions, and weather conditions to ensure that the user can obtain the best visual effect in different driving environments; the safety detection module monitors the driving environment in real time to avoid interference of the dual-screen virtual image with driving safety and improves driving safety.

[0068] The above embodiments have further elaborated on the purpose, technical solutions, and beneficial effects of the present invention. It should be understood that the above are only specific embodiments of the present invention and are not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made on the basis of the technical solutions of the present invention shall be included in the protection scope of the present invention.

Claims

1. A dual-screen air projection method, characterized in that: The steps of the method include: A first image light beam is generated by a first image generation source (3), wherein the first image generation source comprises a silicon-based liquid crystal chip, a digital light processing chip or a thin film transistor liquid crystal display screen, and the first image light beam contains image information; The first image light beam is shaped by a plane reflector (2) located on the light beam propagation path of the first image generation source (3), wherein the light incident surface of the plane reflector (2) is coated with a semi-transparent semi-reflective film or a CMF film, and the light exit surface is coated with an anti-reflection film, so that the first image light beam forms a virtual image (4) in the air at a preset position after reflection; A second image generating source (5) is placed at a suitable position for forming the virtual image (4), and the second image generating source (5) emits a second image light beam, which passes through the plane reflector (2) and is emitted into the air, and is superimposed with the first image light beam to form a double-screen virtual image.

2. The dual-screen air projection method according to claim 1, characterized in that: The first image generation source (3) generates the first image light beam through a micro-projection module, wherein the micro-projection module comprises a light homogenizer, which is a reflective or transmissive type, so as to ensure that the image enters the eyeball softly and avoid glare caused by the LED imaging in the eyeball; The micro-projection module further includes a Fresnel lens or a DOE lens, which is located between the illumination light path and the light homogenizing sheet to improve the brightness and uniformity of the image; The micro-projection module further includes an adaptive light intensity adjustment module, which has a built-in first adjustment algorithm for adjusting the light intensity of the first image light beam in real time according to the ambient light intensity. The expression of the first adjustment algorithm is: , where I out Indicates the adjusted light intensity, I in represents the initial light intensity, L env Indicates the ambient light intensity, L ref Indicates the reference light intensity threshold.

3. The dual-screen air projection method according to claim 1, characterized in that: The light incident surface of the plane reflector (2) is coated with a CMF film, which is used to reduce the light loss of the first image light beam during the reflection process; The light-emitting surface of the plane reflector (2) is coated with an anti-reflection film, which is used to reduce the reflectivity of light and ensure that more light can pass through the plane reflector (2) to improve the brightness and clarity of the image; The light incident surface and the light exit surface of the plane reflector (2) are also provided with polarization control layers for controlling the polarization state of the first image light beam, so as to improve the contrast and clarity of the virtual image (4); The polarization control layer further includes an adaptive polarization adjustment module, which has a second adjustment algorithm built therein, and is used to adjust the polarization state of the first image light beam in real time according to the polarization characteristics of the ambient light. The expression of the second adjustment algorithm is: , where P out represents the initial polarization state, P in represents the initial polarization state, P env Represents the polarization characteristics of ambient light, P ref represents the reference polarization threshold, and ΔP represents the polarization adjustment amplitude.

4. The dual-screen air projection method according to claim 1, characterized in that: The second image generation source (5) adopts a DLP projection, an LCOS projection module or a laser projection module, and the image information of the second image generation source (5) complements the image information of the first image generation source (3), and together form a complete 3D effect; The intensity and angle of the beam of the second image generating source (5) are dynamically adjusted according to demand to adapt to different driving environments and user preferences; The light beam generated by the second image generation source (5) undergoes secondary shaping processing by the plane reflector (2), and the second image light beam is superimposed on the first image light beam to form a seamless dual-screen virtual image. The secondary shaping processing includes finely adjusting the angle, intensity and color of the second image light beam. The expression for the fine adjustment is: , wherein I1 and I2 represent the intensities of the first image light beam and the second image light beam, respectively, and α is an adjustment coefficient between 0 and 1; The color adjustment module has a built-in color temperature adaptive algorithm for adjusting the color of the second image light beam in real time according to the color temperature of the ambient light. The expression of the color temperature adaptive algorithm is: , where C in Indicates the initial color, T env Indicates the color temperature of ambient light, T ref represents the reference color temperature threshold, and ΔC represents the color adjustment amplitude.

5. The dual-screen air projection method according to claim 1, characterized in that: A base (6) and a motor (7) are added below the imaging structure to form a rotating structure for 360° rotation of the imaging structure to obtain an all-round visual range; Real-time interactive control of the dual-screen virtual image is performed through intelligent voice, eye tracking or motion recognition system to flexibly adjust display content and viewing angle according to needs; The rotating structure also includes an intelligent angle compensation module with a built-in angle compensation algorithm for dynamically adjusting the angle of the dual-screen virtual image according to the driving posture of the vehicle to ensure that the image is always perpendicular to the user's line of sight. The expression of the angle compensation algorithm is: , where θ comp Represents the attitude angle after compensation, θ vehicle represents the vehicle's attitude angle, v represents the vehicle's speed, and v ref represents the reference speed threshold, and Δθ represents the compensation angle.

6. The dual-screen air projection method according to claim 5, characterized in that: The step of performing real-time interactive control of the dual-screen virtual image by intelligent voice, eye tracking or motion recognition system comprises: Real-time data analysis and interaction through voice recognition module, eye tracking module and motion recognition module; The user's operation intention is predicted in advance according to the user's historical operation habits through the behavior prediction module, and the behavior prediction module has a built-in behavior prediction algorithm; The steps of the behavior prediction algorithm include: Collect users' historical operation data and build a user behavior database; Using a deep neural network model to train the user behavior database to obtain a user behavior prediction model, wherein the input of the user behavior prediction model is the user's current operation state, and the output is the user's expected operation probability distribution; According to the probability distribution of the user's expected operation, the user's next operation is calculated. The expression is: , where P next Indicates the next step, P i represents the probability of the ith operation, w i represents the weight coefficient of the i-th operation, t i represents the timestamp of the i-th operation, σ i Indicates time deviation; The behavior prediction algorithm also includes a multimodal fusion module for analyzing the user's voice, gestures, and eye movements to improve the accuracy of the prediction. The expression of multimodal fusion is: , where ω j represents the weight of the jth time window, t j represents the timestamp of the jth time window, σ j represents the time deviation, α j ,β j ,γ j Represent the weight coefficients of speech, gesture and eye movement respectively.

7. The dual-screen air projection method according to claim 1, characterized in that: The light incident surface of the plane reflector (2) is coated with a semi-transparent and semi-reflective film, and the transmittance and reflectance of the semi-transparent and semi-reflective film are adaptively adjusted according to the intensity of ambient light to enhance the imaging effect under different lighting conditions; The adjustment mechanism of the semi-transmissive and semi-reflective film is based on data from an ambient light sensor, which monitors the ambient light intensity in real time and adjusts the transmittance and reflectance of the semi-transmissive and semi-reflective film through a feedback control system; The ambient light sensor also includes a spectral analysis module, which analyzes the spectral characteristics of the ambient light to optimize the adjustment strategy of the semi-transparent and semi-reflective film. The expression of the spectral analysis is: , where I(λ) represents the intensity of ambient light at wavelength λ, avg represents the average wavelength, σ λ Indicates wavelength deviation.

8. The dual-screen air projection method according to claim 7, characterized in that: The method also includes an adaptive optics algorithm, which satisfies the following constraints: , where I0 is the initial light intensity, L is the optical path function, θn is the deflection angle of the nth beam, and E env is the ambient light interference vector, and α is the attenuation coefficient.

9. A dual-screen air projection system, used to implement the dual-screen air projection method according to any one of claims 1 to 8, characterized in that: The projection system comprises: A first image generating source (3) for emitting a first image light beam; A plane reflector (2), located on the light beam propagation path of the first image generation source (3), and used for shaping the first image light beam and forming a virtual image (4) in the air; A second image generating source (5) is used to emit a second image light beam, the second image light beam passes through the plane reflecting mirror (2) and is superimposed with the first image light beam to form a dual-screen virtual image; The rotating structure comprises a base (6) and a motor (7), and is used to realize 360° rotating imaging; The intelligent interactive control system comprises a speech recognition module, an eye tracking module and a motion recognition module, and is used for real-time interactive control of the dual-screen virtual images.

10. An automobile display device, comprising the dual-screen air projection system according to claim 9, characterized in that: The display device further includes: A display controller, used to switch and adjust the display content of the dual-screen virtual image according to the driving state and user needs; A safety detection module, used to monitor the driving environment in real time to prevent the dual-screen virtual image from interfering with driving safety; The display controller comprises: A user preference learning module, which analyzes the user's historical operation data through a machine learning algorithm to adjust the display content and interaction mode of the dual-screen virtual image; The dynamic environment adaptation module adjusts the display parameters of the dual-screen virtual image in real time according to the vehicle's speed, road conditions and weather conditions to ensure the best visual effect.

Images